[ 666.396153] env[69980]: INFO neutron.common.config [-] Logging enabled! [ 666.396520] env[69980]: INFO neutron.common.config [-] /opt/stack/data/venv/bin/neutron-nsxv3-agent version 26.1.0.dev73 [ 666.396606] env[69980]: DEBUG neutron.common.config [-] command line: /opt/stack/data/venv/bin/neutron-nsxv3-agent --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/ml2/ml2_conf.ini --config-file /etc/neutron/plugins/ml2/ml2-nsxv3-1.ini {{(pid=69980) setup_logging /opt/stack/neutron/neutron/common/config.py:124}} [ 666.396905] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] VMware NSXv3 Agent initializing ... [ 666.397014] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] Eventlet blocking behavior detection initialization completed. [ 666.397820] env[69980]: WARNING oslo_policy.policy [None req-146d368d-73f3-4c7e-931a-2275b65deafb None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. [ 666.398057] env[69980]: WARNING oslo_policy.policy [None req-146d368d-73f3-4c7e-931a-2275b65deafb None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. [ 666.399527] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [None req-146d368d-73f3-4c7e-931a-2275b65deafb None None] VMware NSXv3 Agent initialized successfully. [ 666.399882] env[69980]: DEBUG oslo_concurrency.lockutils [None req-146d368d-73f3-4c7e-931a-2275b65deafb None None] Acquiring lock "singleton_lock" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.400029] env[69980]: DEBUG oslo_concurrency.lockutils [None req-146d368d-73f3-4c7e-931a-2275b65deafb None None] Acquired lock "singleton_lock" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.400237] env[69980]: DEBUG oslo_concurrency.lockutils [None req-146d368d-73f3-4c7e-931a-2275b65deafb None None] Releasing lock "singleton_lock" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.400521] env[69980]: DEBUG oslo_service.backend.eventlet.service [None req-146d368d-73f3-4c7e-931a-2275b65deafb None None] Full set of CONF: {{(pid=69980) _wait_for_exit_or_signal /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/eventlet/service.py:357}} [ 666.400729] env[69980]: DEBUG oslo_service.backend.eventlet.service [None req-146d368d-73f3-4c7e-931a-2275b65deafb None None] ******************************************************************************** {{(pid=69980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2804}} [ 666.400849] env[69980]: DEBUG oslo_service.backend.eventlet.service [None req-146d368d-73f3-4c7e-931a-2275b65deafb None None] Configuration options gathered from: {{(pid=69980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2805}} [ 666.401082] env[69980]: DEBUG oslo_service.backend.eventlet.service [None req-146d368d-73f3-4c7e-931a-2275b65deafb None None] command line args: ['--config-file', '/etc/neutron/neutron.conf', '--config-file', '/etc/neutron/plugins/ml2/ml2_conf.ini', '--config-file', '/etc/neutron/plugins/ml2/ml2-nsxv3-1.ini'] {{(pid=69980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2806}} [ 666.401256] env[69980]: DEBUG oslo_service.backend.eventlet.service [None req-146d368d-73f3-4c7e-931a-2275b65deafb None None] config files: ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini', '/etc/neutron/plugins/ml2/ml2-nsxv3-1.ini'] {{(pid=69980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2807}} [ 666.401414] env[69980]: DEBUG oslo_service.backend.eventlet.service [None req-146d368d-73f3-4c7e-931a-2275b65deafb None None] ================================================================================ {{(pid=69980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2809}} [ 666.401545] env[69980]: DEBUG oslo_service.backend.eventlet.service [None req-146d368d-73f3-4c7e-931a-2275b65deafb None None] agent_down_time = 75 {{(pid=69980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 666.401679] env[69980]: DEBUG oslo_service.backend.eventlet.service [None req-146d368d-73f3-4c7e-931a-2275b65deafb None None] allow_automatic_dhcp_failover = True {{(pid=69980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 666.401819] env[69980]: DEBUG oslo_service.backend.eventlet.service [None req-146d368d-73f3-4c7e-931a-2275b65deafb None None] allow_bulk = True {{(pid=69980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 666.402031] env[69980]: DEBUG oslo_service.backend.eventlet.service [None req-146d368d-73f3-4c7e-931a-2275b65deafb None None] api_extensions_path = {{(pid=69980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 666.402113] env[69980]: DEBUG oslo_service.backend.eventlet.service [None req-146d368d-73f3-4c7e-931a-2275b65deafb None None] api_paste_config = api-paste.ini {{(pid=69980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 666.402261] env[69980]: DEBUG oslo_service.backend.eventlet.service [None req-146d368d-73f3-4c7e-931a-2275b65deafb None None] auth_strategy = keystone {{(pid=69980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 666.402375] env[69980]: DEBUG oslo_service.backend.eventlet.service [None req-146d368d-73f3-4c7e-931a-2275b65deafb None None] backdoor_port = None {{(pid=69980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 666.402484] env[69980]: DEBUG oslo_service.backend.eventlet.service [None req-146d368d-73f3-4c7e-931a-2275b65deafb None None] backdoor_socket = None {{(pid=69980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 666.402666] env[69980]: DEBUG oslo_service.backend.eventlet.service [None req-146d368d-73f3-4c7e-931a-2275b65deafb None None] backlog = 4096 {{(pid=69980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 666.402769] env[69980]: DEBUG oslo_service.backend.eventlet.service [None req-146d368d-73f3-4c7e-931a-2275b65deafb None None] base_mac = fa:16:3e:00:00:00 {{(pid=69980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 666.402931] env[69980]: DEBUG oslo_service.backend.eventlet.service [None req-146d368d-73f3-4c7e-931a-2275b65deafb None None] bind_host = 0.0.0.0 {{(pid=69980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 666.403090] env[69980]: DEBUG oslo_service.backend.eventlet.service [None req-146d368d-73f3-4c7e-931a-2275b65deafb None None] bind_port = 9696 {{(pid=69980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 666.403234] env[69980]: DEBUG oslo_service.backend.eventlet.service [None req-146d368d-73f3-4c7e-931a-2275b65deafb None None] client_socket_timeout = 900 {{(pid=69980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 666.403377] env[69980]: DEBUG oslo_service.backend.eventlet.service [None req-146d368d-73f3-4c7e-931a-2275b65deafb None None] config_dir = [] {{(pid=69980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 666.403494] env[69980]: DEBUG oslo_service.backend.eventlet.service [None req-146d368d-73f3-4c7e-931a-2275b65deafb None None] config_file = ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini', '/etc/neutron/plugins/ml2/ml2-nsxv3-1.ini'] {{(pid=69980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 666.403635] env[69980]: DEBUG oslo_service.backend.eventlet.service [None req-146d368d-73f3-4c7e-931a-2275b65deafb None None] config_source = [] {{(pid=69980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 666.403781] env[69980]: DEBUG oslo_service.backend.eventlet.service [None req-146d368d-73f3-4c7e-931a-2275b65deafb None None] control_exchange = neutron {{(pid=69980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 666.403924] env[69980]: DEBUG oslo_service.backend.eventlet.service [None req-146d368d-73f3-4c7e-931a-2275b65deafb None None] core_plugin = ml2 {{(pid=69980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 666.404079] env[69980]: DEBUG oslo_service.backend.eventlet.service [None req-146d368d-73f3-4c7e-931a-2275b65deafb None None] debug = True {{(pid=69980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 666.404222] env[69980]: DEBUG oslo_service.backend.eventlet.service [None req-146d368d-73f3-4c7e-931a-2275b65deafb None None] default_availability_zones = [] {{(pid=69980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 666.404433] env[69980]: DEBUG oslo_service.backend.eventlet.service [None req-146d368d-73f3-4c7e-931a-2275b65deafb None None] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'OFPHandler=INFO', 'OfctlService=INFO', 'os_ken.base.app_manager=INFO', 'os_ken.controller.controller=INFO'] {{(pid=69980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 666.404578] env[69980]: DEBUG oslo_service.backend.eventlet.service [None req-146d368d-73f3-4c7e-931a-2275b65deafb None None] dhcp_agent_notification = True {{(pid=69980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 666.404716] env[69980]: DEBUG oslo_service.backend.eventlet.service [None req-146d368d-73f3-4c7e-931a-2275b65deafb None None] dhcp_agents_per_network = 1 {{(pid=69980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 666.404854] env[69980]: DEBUG oslo_service.backend.eventlet.service [None req-146d368d-73f3-4c7e-931a-2275b65deafb None None] dhcp_lease_duration = 86400 {{(pid=69980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 666.405006] env[69980]: DEBUG oslo_service.backend.eventlet.service [None req-146d368d-73f3-4c7e-931a-2275b65deafb None None] dhcp_load_type = networks {{(pid=69980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 666.405155] env[69980]: DEBUG oslo_service.backend.eventlet.service [None req-146d368d-73f3-4c7e-931a-2275b65deafb None None] dns_domain = openstacklocal {{(pid=69980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 666.405297] env[69980]: DEBUG oslo_service.backend.eventlet.service [None req-146d368d-73f3-4c7e-931a-2275b65deafb None None] dvr_base_mac = fa:16:3f:00:00:00 {{(pid=69980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 666.405435] env[69980]: DEBUG oslo_service.backend.eventlet.service [None req-146d368d-73f3-4c7e-931a-2275b65deafb None None] enable_default_route_bfd = False {{(pid=69980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 666.405572] env[69980]: DEBUG oslo_service.backend.eventlet.service [None req-146d368d-73f3-4c7e-931a-2275b65deafb None None] enable_default_route_ecmp = False {{(pid=69980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 666.405706] env[69980]: DEBUG oslo_service.backend.eventlet.service [None req-146d368d-73f3-4c7e-931a-2275b65deafb None None] enable_dvr = True {{(pid=69980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 666.405841] env[69980]: DEBUG oslo_service.backend.eventlet.service [None req-146d368d-73f3-4c7e-931a-2275b65deafb None None] enable_new_agents = True {{(pid=69980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 666.405975] env[69980]: DEBUG oslo_service.backend.eventlet.service [None req-146d368d-73f3-4c7e-931a-2275b65deafb None None] enable_services_on_agents_with_admin_state_down = False {{(pid=69980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 666.406118] env[69980]: DEBUG oslo_service.backend.eventlet.service [None req-146d368d-73f3-4c7e-931a-2275b65deafb None None] enable_signals = True {{(pid=69980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 666.406252] env[69980]: DEBUG oslo_service.backend.eventlet.service [None req-146d368d-73f3-4c7e-931a-2275b65deafb None None] enable_traditional_dhcp = True {{(pid=69980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 666.406384] env[69980]: DEBUG oslo_service.backend.eventlet.service [None req-146d368d-73f3-4c7e-931a-2275b65deafb None None] external_dns_driver = None {{(pid=69980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 666.406519] env[69980]: DEBUG oslo_service.backend.eventlet.service [None req-146d368d-73f3-4c7e-931a-2275b65deafb None None] filter_validation = True {{(pid=69980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 666.406662] env[69980]: DEBUG oslo_service.backend.eventlet.service [None req-146d368d-73f3-4c7e-931a-2275b65deafb None None] global_physnet_mtu = 8950 {{(pid=69980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 666.406800] env[69980]: DEBUG oslo_service.backend.eventlet.service [None req-146d368d-73f3-4c7e-931a-2275b65deafb None None] graceful_shutdown_timeout = 60 {{(pid=69980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 666.406977] env[69980]: DEBUG oslo_service.backend.eventlet.service [None req-146d368d-73f3-4c7e-931a-2275b65deafb None None] host = cpu-1 {{(pid=69980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 666.407135] env[69980]: DEBUG oslo_service.backend.eventlet.service [None req-146d368d-73f3-4c7e-931a-2275b65deafb None None] host_dvr_for_dhcp = True {{(pid=69980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 666.407276] env[69980]: DEBUG oslo_service.backend.eventlet.service [None req-146d368d-73f3-4c7e-931a-2275b65deafb None None] http_retries = 3 {{(pid=69980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 666.407423] env[69980]: DEBUG oslo_service.backend.eventlet.service [None req-146d368d-73f3-4c7e-931a-2275b65deafb None None] instance_format = [instance: %(uuid)s] {{(pid=69980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 666.407570] env[69980]: DEBUG oslo_service.backend.eventlet.service [None req-146d368d-73f3-4c7e-931a-2275b65deafb None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=69980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 666.407712] env[69980]: DEBUG oslo_service.backend.eventlet.service [None req-146d368d-73f3-4c7e-931a-2275b65deafb None None] ipam_driver = internal {{(pid=69980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 666.407854] env[69980]: DEBUG oslo_service.backend.eventlet.service [None req-146d368d-73f3-4c7e-931a-2275b65deafb None None] ipv6_pd_enabled = False {{(pid=69980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 666.407993] env[69980]: DEBUG oslo_service.backend.eventlet.service [None req-146d368d-73f3-4c7e-931a-2275b65deafb None None] l3_ha = False {{(pid=69980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 666.408147] env[69980]: DEBUG oslo_service.backend.eventlet.service [None req-146d368d-73f3-4c7e-931a-2275b65deafb None None] l3_ha_net_cidr = 169.254.192.0/18 {{(pid=69980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 666.408290] env[69980]: DEBUG oslo_service.backend.eventlet.service [None req-146d368d-73f3-4c7e-931a-2275b65deafb None None] l3_ha_network_physical_name = {{(pid=69980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 666.408432] env[69980]: DEBUG oslo_service.backend.eventlet.service [None req-146d368d-73f3-4c7e-931a-2275b65deafb None None] l3_ha_network_type = {{(pid=69980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 666.408576] env[69980]: DEBUG oslo_service.backend.eventlet.service [None req-146d368d-73f3-4c7e-931a-2275b65deafb None None] log_color = False {{(pid=69980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 666.408721] env[69980]: DEBUG oslo_service.backend.eventlet.service [None req-146d368d-73f3-4c7e-931a-2275b65deafb None None] log_config_append = None {{(pid=69980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 666.408863] env[69980]: DEBUG oslo_service.backend.eventlet.service [None req-146d368d-73f3-4c7e-931a-2275b65deafb None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=69980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 666.408998] env[69980]: DEBUG oslo_service.backend.eventlet.service [None req-146d368d-73f3-4c7e-931a-2275b65deafb None None] log_dir = None {{(pid=69980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 666.409147] env[69980]: DEBUG oslo_service.backend.eventlet.service [None req-146d368d-73f3-4c7e-931a-2275b65deafb None None] log_file = None {{(pid=69980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 666.409257] env[69980]: DEBUG oslo_service.backend.eventlet.service [None req-146d368d-73f3-4c7e-931a-2275b65deafb None None] log_options = True {{(pid=69980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 666.409397] env[69980]: DEBUG oslo_service.backend.eventlet.service [None req-146d368d-73f3-4c7e-931a-2275b65deafb None None] log_rotate_interval = 1 {{(pid=69980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 666.409618] env[69980]: DEBUG oslo_service.backend.eventlet.service [None req-146d368d-73f3-4c7e-931a-2275b65deafb None None] log_rotate_interval_type = days {{(pid=69980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 666.409776] env[69980]: DEBUG oslo_service.backend.eventlet.service [None req-146d368d-73f3-4c7e-931a-2275b65deafb None None] log_rotation_type = none {{(pid=69980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 666.409889] env[69980]: DEBUG oslo_service.backend.eventlet.service [None req-146d368d-73f3-4c7e-931a-2275b65deafb None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=69980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 666.409997] env[69980]: DEBUG oslo_service.backend.eventlet.service [None req-146d368d-73f3-4c7e-931a-2275b65deafb None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=69980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 666.410158] env[69980]: DEBUG oslo_service.backend.eventlet.service [None req-146d368d-73f3-4c7e-931a-2275b65deafb None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=69980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 666.410303] env[69980]: DEBUG oslo_service.backend.eventlet.service [None req-146d368d-73f3-4c7e-931a-2275b65deafb None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=69980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 666.410414] env[69980]: DEBUG oslo_service.backend.eventlet.service [None req-146d368d-73f3-4c7e-931a-2275b65deafb None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=69980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 666.410557] env[69980]: DEBUG oslo_service.backend.eventlet.service [None req-146d368d-73f3-4c7e-931a-2275b65deafb None None] max_dns_nameservers = 5 {{(pid=69980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 666.410695] env[69980]: DEBUG oslo_service.backend.eventlet.service [None req-146d368d-73f3-4c7e-931a-2275b65deafb None None] max_header_line = 16384 {{(pid=69980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 666.410832] env[69980]: DEBUG oslo_service.backend.eventlet.service [None req-146d368d-73f3-4c7e-931a-2275b65deafb None None] max_l3_agents_per_router = 3 {{(pid=69980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 666.410967] env[69980]: DEBUG oslo_service.backend.eventlet.service [None req-146d368d-73f3-4c7e-931a-2275b65deafb None None] max_logfile_count = 30 {{(pid=69980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 666.411116] env[69980]: DEBUG oslo_service.backend.eventlet.service [None req-146d368d-73f3-4c7e-931a-2275b65deafb None None] max_logfile_size_mb = 200 {{(pid=69980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 666.411252] env[69980]: DEBUG oslo_service.backend.eventlet.service [None req-146d368d-73f3-4c7e-931a-2275b65deafb None None] max_subnet_host_routes = 20 {{(pid=69980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 666.411394] env[69980]: DEBUG oslo_service.backend.eventlet.service [None req-146d368d-73f3-4c7e-931a-2275b65deafb None None] my_ip = 10.180.1.21 {{(pid=69980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 666.411533] env[69980]: DEBUG oslo_service.backend.eventlet.service [None req-146d368d-73f3-4c7e-931a-2275b65deafb None None] my_ipv6 = ::1 {{(pid=69980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 666.411671] env[69980]: DEBUG oslo_service.backend.eventlet.service [None req-146d368d-73f3-4c7e-931a-2275b65deafb None None] network_auto_schedule = True {{(pid=69980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 666.411804] env[69980]: DEBUG oslo_service.backend.eventlet.service [None req-146d368d-73f3-4c7e-931a-2275b65deafb None None] network_link_prefix = None {{(pid=69980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 666.411943] env[69980]: DEBUG oslo_service.backend.eventlet.service [None req-146d368d-73f3-4c7e-931a-2275b65deafb None None] network_scheduler_driver = neutron.scheduler.dhcp_agent_scheduler.WeightScheduler {{(pid=69980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 666.412094] env[69980]: DEBUG oslo_service.backend.eventlet.service [None req-146d368d-73f3-4c7e-931a-2275b65deafb None None] notify_nova_on_port_data_changes = True {{(pid=69980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 666.412235] env[69980]: DEBUG oslo_service.backend.eventlet.service [None req-146d368d-73f3-4c7e-931a-2275b65deafb None None] notify_nova_on_port_status_changes = True {{(pid=69980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 666.412378] env[69980]: DEBUG oslo_service.backend.eventlet.service [None req-146d368d-73f3-4c7e-931a-2275b65deafb None None] pagination_max_limit = -1 {{(pid=69980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 666.412516] env[69980]: DEBUG oslo_service.backend.eventlet.service [None req-146d368d-73f3-4c7e-931a-2275b65deafb None None] publish_errors = False {{(pid=69980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 666.412652] env[69980]: DEBUG oslo_service.backend.eventlet.service [None req-146d368d-73f3-4c7e-931a-2275b65deafb None None] rate_limit_burst = 0 {{(pid=69980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 666.412795] env[69980]: DEBUG oslo_service.backend.eventlet.service [None req-146d368d-73f3-4c7e-931a-2275b65deafb None None] rate_limit_except_level = CRITICAL {{(pid=69980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 666.412932] env[69980]: DEBUG oslo_service.backend.eventlet.service [None req-146d368d-73f3-4c7e-931a-2275b65deafb None None] rate_limit_interval = 0 {{(pid=69980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 666.413079] env[69980]: DEBUG oslo_service.backend.eventlet.service [None req-146d368d-73f3-4c7e-931a-2275b65deafb None None] retry_until_window = 30 {{(pid=69980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 666.413219] env[69980]: DEBUG oslo_service.backend.eventlet.service [None req-146d368d-73f3-4c7e-931a-2275b65deafb None None] router_distributed = False {{(pid=69980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 666.413354] env[69980]: DEBUG oslo_service.backend.eventlet.service [None req-146d368d-73f3-4c7e-931a-2275b65deafb None None] rpc_resources_processing_step = 20 {{(pid=69980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 666.413490] env[69980]: DEBUG oslo_service.backend.eventlet.service [None req-146d368d-73f3-4c7e-931a-2275b65deafb None None] rpc_response_max_timeout = 600 {{(pid=69980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 666.413628] env[69980]: DEBUG oslo_service.backend.eventlet.service [None req-146d368d-73f3-4c7e-931a-2275b65deafb None None] rpc_response_timeout = 60 {{(pid=69980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 666.413765] env[69980]: DEBUG oslo_service.backend.eventlet.service [None req-146d368d-73f3-4c7e-931a-2275b65deafb None None] send_events_interval = 2 {{(pid=69980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 666.413913] env[69980]: DEBUG oslo_service.backend.eventlet.service [None req-146d368d-73f3-4c7e-931a-2275b65deafb None None] service_plugins = ['router'] {{(pid=69980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 666.414065] env[69980]: DEBUG oslo_service.backend.eventlet.service [None req-146d368d-73f3-4c7e-931a-2275b65deafb None None] setproctitle = on {{(pid=69980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 666.414201] env[69980]: DEBUG oslo_service.backend.eventlet.service [None req-146d368d-73f3-4c7e-931a-2275b65deafb None None] shell_completion = None {{(pid=69980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 666.414342] env[69980]: DEBUG oslo_service.backend.eventlet.service [None req-146d368d-73f3-4c7e-931a-2275b65deafb None None] state_path = /opt/stack/data/neutron {{(pid=69980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 666.414483] env[69980]: DEBUG oslo_service.backend.eventlet.service [None req-146d368d-73f3-4c7e-931a-2275b65deafb None None] syslog_log_facility = LOG_USER {{(pid=69980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 666.414621] env[69980]: DEBUG oslo_service.backend.eventlet.service [None req-146d368d-73f3-4c7e-931a-2275b65deafb None None] tcp_keepidle = 600 {{(pid=69980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 666.414760] env[69980]: DEBUG oslo_service.backend.eventlet.service [None req-146d368d-73f3-4c7e-931a-2275b65deafb None None] transport_url = **** {{(pid=69980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 666.414896] env[69980]: DEBUG oslo_service.backend.eventlet.service [None req-146d368d-73f3-4c7e-931a-2275b65deafb None None] use_journal = False {{(pid=69980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 666.415040] env[69980]: DEBUG oslo_service.backend.eventlet.service [None req-146d368d-73f3-4c7e-931a-2275b65deafb None None] use_json = False {{(pid=69980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 666.415178] env[69980]: DEBUG oslo_service.backend.eventlet.service [None req-146d368d-73f3-4c7e-931a-2275b65deafb None None] use_ssl = False {{(pid=69980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 666.415310] env[69980]: DEBUG oslo_service.backend.eventlet.service [None req-146d368d-73f3-4c7e-931a-2275b65deafb None None] use_stderr = False {{(pid=69980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 666.415451] env[69980]: DEBUG oslo_service.backend.eventlet.service [None req-146d368d-73f3-4c7e-931a-2275b65deafb None None] use_syslog = False {{(pid=69980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 666.415588] env[69980]: DEBUG oslo_service.backend.eventlet.service [None req-146d368d-73f3-4c7e-931a-2275b65deafb None None] vlan_qinq = False {{(pid=69980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 666.415721] env[69980]: DEBUG oslo_service.backend.eventlet.service [None req-146d368d-73f3-4c7e-931a-2275b65deafb None None] vlan_transparent = False {{(pid=69980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 666.415852] env[69980]: DEBUG oslo_service.backend.eventlet.service [None req-146d368d-73f3-4c7e-931a-2275b65deafb None None] watch_log_file = False {{(pid=69980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 666.415988] env[69980]: DEBUG oslo_service.backend.eventlet.service [None req-146d368d-73f3-4c7e-931a-2275b65deafb None None] wsgi_default_pool_size = 100 {{(pid=69980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 666.416135] env[69980]: DEBUG oslo_service.backend.eventlet.service [None req-146d368d-73f3-4c7e-931a-2275b65deafb None None] wsgi_keep_alive = True {{(pid=69980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 666.416277] env[69980]: DEBUG oslo_service.backend.eventlet.service [None req-146d368d-73f3-4c7e-931a-2275b65deafb None None] wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=69980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 666.416413] env[69980]: DEBUG oslo_service.backend.eventlet.service [None req-146d368d-73f3-4c7e-931a-2275b65deafb None None] wsgi_server_debug = False {{(pid=69980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 666.416564] env[69980]: DEBUG oslo_service.backend.eventlet.service [None req-146d368d-73f3-4c7e-931a-2275b65deafb None None] oslo_concurrency.disable_process_locking = False {{(pid=69980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 666.416712] env[69980]: DEBUG oslo_service.backend.eventlet.service [None req-146d368d-73f3-4c7e-931a-2275b65deafb None None] oslo_concurrency.lock_path = /opt/stack/data/neutron/lock {{(pid=69980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 666.416860] env[69980]: DEBUG oslo_service.backend.eventlet.service [None req-146d368d-73f3-4c7e-931a-2275b65deafb None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=69980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 666.416999] env[69980]: DEBUG oslo_service.backend.eventlet.service [None req-146d368d-73f3-4c7e-931a-2275b65deafb None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=69980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 666.417187] env[69980]: DEBUG oslo_service.backend.eventlet.service [None req-146d368d-73f3-4c7e-931a-2275b65deafb None None] oslo_messaging_metrics.metrics_process_name = {{(pid=69980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 666.417351] env[69980]: DEBUG oslo_service.backend.eventlet.service [None req-146d368d-73f3-4c7e-931a-2275b65deafb None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=69980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 666.417497] env[69980]: DEBUG oslo_service.backend.eventlet.service [None req-146d368d-73f3-4c7e-931a-2275b65deafb None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=69980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 666.417653] env[69980]: DEBUG oslo_service.backend.eventlet.service [None req-146d368d-73f3-4c7e-931a-2275b65deafb None None] profiler.connection_string = messaging:// {{(pid=69980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 666.417797] env[69980]: DEBUG oslo_service.backend.eventlet.service [None req-146d368d-73f3-4c7e-931a-2275b65deafb None None] profiler.enabled = False {{(pid=69980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 666.417960] env[69980]: DEBUG oslo_service.backend.eventlet.service [None req-146d368d-73f3-4c7e-931a-2275b65deafb None None] profiler.es_doc_type = notification {{(pid=69980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 666.418117] env[69980]: DEBUG oslo_service.backend.eventlet.service [None req-146d368d-73f3-4c7e-931a-2275b65deafb None None] profiler.es_scroll_size = 10000 {{(pid=69980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 666.418265] env[69980]: DEBUG oslo_service.backend.eventlet.service [None req-146d368d-73f3-4c7e-931a-2275b65deafb None None] profiler.es_scroll_time = 2m {{(pid=69980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 666.418403] env[69980]: DEBUG oslo_service.backend.eventlet.service [None req-146d368d-73f3-4c7e-931a-2275b65deafb None None] profiler.filter_error_trace = False {{(pid=69980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 666.418549] env[69980]: DEBUG oslo_service.backend.eventlet.service [None req-146d368d-73f3-4c7e-931a-2275b65deafb None None] profiler.hmac_keys = **** {{(pid=69980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 666.418690] env[69980]: DEBUG oslo_service.backend.eventlet.service [None req-146d368d-73f3-4c7e-931a-2275b65deafb None None] profiler.sentinel_service_name = mymaster {{(pid=69980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 666.418837] env[69980]: DEBUG oslo_service.backend.eventlet.service [None req-146d368d-73f3-4c7e-931a-2275b65deafb None None] profiler.socket_timeout = 0.1 {{(pid=69980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 666.418976] env[69980]: DEBUG oslo_service.backend.eventlet.service [None req-146d368d-73f3-4c7e-931a-2275b65deafb None None] profiler.trace_requests = False {{(pid=69980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 666.419125] env[69980]: DEBUG oslo_service.backend.eventlet.service [None req-146d368d-73f3-4c7e-931a-2275b65deafb None None] profiler.trace_sqlalchemy = False {{(pid=69980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 666.419275] env[69980]: DEBUG oslo_service.backend.eventlet.service [None req-146d368d-73f3-4c7e-931a-2275b65deafb None None] profiler_jaeger.process_tags = {} {{(pid=69980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 666.419411] env[69980]: DEBUG oslo_service.backend.eventlet.service [None req-146d368d-73f3-4c7e-931a-2275b65deafb None None] profiler_jaeger.service_name_prefix = None {{(pid=69980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 666.419549] env[69980]: DEBUG oslo_service.backend.eventlet.service [None req-146d368d-73f3-4c7e-931a-2275b65deafb None None] profiler_otlp.service_name_prefix = None {{(pid=69980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 666.419697] env[69980]: DEBUG oslo_service.backend.eventlet.service [None req-146d368d-73f3-4c7e-931a-2275b65deafb None None] oslo_policy.enforce_new_defaults = True {{(pid=69980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 666.419951] env[69980]: WARNING oslo_config.cfg [None req-146d368d-73f3-4c7e-931a-2275b65deafb None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. [ 666.420117] env[69980]: DEBUG oslo_service.backend.eventlet.service [None req-146d368d-73f3-4c7e-931a-2275b65deafb None None] oslo_policy.enforce_scope = True {{(pid=69980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 666.420264] env[69980]: DEBUG oslo_service.backend.eventlet.service [None req-146d368d-73f3-4c7e-931a-2275b65deafb None None] oslo_policy.policy_default_rule = default {{(pid=69980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 666.420415] env[69980]: DEBUG oslo_service.backend.eventlet.service [None req-146d368d-73f3-4c7e-931a-2275b65deafb None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=69980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 666.420561] env[69980]: DEBUG oslo_service.backend.eventlet.service [None req-146d368d-73f3-4c7e-931a-2275b65deafb None None] oslo_policy.policy_file = /etc/neutron/policy.json {{(pid=69980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 666.420706] env[69980]: DEBUG oslo_service.backend.eventlet.service [None req-146d368d-73f3-4c7e-931a-2275b65deafb None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=69980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 666.420862] env[69980]: DEBUG oslo_service.backend.eventlet.service [None req-146d368d-73f3-4c7e-931a-2275b65deafb None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=69980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 666.421022] env[69980]: DEBUG oslo_service.backend.eventlet.service [None req-146d368d-73f3-4c7e-931a-2275b65deafb None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=69980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 666.421154] env[69980]: DEBUG oslo_service.backend.eventlet.service [None req-146d368d-73f3-4c7e-931a-2275b65deafb None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=69980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 666.421294] env[69980]: DEBUG oslo_service.backend.eventlet.service [None req-146d368d-73f3-4c7e-931a-2275b65deafb None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=69980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 666.421439] env[69980]: DEBUG oslo_service.backend.eventlet.service [None req-146d368d-73f3-4c7e-931a-2275b65deafb None None] oslo_policy.remote_timeout = 60.0 {{(pid=69980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 666.421597] env[69980]: DEBUG oslo_service.backend.eventlet.service [None req-146d368d-73f3-4c7e-931a-2275b65deafb None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=69980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 666.421736] env[69980]: DEBUG oslo_service.backend.eventlet.service [None req-146d368d-73f3-4c7e-931a-2275b65deafb None None] agent.extensions = [] {{(pid=69980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 666.421879] env[69980]: DEBUG oslo_service.backend.eventlet.service [None req-146d368d-73f3-4c7e-931a-2275b65deafb None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=69980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 666.422033] env[69980]: DEBUG oslo_service.backend.eventlet.service [None req-146d368d-73f3-4c7e-931a-2275b65deafb None None] service_providers.service_provider = [] {{(pid=69980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 666.422185] env[69980]: DEBUG oslo_service.backend.eventlet.service [None req-146d368d-73f3-4c7e-931a-2275b65deafb None None] QUOTAS.default_quota = -1 {{(pid=69980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 666.422330] env[69980]: DEBUG oslo_service.backend.eventlet.service [None req-146d368d-73f3-4c7e-931a-2275b65deafb None None] QUOTAS.quota_driver = neutron.db.quota.driver_nolock.DbQuotaNoLockDriver {{(pid=69980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 666.422470] env[69980]: DEBUG oslo_service.backend.eventlet.service [None req-146d368d-73f3-4c7e-931a-2275b65deafb None None] QUOTAS.quota_floatingip = 50 {{(pid=69980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 666.422610] env[69980]: DEBUG oslo_service.backend.eventlet.service [None req-146d368d-73f3-4c7e-931a-2275b65deafb None None] QUOTAS.quota_network = 100 {{(pid=69980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 666.422748] env[69980]: DEBUG oslo_service.backend.eventlet.service [None req-146d368d-73f3-4c7e-931a-2275b65deafb None None] QUOTAS.quota_port = 500 {{(pid=69980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 666.422884] env[69980]: DEBUG oslo_service.backend.eventlet.service [None req-146d368d-73f3-4c7e-931a-2275b65deafb None None] QUOTAS.quota_rbac_policy = 10 {{(pid=69980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 666.423028] env[69980]: DEBUG oslo_service.backend.eventlet.service [None req-146d368d-73f3-4c7e-931a-2275b65deafb None None] QUOTAS.quota_router = 10 {{(pid=69980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 666.423168] env[69980]: DEBUG oslo_service.backend.eventlet.service [None req-146d368d-73f3-4c7e-931a-2275b65deafb None None] QUOTAS.quota_security_group = 10 {{(pid=69980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 666.423307] env[69980]: DEBUG oslo_service.backend.eventlet.service [None req-146d368d-73f3-4c7e-931a-2275b65deafb None None] QUOTAS.quota_security_group_rule = 100 {{(pid=69980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 666.423446] env[69980]: DEBUG oslo_service.backend.eventlet.service [None req-146d368d-73f3-4c7e-931a-2275b65deafb None None] QUOTAS.quota_subnet = 100 {{(pid=69980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 666.423584] env[69980]: DEBUG oslo_service.backend.eventlet.service [None req-146d368d-73f3-4c7e-931a-2275b65deafb None None] QUOTAS.track_quota_usage = True {{(pid=69980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 666.423734] env[69980]: DEBUG oslo_service.backend.eventlet.service [None req-146d368d-73f3-4c7e-931a-2275b65deafb None None] privsep.capabilities = [21, 12, 1, 2, 19] {{(pid=69980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 666.423869] env[69980]: DEBUG oslo_service.backend.eventlet.service [None req-146d368d-73f3-4c7e-931a-2275b65deafb None None] privsep.group = None {{(pid=69980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 666.424008] env[69980]: DEBUG oslo_service.backend.eventlet.service [None req-146d368d-73f3-4c7e-931a-2275b65deafb None None] privsep.helper_command = None {{(pid=69980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 666.424153] env[69980]: DEBUG oslo_service.backend.eventlet.service [None req-146d368d-73f3-4c7e-931a-2275b65deafb None None] privsep.logger_name = oslo_privsep.daemon {{(pid=69980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 666.424293] env[69980]: DEBUG oslo_service.backend.eventlet.service [None req-146d368d-73f3-4c7e-931a-2275b65deafb None None] privsep.thread_pool_size = 8 {{(pid=69980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 666.424428] env[69980]: DEBUG oslo_service.backend.eventlet.service [None req-146d368d-73f3-4c7e-931a-2275b65deafb None None] privsep.user = None {{(pid=69980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 666.424575] env[69980]: DEBUG oslo_service.backend.eventlet.service [None req-146d368d-73f3-4c7e-931a-2275b65deafb None None] privsep_dhcp_release.capabilities = [21, 12] {{(pid=69980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 666.424710] env[69980]: DEBUG oslo_service.backend.eventlet.service [None req-146d368d-73f3-4c7e-931a-2275b65deafb None None] privsep_dhcp_release.group = None {{(pid=69980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 666.424844] env[69980]: DEBUG oslo_service.backend.eventlet.service [None req-146d368d-73f3-4c7e-931a-2275b65deafb None None] privsep_dhcp_release.helper_command = None {{(pid=69980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 666.425112] env[69980]: DEBUG oslo_service.backend.eventlet.service [None req-146d368d-73f3-4c7e-931a-2275b65deafb None None] privsep_dhcp_release.logger_name = oslo_privsep.daemon {{(pid=69980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 666.425167] env[69980]: DEBUG oslo_service.backend.eventlet.service [None req-146d368d-73f3-4c7e-931a-2275b65deafb None None] privsep_dhcp_release.thread_pool_size = 8 {{(pid=69980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 666.429021] env[69980]: DEBUG oslo_service.backend.eventlet.service [None req-146d368d-73f3-4c7e-931a-2275b65deafb None None] privsep_dhcp_release.user = None {{(pid=69980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 666.429021] env[69980]: DEBUG oslo_service.backend.eventlet.service [None req-146d368d-73f3-4c7e-931a-2275b65deafb None None] privsep_ovs_vsctl.capabilities = [21, 12] {{(pid=69980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 666.429021] env[69980]: DEBUG oslo_service.backend.eventlet.service [None req-146d368d-73f3-4c7e-931a-2275b65deafb None None] privsep_ovs_vsctl.group = None {{(pid=69980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 666.429021] env[69980]: DEBUG oslo_service.backend.eventlet.service [None req-146d368d-73f3-4c7e-931a-2275b65deafb None None] privsep_ovs_vsctl.helper_command = None {{(pid=69980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 666.429021] env[69980]: DEBUG oslo_service.backend.eventlet.service [None req-146d368d-73f3-4c7e-931a-2275b65deafb None None] privsep_ovs_vsctl.logger_name = oslo_privsep.daemon {{(pid=69980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 666.429021] env[69980]: DEBUG oslo_service.backend.eventlet.service [None req-146d368d-73f3-4c7e-931a-2275b65deafb None None] privsep_ovs_vsctl.thread_pool_size = 8 {{(pid=69980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 666.429021] env[69980]: DEBUG oslo_service.backend.eventlet.service [None req-146d368d-73f3-4c7e-931a-2275b65deafb None None] privsep_ovs_vsctl.user = None {{(pid=69980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 666.429487] env[69980]: DEBUG oslo_service.backend.eventlet.service [None req-146d368d-73f3-4c7e-931a-2275b65deafb None None] privsep_namespace.capabilities = [21] {{(pid=69980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 666.429487] env[69980]: DEBUG oslo_service.backend.eventlet.service [None req-146d368d-73f3-4c7e-931a-2275b65deafb None None] privsep_namespace.group = None {{(pid=69980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 666.429487] env[69980]: DEBUG oslo_service.backend.eventlet.service [None req-146d368d-73f3-4c7e-931a-2275b65deafb None None] privsep_namespace.helper_command = None {{(pid=69980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 666.429487] env[69980]: DEBUG oslo_service.backend.eventlet.service [None req-146d368d-73f3-4c7e-931a-2275b65deafb None None] privsep_namespace.logger_name = oslo_privsep.daemon {{(pid=69980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 666.429487] env[69980]: DEBUG oslo_service.backend.eventlet.service [None req-146d368d-73f3-4c7e-931a-2275b65deafb None None] privsep_namespace.thread_pool_size = 8 {{(pid=69980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 666.429487] env[69980]: DEBUG oslo_service.backend.eventlet.service [None req-146d368d-73f3-4c7e-931a-2275b65deafb None None] privsep_namespace.user = None {{(pid=69980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 666.429487] env[69980]: DEBUG oslo_service.backend.eventlet.service [None req-146d368d-73f3-4c7e-931a-2275b65deafb None None] privsep_conntrack.capabilities = [12] {{(pid=69980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 666.429671] env[69980]: DEBUG oslo_service.backend.eventlet.service [None req-146d368d-73f3-4c7e-931a-2275b65deafb None None] privsep_conntrack.group = None {{(pid=69980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 666.429671] env[69980]: DEBUG oslo_service.backend.eventlet.service [None req-146d368d-73f3-4c7e-931a-2275b65deafb None None] privsep_conntrack.helper_command = None {{(pid=69980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 666.429671] env[69980]: DEBUG oslo_service.backend.eventlet.service [None req-146d368d-73f3-4c7e-931a-2275b65deafb None None] privsep_conntrack.logger_name = oslo_privsep.daemon {{(pid=69980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 666.429671] env[69980]: DEBUG oslo_service.backend.eventlet.service [None req-146d368d-73f3-4c7e-931a-2275b65deafb None None] privsep_conntrack.thread_pool_size = 8 {{(pid=69980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 666.429671] env[69980]: DEBUG oslo_service.backend.eventlet.service [None req-146d368d-73f3-4c7e-931a-2275b65deafb None None] privsep_conntrack.user = None {{(pid=69980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 666.429671] env[69980]: DEBUG oslo_service.backend.eventlet.service [None req-146d368d-73f3-4c7e-931a-2275b65deafb None None] privsep_link.capabilities = [12, 21] {{(pid=69980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 666.429671] env[69980]: DEBUG oslo_service.backend.eventlet.service [None req-146d368d-73f3-4c7e-931a-2275b65deafb None None] privsep_link.group = None {{(pid=69980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 666.429845] env[69980]: DEBUG oslo_service.backend.eventlet.service [None req-146d368d-73f3-4c7e-931a-2275b65deafb None None] privsep_link.helper_command = None {{(pid=69980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 666.429845] env[69980]: DEBUG oslo_service.backend.eventlet.service [None req-146d368d-73f3-4c7e-931a-2275b65deafb None None] privsep_link.logger_name = oslo_privsep.daemon {{(pid=69980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 666.429845] env[69980]: DEBUG oslo_service.backend.eventlet.service [None req-146d368d-73f3-4c7e-931a-2275b65deafb None None] privsep_link.thread_pool_size = 8 {{(pid=69980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 666.429845] env[69980]: DEBUG oslo_service.backend.eventlet.service [None req-146d368d-73f3-4c7e-931a-2275b65deafb None None] privsep_link.user = None {{(pid=69980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 666.429845] env[69980]: DEBUG oslo_service.backend.eventlet.service [None req-146d368d-73f3-4c7e-931a-2275b65deafb None None] AGENT.agent_id = nsxm-l-01a.corp.local {{(pid=69980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 666.429845] env[69980]: DEBUG oslo_service.backend.eventlet.service [None req-146d368d-73f3-4c7e-931a-2275b65deafb None None] AGENT.agent_prometheus_exporter_port = 8000 {{(pid=69980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 666.429845] env[69980]: DEBUG oslo_service.backend.eventlet.service [None req-146d368d-73f3-4c7e-931a-2275b65deafb None None] AGENT.continue_on_failed_promotions = False {{(pid=69980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 666.430035] env[69980]: DEBUG oslo_service.backend.eventlet.service [None req-146d368d-73f3-4c7e-931a-2275b65deafb None None] AGENT.dscp = None {{(pid=69980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 666.430035] env[69980]: DEBUG oslo_service.backend.eventlet.service [None req-146d368d-73f3-4c7e-931a-2275b65deafb None None] AGENT.dscp_inherit = False {{(pid=69980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 666.430035] env[69980]: DEBUG oslo_service.backend.eventlet.service [None req-146d368d-73f3-4c7e-931a-2275b65deafb None None] AGENT.force_mp_to_policy = True {{(pid=69980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 666.430035] env[69980]: DEBUG oslo_service.backend.eventlet.service [None req-146d368d-73f3-4c7e-931a-2275b65deafb None None] AGENT.locking_coordinator_url = None {{(pid=69980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 666.430035] env[69980]: DEBUG oslo_service.backend.eventlet.service [None req-146d368d-73f3-4c7e-931a-2275b65deafb None None] AGENT.log_agent_heartbeats = False {{(pid=69980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 666.430035] env[69980]: DEBUG oslo_service.backend.eventlet.service [None req-146d368d-73f3-4c7e-931a-2275b65deafb None None] AGENT.logging_expire = 1 {{(pid=69980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 666.430035] env[69980]: DEBUG oslo_service.backend.eventlet.service [None req-146d368d-73f3-4c7e-931a-2275b65deafb None None] AGENT.logging_url = unix:///var/run/redis/socket/redis.sock {{(pid=69980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 666.430215] env[69980]: DEBUG oslo_service.backend.eventlet.service [None req-146d368d-73f3-4c7e-931a-2275b65deafb None None] AGENT.max_sg_tags_per_segment_port = 27 {{(pid=69980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 666.430215] env[69980]: DEBUG oslo_service.backend.eventlet.service [None req-146d368d-73f3-4c7e-931a-2275b65deafb None None] AGENT.polling_interval = 240 {{(pid=69980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 666.430215] env[69980]: DEBUG oslo_service.backend.eventlet.service [None req-146d368d-73f3-4c7e-931a-2275b65deafb None None] AGENT.ports_tag_number_decrease_workaround = True {{(pid=69980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 666.430390] env[69980]: DEBUG oslo_service.backend.eventlet.service [None req-146d368d-73f3-4c7e-931a-2275b65deafb None None] AGENT.quitting_rpc_timeout = 120 {{(pid=69980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 666.430513] env[69980]: DEBUG oslo_service.backend.eventlet.service [None req-146d368d-73f3-4c7e-931a-2275b65deafb None None] AGENT.report_interval = 30.0 {{(pid=69980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 666.430620] env[69980]: DEBUG oslo_service.backend.eventlet.service [None req-146d368d-73f3-4c7e-931a-2275b65deafb None None] AGENT.root_helper = sudo /opt/stack/data/venv/bin/neutron-rootwrap /etc/neutron/rootwrap.conf {{(pid=69980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 666.430759] env[69980]: DEBUG oslo_service.backend.eventlet.service [None req-146d368d-73f3-4c7e-931a-2275b65deafb None None] AGENT.root_helper_daemon = sudo /opt/stack/data/venv/bin/neutron-rootwrap-daemon /etc/neutron/rootwrap.conf {{(pid=69980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 666.430898] env[69980]: DEBUG oslo_service.backend.eventlet.service [None req-146d368d-73f3-4c7e-931a-2275b65deafb None None] AGENT.rpc_max_records_per_query = 1000 {{(pid=69980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 666.431044] env[69980]: DEBUG oslo_service.backend.eventlet.service [None req-146d368d-73f3-4c7e-931a-2275b65deafb None None] AGENT.sync_skew = 60 {{(pid=69980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 666.431181] env[69980]: DEBUG oslo_service.backend.eventlet.service [None req-146d368d-73f3-4c7e-931a-2275b65deafb None None] AGENT.synchronization_queue_size = 20 {{(pid=69980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 666.431340] env[69980]: DEBUG oslo_service.backend.eventlet.service [None req-146d368d-73f3-4c7e-931a-2275b65deafb None None] AGENT.use_helper_for_ns_read = True {{(pid=69980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 666.431489] env[69980]: DEBUG oslo_service.backend.eventlet.service [None req-146d368d-73f3-4c7e-931a-2275b65deafb None None] SECURITYGROUP.enable_ipset = True {{(pid=69980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 666.431642] env[69980]: DEBUG oslo_service.backend.eventlet.service [None req-146d368d-73f3-4c7e-931a-2275b65deafb None None] SECURITYGROUP.enable_security_group = True {{(pid=69980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 666.431798] env[69980]: DEBUG oslo_service.backend.eventlet.service [None req-146d368d-73f3-4c7e-931a-2275b65deafb None None] SECURITYGROUP.firewall_driver = nsxv3 {{(pid=69980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 666.431910] env[69980]: DEBUG oslo_service.backend.eventlet.service [None req-146d368d-73f3-4c7e-931a-2275b65deafb None None] SECURITYGROUP.permitted_ethertypes = [] {{(pid=69980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 666.432064] env[69980]: DEBUG oslo_service.backend.eventlet.service [None req-146d368d-73f3-4c7e-931a-2275b65deafb None None] experimental.ipv6_pd_enabled = False {{(pid=69980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 666.432219] env[69980]: DEBUG oslo_service.backend.eventlet.service [None req-146d368d-73f3-4c7e-931a-2275b65deafb None None] ml2.extension_drivers = ['port_security'] {{(pid=69980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 666.434032] env[69980]: DEBUG oslo_service.backend.eventlet.service [None req-146d368d-73f3-4c7e-931a-2275b65deafb None None] ml2.external_network_type = None {{(pid=69980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 666.434032] env[69980]: DEBUG oslo_service.backend.eventlet.service [None req-146d368d-73f3-4c7e-931a-2275b65deafb None None] ml2.mechanism_drivers = ['nsxv3', 'openvswitch', 'logger'] {{(pid=69980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 666.434032] env[69980]: DEBUG oslo_service.backend.eventlet.service [None req-146d368d-73f3-4c7e-931a-2275b65deafb None None] ml2.overlay_ip_version = 4 {{(pid=69980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 666.434032] env[69980]: DEBUG oslo_service.backend.eventlet.service [None req-146d368d-73f3-4c7e-931a-2275b65deafb None None] ml2.path_mtu = 8950 {{(pid=69980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 666.434032] env[69980]: DEBUG oslo_service.backend.eventlet.service [None req-146d368d-73f3-4c7e-931a-2275b65deafb None None] ml2.physical_network_mtus = {} {{(pid=69980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 666.434032] env[69980]: DEBUG oslo_service.backend.eventlet.service [None req-146d368d-73f3-4c7e-931a-2275b65deafb None None] ml2.tenant_network_types = ['vlan'] {{(pid=69980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 666.434032] env[69980]: DEBUG oslo_service.backend.eventlet.service [None req-146d368d-73f3-4c7e-931a-2275b65deafb None None] ml2.tunnelled_network_rp_name = rp_tunnelled {{(pid=69980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 666.434312] env[69980]: DEBUG oslo_service.backend.eventlet.service [None req-146d368d-73f3-4c7e-931a-2275b65deafb None None] ml2.type_drivers = ['vlan'] {{(pid=69980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 666.434312] env[69980]: DEBUG oslo_service.backend.eventlet.service [None req-146d368d-73f3-4c7e-931a-2275b65deafb None None] AGENT_CLI.neutron_port_id = [] {{(pid=69980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 666.434312] env[69980]: DEBUG oslo_service.backend.eventlet.service [None req-146d368d-73f3-4c7e-931a-2275b65deafb None None] AGENT_CLI.neutron_qos_policy_id = [] {{(pid=69980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 666.434312] env[69980]: DEBUG oslo_service.backend.eventlet.service [None req-146d368d-73f3-4c7e-931a-2275b65deafb None None] AGENT_CLI.neutron_security_group_id = [] {{(pid=69980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 666.434312] env[69980]: DEBUG oslo_service.backend.eventlet.service [None req-146d368d-73f3-4c7e-931a-2275b65deafb None None] NSXV3.nsxv3_concurrent_requests = 40 {{(pid=69980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 666.434312] env[69980]: DEBUG oslo_service.backend.eventlet.service [None req-146d368d-73f3-4c7e-931a-2275b65deafb None None] NSXV3.nsxv3_connection_retry_count = 2 {{(pid=69980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 666.434312] env[69980]: DEBUG oslo_service.backend.eventlet.service [None req-146d368d-73f3-4c7e-931a-2275b65deafb None None] NSXV3.nsxv3_connection_retry_sleep = 2 {{(pid=69980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 666.434529] env[69980]: DEBUG oslo_service.backend.eventlet.service [None req-146d368d-73f3-4c7e-931a-2275b65deafb None None] NSXV3.nsxv3_default_policy_infrastructure_rules = True {{(pid=69980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 666.434529] env[69980]: DEBUG oslo_service.backend.eventlet.service [None req-146d368d-73f3-4c7e-931a-2275b65deafb None None] NSXV3.nsxv3_dfw_connectivity_strategy = NONE {{(pid=69980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 666.434747] env[69980]: DEBUG oslo_service.backend.eventlet.service [None req-146d368d-73f3-4c7e-931a-2275b65deafb None None] NSXV3.nsxv3_ip_discovery_switching_profile = nsx-default-ip-discovery-vlan-profile {{(pid=69980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 666.434885] env[69980]: DEBUG oslo_service.backend.eventlet.service [None req-146d368d-73f3-4c7e-931a-2275b65deafb None None] NSXV3.nsxv3_login_hostname = nsxt.osci.c.eu-de-1.cloud.sap {{(pid=69980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 666.435022] env[69980]: DEBUG oslo_service.backend.eventlet.service [None req-146d368d-73f3-4c7e-931a-2275b65deafb None None] NSXV3.nsxv3_login_password = **** {{(pid=69980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 666.435268] env[69980]: DEBUG oslo_service.backend.eventlet.service [None req-146d368d-73f3-4c7e-931a-2275b65deafb None None] NSXV3.nsxv3_login_port = 443 {{(pid=69980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 666.435323] env[69980]: DEBUG oslo_service.backend.eventlet.service [None req-146d368d-73f3-4c7e-931a-2275b65deafb None None] NSXV3.nsxv3_login_user = admin {{(pid=69980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 666.435426] env[69980]: DEBUG oslo_service.backend.eventlet.service [None req-146d368d-73f3-4c7e-931a-2275b65deafb None None] NSXV3.nsxv3_managed_hosts = [] {{(pid=69980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 666.435571] env[69980]: DEBUG oslo_service.backend.eventlet.service [None req-146d368d-73f3-4c7e-931a-2275b65deafb None None] NSXV3.nsxv3_max_records_per_query = 200 {{(pid=69980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 666.435720] env[69980]: DEBUG oslo_service.backend.eventlet.service [None req-146d368d-73f3-4c7e-931a-2275b65deafb None None] NSXV3.nsxv3_operation_retry_count = 3 {{(pid=69980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 666.435848] env[69980]: DEBUG oslo_service.backend.eventlet.service [None req-146d368d-73f3-4c7e-931a-2275b65deafb None None] NSXV3.nsxv3_operation_retry_sleep = 5 {{(pid=69980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 666.435990] env[69980]: DEBUG oslo_service.backend.eventlet.service [None req-146d368d-73f3-4c7e-931a-2275b65deafb None None] NSXV3.nsxv3_realization_timeout = 300 {{(pid=69980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 666.436149] env[69980]: DEBUG oslo_service.backend.eventlet.service [None req-146d368d-73f3-4c7e-931a-2275b65deafb None None] NSXV3.nsxv3_remove_orphan_ports_after = 2.0 {{(pid=69980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 666.436295] env[69980]: DEBUG oslo_service.backend.eventlet.service [None req-146d368d-73f3-4c7e-931a-2275b65deafb None None] NSXV3.nsxv3_request_timeout = 60 {{(pid=69980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 666.436436] env[69980]: DEBUG oslo_service.backend.eventlet.service [None req-146d368d-73f3-4c7e-931a-2275b65deafb None None] NSXV3.nsxv3_requests_per_second = 80 {{(pid=69980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 666.436578] env[69980]: DEBUG oslo_service.backend.eventlet.service [None req-146d368d-73f3-4c7e-931a-2275b65deafb None None] NSXV3.nsxv3_requests_per_second_timeout = 7 {{(pid=69980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 666.436721] env[69980]: DEBUG oslo_service.backend.eventlet.service [None req-146d368d-73f3-4c7e-931a-2275b65deafb None None] NSXV3.nsxv3_spoof_guard_switching_profile = nsx-default-spoof-guard-vif-profile {{(pid=69980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 666.436871] env[69980]: DEBUG oslo_service.backend.eventlet.service [None req-146d368d-73f3-4c7e-931a-2275b65deafb None None] NSXV3.nsxv3_suppress_ssl_warnings = True {{(pid=69980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 666.437020] env[69980]: DEBUG oslo_service.backend.eventlet.service [None req-146d368d-73f3-4c7e-931a-2275b65deafb None None] NSXV3.nsxv3_transport_zone_id_cache_time = 86400 {{(pid=69980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 666.437166] env[69980]: DEBUG oslo_service.backend.eventlet.service [None req-146d368d-73f3-4c7e-931a-2275b65deafb None None] NSXV3.nsxv3_transport_zone_name = nsx-vlan-transportzone {{(pid=69980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 666.437355] env[69980]: DEBUG oslo_service.backend.eventlet.service [None req-146d368d-73f3-4c7e-931a-2275b65deafb None None] vsphere.vsphere_login_hostname = vc-l-01a.corp.local {{(pid=69980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 666.437504] env[69980]: DEBUG oslo_service.backend.eventlet.service [None req-146d368d-73f3-4c7e-931a-2275b65deafb None None] vsphere.vsphere_login_password = VMware1! {{(pid=69980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 666.437652] env[69980]: DEBUG oslo_service.backend.eventlet.service [None req-146d368d-73f3-4c7e-931a-2275b65deafb None None] vsphere.vsphere_login_username = administrator@vsphere.local {{(pid=69980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 666.437798] env[69980]: DEBUG oslo_service.backend.eventlet.service [None req-146d368d-73f3-4c7e-931a-2275b65deafb None None] vsphere.vsphere_suppress_ssl_wornings = True {{(pid=69980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 666.437944] env[69980]: DEBUG oslo_service.backend.eventlet.service [None req-146d368d-73f3-4c7e-931a-2275b65deafb None None] nova.auth_section = None {{(pid=69980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 666.438105] env[69980]: DEBUG oslo_service.backend.eventlet.service [None req-146d368d-73f3-4c7e-931a-2275b65deafb None None] nova.auth_type = password {{(pid=69980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 666.438251] env[69980]: DEBUG oslo_service.backend.eventlet.service [None req-146d368d-73f3-4c7e-931a-2275b65deafb None None] nova.cafile = /opt/stack/data/ca-bundle.pem {{(pid=69980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 666.438387] env[69980]: DEBUG oslo_service.backend.eventlet.service [None req-146d368d-73f3-4c7e-931a-2275b65deafb None None] nova.certfile = None {{(pid=69980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 666.438529] env[69980]: DEBUG oslo_service.backend.eventlet.service [None req-146d368d-73f3-4c7e-931a-2275b65deafb None None] nova.collect_timing = False {{(pid=69980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 666.438676] env[69980]: DEBUG oslo_service.backend.eventlet.service [None req-146d368d-73f3-4c7e-931a-2275b65deafb None None] nova.endpoint_type = public {{(pid=69980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 666.438815] env[69980]: DEBUG oslo_service.backend.eventlet.service [None req-146d368d-73f3-4c7e-931a-2275b65deafb None None] nova.insecure = False {{(pid=69980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 666.438949] env[69980]: DEBUG oslo_service.backend.eventlet.service [None req-146d368d-73f3-4c7e-931a-2275b65deafb None None] nova.keyfile = None {{(pid=69980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 666.439106] env[69980]: DEBUG oslo_service.backend.eventlet.service [None req-146d368d-73f3-4c7e-931a-2275b65deafb None None] nova.region_name = RegionOne {{(pid=69980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 666.439279] env[69980]: DEBUG oslo_service.backend.eventlet.service [None req-146d368d-73f3-4c7e-931a-2275b65deafb None None] nova.split_loggers = False {{(pid=69980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 666.439429] env[69980]: DEBUG oslo_service.backend.eventlet.service [None req-146d368d-73f3-4c7e-931a-2275b65deafb None None] nova.timeout = None {{(pid=69980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 666.439584] env[69980]: DEBUG oslo_service.backend.eventlet.service [None req-146d368d-73f3-4c7e-931a-2275b65deafb None None] placement.auth_section = None {{(pid=69980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 666.439772] env[69980]: DEBUG oslo_service.backend.eventlet.service [None req-146d368d-73f3-4c7e-931a-2275b65deafb None None] placement.auth_type = password {{(pid=69980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 666.439923] env[69980]: DEBUG oslo_service.backend.eventlet.service [None req-146d368d-73f3-4c7e-931a-2275b65deafb None None] placement.cafile = /opt/stack/data/ca-bundle.pem {{(pid=69980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 666.440073] env[69980]: DEBUG oslo_service.backend.eventlet.service [None req-146d368d-73f3-4c7e-931a-2275b65deafb None None] placement.certfile = None {{(pid=69980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 666.440215] env[69980]: DEBUG oslo_service.backend.eventlet.service [None req-146d368d-73f3-4c7e-931a-2275b65deafb None None] placement.collect_timing = False {{(pid=69980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 666.440376] env[69980]: DEBUG oslo_service.backend.eventlet.service [None req-146d368d-73f3-4c7e-931a-2275b65deafb None None] placement.endpoint_type = public {{(pid=69980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 666.440530] env[69980]: DEBUG oslo_service.backend.eventlet.service [None req-146d368d-73f3-4c7e-931a-2275b65deafb None None] placement.insecure = False {{(pid=69980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 666.440679] env[69980]: DEBUG oslo_service.backend.eventlet.service [None req-146d368d-73f3-4c7e-931a-2275b65deafb None None] placement.keyfile = None {{(pid=69980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 666.440815] env[69980]: DEBUG oslo_service.backend.eventlet.service [None req-146d368d-73f3-4c7e-931a-2275b65deafb None None] placement.region_name = None {{(pid=69980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 666.440954] env[69980]: DEBUG oslo_service.backend.eventlet.service [None req-146d368d-73f3-4c7e-931a-2275b65deafb None None] placement.split_loggers = False {{(pid=69980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 666.441100] env[69980]: DEBUG oslo_service.backend.eventlet.service [None req-146d368d-73f3-4c7e-931a-2275b65deafb None None] placement.timeout = None {{(pid=69980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 666.441241] env[69980]: DEBUG oslo_service.backend.eventlet.service [None req-146d368d-73f3-4c7e-931a-2275b65deafb None None] ironic.auth_section = None {{(pid=69980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 666.441381] env[69980]: DEBUG oslo_service.backend.eventlet.service [None req-146d368d-73f3-4c7e-931a-2275b65deafb None None] ironic.auth_type = None {{(pid=69980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 666.441717] env[69980]: DEBUG oslo_service.backend.eventlet.service [None req-146d368d-73f3-4c7e-931a-2275b65deafb None None] ironic.cafile = None {{(pid=69980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 666.441717] env[69980]: DEBUG oslo_service.backend.eventlet.service [None req-146d368d-73f3-4c7e-931a-2275b65deafb None None] ironic.certfile = None {{(pid=69980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 666.441809] env[69980]: DEBUG oslo_service.backend.eventlet.service [None req-146d368d-73f3-4c7e-931a-2275b65deafb None None] ironic.collect_timing = False {{(pid=69980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 666.441932] env[69980]: DEBUG oslo_service.backend.eventlet.service [None req-146d368d-73f3-4c7e-931a-2275b65deafb None None] ironic.connect_retries = None {{(pid=69980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 666.442035] env[69980]: DEBUG oslo_service.backend.eventlet.service [None req-146d368d-73f3-4c7e-931a-2275b65deafb None None] ironic.connect_retry_delay = None {{(pid=69980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 666.442177] env[69980]: DEBUG oslo_service.backend.eventlet.service [None req-146d368d-73f3-4c7e-931a-2275b65deafb None None] ironic.enable_notifications = False {{(pid=69980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 666.442309] env[69980]: DEBUG oslo_service.backend.eventlet.service [None req-146d368d-73f3-4c7e-931a-2275b65deafb None None] ironic.endpoint_override = None {{(pid=69980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 666.442492] env[69980]: DEBUG oslo_service.backend.eventlet.service [None req-146d368d-73f3-4c7e-931a-2275b65deafb None None] ironic.insecure = False {{(pid=69980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 666.442574] env[69980]: DEBUG oslo_service.backend.eventlet.service [None req-146d368d-73f3-4c7e-931a-2275b65deafb None None] ironic.interface = None {{(pid=69980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 666.442707] env[69980]: DEBUG oslo_service.backend.eventlet.service [None req-146d368d-73f3-4c7e-931a-2275b65deafb None None] ironic.keyfile = None {{(pid=69980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 666.442838] env[69980]: DEBUG oslo_service.backend.eventlet.service [None req-146d368d-73f3-4c7e-931a-2275b65deafb None None] ironic.max_version = None {{(pid=69980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 666.442969] env[69980]: DEBUG oslo_service.backend.eventlet.service [None req-146d368d-73f3-4c7e-931a-2275b65deafb None None] ironic.min_version = None {{(pid=69980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 666.443115] env[69980]: DEBUG oslo_service.backend.eventlet.service [None req-146d368d-73f3-4c7e-931a-2275b65deafb None None] ironic.region_name = None {{(pid=69980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 666.443250] env[69980]: DEBUG oslo_service.backend.eventlet.service [None req-146d368d-73f3-4c7e-931a-2275b65deafb None None] ironic.retriable_status_codes = None {{(pid=69980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 666.443381] env[69980]: DEBUG oslo_service.backend.eventlet.service [None req-146d368d-73f3-4c7e-931a-2275b65deafb None None] ironic.service_name = None {{(pid=69980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 666.443511] env[69980]: DEBUG oslo_service.backend.eventlet.service [None req-146d368d-73f3-4c7e-931a-2275b65deafb None None] ironic.service_type = None {{(pid=69980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 666.443651] env[69980]: DEBUG oslo_service.backend.eventlet.service [None req-146d368d-73f3-4c7e-931a-2275b65deafb None None] ironic.split_loggers = False {{(pid=69980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 666.443786] env[69980]: DEBUG oslo_service.backend.eventlet.service [None req-146d368d-73f3-4c7e-931a-2275b65deafb None None] ironic.status_code_retries = None {{(pid=69980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 666.443920] env[69980]: DEBUG oslo_service.backend.eventlet.service [None req-146d368d-73f3-4c7e-931a-2275b65deafb None None] ironic.status_code_retry_delay = None {{(pid=69980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 666.444064] env[69980]: DEBUG oslo_service.backend.eventlet.service [None req-146d368d-73f3-4c7e-931a-2275b65deafb None None] ironic.timeout = None {{(pid=69980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 666.444201] env[69980]: DEBUG oslo_service.backend.eventlet.service [None req-146d368d-73f3-4c7e-931a-2275b65deafb None None] ironic.valid_interfaces = None {{(pid=69980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 666.444335] env[69980]: DEBUG oslo_service.backend.eventlet.service [None req-146d368d-73f3-4c7e-931a-2275b65deafb None None] ironic.version = None {{(pid=69980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 666.444476] env[69980]: DEBUG oslo_service.backend.eventlet.service [None req-146d368d-73f3-4c7e-931a-2275b65deafb None None] cli_script.dry_run = False {{(pid=69980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 666.444626] env[69980]: DEBUG oslo_service.backend.eventlet.service [None req-146d368d-73f3-4c7e-931a-2275b65deafb None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=69980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 666.444762] env[69980]: DEBUG oslo_service.backend.eventlet.service [None req-146d368d-73f3-4c7e-931a-2275b65deafb None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=69980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 666.444926] env[69980]: DEBUG oslo_service.backend.eventlet.service [None req-146d368d-73f3-4c7e-931a-2275b65deafb None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=69980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 666.445038] env[69980]: DEBUG oslo_service.backend.eventlet.service [None req-146d368d-73f3-4c7e-931a-2275b65deafb None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=69980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 666.445166] env[69980]: DEBUG oslo_service.backend.eventlet.service [None req-146d368d-73f3-4c7e-931a-2275b65deafb None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=69980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 666.445304] env[69980]: DEBUG oslo_service.backend.eventlet.service [None req-146d368d-73f3-4c7e-931a-2275b65deafb None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=69980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 666.445439] env[69980]: DEBUG oslo_service.backend.eventlet.service [None req-146d368d-73f3-4c7e-931a-2275b65deafb None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=69980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 666.445575] env[69980]: DEBUG oslo_service.backend.eventlet.service [None req-146d368d-73f3-4c7e-931a-2275b65deafb None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=69980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 666.445712] env[69980]: DEBUG oslo_service.backend.eventlet.service [None req-146d368d-73f3-4c7e-931a-2275b65deafb None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=69980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 666.445855] env[69980]: DEBUG oslo_service.backend.eventlet.service [None req-146d368d-73f3-4c7e-931a-2275b65deafb None None] oslo_messaging_rabbit.hostname = devstack {{(pid=69980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 666.445991] env[69980]: DEBUG oslo_service.backend.eventlet.service [None req-146d368d-73f3-4c7e-931a-2275b65deafb None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=69980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 666.446146] env[69980]: DEBUG oslo_service.backend.eventlet.service [None req-146d368d-73f3-4c7e-931a-2275b65deafb None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=69980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 666.446290] env[69980]: DEBUG oslo_service.backend.eventlet.service [None req-146d368d-73f3-4c7e-931a-2275b65deafb None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=69980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 666.446430] env[69980]: DEBUG oslo_service.backend.eventlet.service [None req-146d368d-73f3-4c7e-931a-2275b65deafb None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=69980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 666.446570] env[69980]: DEBUG oslo_service.backend.eventlet.service [None req-146d368d-73f3-4c7e-931a-2275b65deafb None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=69980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 666.446711] env[69980]: DEBUG oslo_service.backend.eventlet.service [None req-146d368d-73f3-4c7e-931a-2275b65deafb None None] oslo_messaging_rabbit.processname = neutron-nsxv3-agent {{(pid=69980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 666.446849] env[69980]: DEBUG oslo_service.backend.eventlet.service [None req-146d368d-73f3-4c7e-931a-2275b65deafb None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=69980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 666.446986] env[69980]: DEBUG oslo_service.backend.eventlet.service [None req-146d368d-73f3-4c7e-931a-2275b65deafb None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=69980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 666.447142] env[69980]: DEBUG oslo_service.backend.eventlet.service [None req-146d368d-73f3-4c7e-931a-2275b65deafb None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=69980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 666.447279] env[69980]: DEBUG oslo_service.backend.eventlet.service [None req-146d368d-73f3-4c7e-931a-2275b65deafb None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=69980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 666.447416] env[69980]: DEBUG oslo_service.backend.eventlet.service [None req-146d368d-73f3-4c7e-931a-2275b65deafb None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=69980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 666.447556] env[69980]: DEBUG oslo_service.backend.eventlet.service [None req-146d368d-73f3-4c7e-931a-2275b65deafb None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=69980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 666.447692] env[69980]: DEBUG oslo_service.backend.eventlet.service [None req-146d368d-73f3-4c7e-931a-2275b65deafb None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=69980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 666.447829] env[69980]: DEBUG oslo_service.backend.eventlet.service [None req-146d368d-73f3-4c7e-931a-2275b65deafb None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=69980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 666.447965] env[69980]: DEBUG oslo_service.backend.eventlet.service [None req-146d368d-73f3-4c7e-931a-2275b65deafb None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=69980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 666.448112] env[69980]: DEBUG oslo_service.backend.eventlet.service [None req-146d368d-73f3-4c7e-931a-2275b65deafb None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=69980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 666.448248] env[69980]: DEBUG oslo_service.backend.eventlet.service [None req-146d368d-73f3-4c7e-931a-2275b65deafb None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=69980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 666.448383] env[69980]: DEBUG oslo_service.backend.eventlet.service [None req-146d368d-73f3-4c7e-931a-2275b65deafb None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=69980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 666.448517] env[69980]: DEBUG oslo_service.backend.eventlet.service [None req-146d368d-73f3-4c7e-931a-2275b65deafb None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=69980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 666.448654] env[69980]: DEBUG oslo_service.backend.eventlet.service [None req-146d368d-73f3-4c7e-931a-2275b65deafb None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=69980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 666.448791] env[69980]: DEBUG oslo_service.backend.eventlet.service [None req-146d368d-73f3-4c7e-931a-2275b65deafb None None] oslo_messaging_rabbit.ssl = False {{(pid=69980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 666.448934] env[69980]: DEBUG oslo_service.backend.eventlet.service [None req-146d368d-73f3-4c7e-931a-2275b65deafb None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=69980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 666.449084] env[69980]: DEBUG oslo_service.backend.eventlet.service [None req-146d368d-73f3-4c7e-931a-2275b65deafb None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=69980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 666.449224] env[69980]: DEBUG oslo_service.backend.eventlet.service [None req-146d368d-73f3-4c7e-931a-2275b65deafb None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=69980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 666.449401] env[69980]: DEBUG oslo_service.backend.eventlet.service [None req-146d368d-73f3-4c7e-931a-2275b65deafb None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=69980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 666.449537] env[69980]: DEBUG oslo_service.backend.eventlet.service [None req-146d368d-73f3-4c7e-931a-2275b65deafb None None] oslo_messaging_rabbit.ssl_version = {{(pid=69980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 666.449634] env[69980]: DEBUG oslo_service.backend.eventlet.service [None req-146d368d-73f3-4c7e-931a-2275b65deafb None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=69980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 666.449776] env[69980]: DEBUG oslo_service.backend.eventlet.service [None req-146d368d-73f3-4c7e-931a-2275b65deafb None None] oslo_messaging_notifications.driver = [] {{(pid=69980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 666.449910] env[69980]: DEBUG oslo_service.backend.eventlet.service [None req-146d368d-73f3-4c7e-931a-2275b65deafb None None] oslo_messaging_notifications.retry = -1 {{(pid=69980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 666.450069] env[69980]: DEBUG oslo_service.backend.eventlet.service [None req-146d368d-73f3-4c7e-931a-2275b65deafb None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=69980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 666.450213] env[69980]: DEBUG oslo_service.backend.eventlet.service [None req-146d368d-73f3-4c7e-931a-2275b65deafb None None] oslo_messaging_notifications.transport_url = **** {{(pid=69980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 666.450324] env[69980]: DEBUG oslo_service.backend.eventlet.service [None req-146d368d-73f3-4c7e-931a-2275b65deafb None None] ******************************************************************************** {{(pid=69980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2828}} [ 666.451305] env[69980]: DEBUG neutron.agent.securitygroups_rpc [None req-977287c2-69f8-47e1-8dff-764e9cba9a38 None None] Init firewall settings (driver=nsxv3) {{(pid=69980) init_firewall /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:137}} [ 666.452594] env[69980]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.extensions.firewall [None req-977287c2-69f8-47e1-8dff-764e9cba9a38 None None] Initializing NSXv3SecurityGroupsDriver dummy driver. {{(pid=69980) __init__ /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/extensions/firewall.py:16}} [ 666.452809] env[69980]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-977287c2-69f8-47e1-8dff-764e9cba9a38 None None] RPC agent_id: nsxm-l-01a.corp.local [ 666.455009] env[69980]: DEBUG dogpile.cache.region [None req-977287c2-69f8-47e1-8dff-764e9cba9a38 None None] No value present for key: 'zone-id' {{(pid=69980) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 666.455143] env[69980]: DEBUG dogpile.lock [None req-977287c2-69f8-47e1-8dff-764e9cba9a38 None None] NeedRegenerationException {{(pid=69980) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 666.455235] env[69980]: DEBUG dogpile.lock [None req-977287c2-69f8-47e1-8dff-764e9cba9a38 None None] no value, waiting for create lock {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 666.455328] env[69980]: DEBUG dogpile.lock [None req-977287c2-69f8-47e1-8dff-764e9cba9a38 None None] value creation lock acquired {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 666.455421] env[69980]: DEBUG dogpile.cache.region [None req-977287c2-69f8-47e1-8dff-764e9cba9a38 None None] No value present for key: 'zone-id' {{(pid=69980) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 666.455510] env[69980]: DEBUG dogpile.lock [None req-977287c2-69f8-47e1-8dff-764e9cba9a38 None None] Calling creation function for not-yet-present value {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 666.455634] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-977287c2-69f8-47e1-8dff-764e9cba9a38 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 666.475699] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-977287c2-69f8-47e1-8dff-764e9cba9a38 None None] Session token - acquiring [ 666.477151] env[69980]: DEBUG networking_nsxv3.common.locking [None req-977287c2-69f8-47e1-8dff-764e9cba9a38 None None] Lock https://nsxt.osci.c.eu-de-1.cloud.sap:443 taken with stack trace [, , , , , , , , , , , , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.477313] env[69980]: DEBUG oslo_concurrency.lockutils [None req-977287c2-69f8-47e1-8dff-764e9cba9a38 None None] Acquiring lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.477416] env[69980]: DEBUG oslo_concurrency.lockutils [None req-977287c2-69f8-47e1-8dff-764e9cba9a38 None None] Acquired lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.477804] env[69980]: DEBUG oslo_concurrency.lockutils [None req-977287c2-69f8-47e1-8dff-764e9cba9a38 None None] Acquired external semaphore "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.488717] env[69980]: DEBUG oslo_concurrency.lockutils [None req-977287c2-69f8-47e1-8dff-764e9cba9a38 None None] Releasing lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.758183] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-977287c2-69f8-47e1-8dff-764e9cba9a38 None None] Session token - acquired, connected to NSX-T 4.1.2.0.0.22589037 [ 666.781350] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-977287c2-69f8-47e1-8dff-764e9cba9a38 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 666.781567] env[69980]: DEBUG dogpile.cache.region [None req-977287c2-69f8-47e1-8dff-764e9cba9a38 None None] Cache value generated in 0.326 seconds for key(s): 'zone-id' {{(pid=69980) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 666.781700] env[69980]: DEBUG dogpile.lock [None req-977287c2-69f8-47e1-8dff-764e9cba9a38 None None] Released creation lock {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 666.781821] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-977287c2-69f8-47e1-8dff-764e9cba9a38 None None] Activating Policy API Provider. [ 666.782026] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-977287c2-69f8-47e1-8dff-764e9cba9a38 None None] Looking for the default Infrastructure Rules. [ 666.860962] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-977287c2-69f8-47e1-8dff-764e9cba9a38 None None] Looking for the Default Layer3 Logged Drop Section. [ 666.873032] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [None req-977287c2-69f8-47e1-8dff-764e9cba9a38 None None] Detected NSX-T (4, 1, 2, 0, 0, 22589037) version. [ 666.873458] env[69980]: DEBUG networking_nsxv3.common.locking [None req-977287c2-69f8-47e1-8dff-764e9cba9a38 None None] Lock all taken with stack trace [, , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.873664] env[69980]: DEBUG oslo_concurrency.lockutils [None req-977287c2-69f8-47e1-8dff-764e9cba9a38 None None] Acquiring lock "all" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.873832] env[69980]: DEBUG oslo_concurrency.lockutils [None req-977287c2-69f8-47e1-8dff-764e9cba9a38 None None] Acquired lock "all" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.874401] env[69980]: DEBUG oslo_concurrency.lockutils [None req-977287c2-69f8-47e1-8dff-764e9cba9a38 None None] Acquired external semaphore "all" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.874485] env[69980]: DEBUG networking_nsxv3.api.rpc [None req-977287c2-69f8-47e1-8dff-764e9cba9a38 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 667.388935] env[69980]: DEBUG networking_nsxv3.api.rpc [None req-977287c2-69f8-47e1-8dff-764e9cba9a38 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 667.891521] env[69980]: DEBUG networking_nsxv3.api.rpc [None req-977287c2-69f8-47e1-8dff-764e9cba9a38 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 668.394563] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [None req-977287c2-69f8-47e1-8dff-764e9cba9a38 None None] Inventory metadata is going to be refreshed. [ 668.394732] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-977287c2-69f8-47e1-8dff-764e9cba9a38 None None] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 669.176018] env[69980]: DEBUG networking_nsxv3.common.locking [None req-977287c2-69f8-47e1-8dff-764e9cba9a38 None None] Lock Segment taken with stack trace [, , , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.176018] env[69980]: DEBUG oslo_concurrency.lockutils [None req-977287c2-69f8-47e1-8dff-764e9cba9a38 None None] Acquiring lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.176018] env[69980]: DEBUG oslo_concurrency.lockutils [None req-977287c2-69f8-47e1-8dff-764e9cba9a38 None None] Acquired lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.176018] env[69980]: DEBUG oslo_concurrency.lockutils [None req-977287c2-69f8-47e1-8dff-764e9cba9a38 None None] Acquired external semaphore "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.187446] env[69980]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [None req-977287c2-69f8-47e1-8dff-764e9cba9a38 None None] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 669.293160] env[69980]: DEBUG oslo_concurrency.lockutils [None req-977287c2-69f8-47e1-8dff-764e9cba9a38 None None] Releasing lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.295023] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-977287c2-69f8-47e1-8dff-764e9cba9a38 None None] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 669.310693] env[69980]: DEBUG networking_nsxv3.common.locking [None req-977287c2-69f8-47e1-8dff-764e9cba9a38 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.310959] env[69980]: DEBUG oslo_concurrency.lockutils [None req-977287c2-69f8-47e1-8dff-764e9cba9a38 None None] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.311121] env[69980]: DEBUG oslo_concurrency.lockutils [None req-977287c2-69f8-47e1-8dff-764e9cba9a38 None None] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.311487] env[69980]: DEBUG oslo_concurrency.lockutils [None req-977287c2-69f8-47e1-8dff-764e9cba9a38 None None] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.311634] env[69980]: DEBUG oslo_concurrency.lockutils [None req-977287c2-69f8-47e1-8dff-764e9cba9a38 None None] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.311817] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-977287c2-69f8-47e1-8dff-764e9cba9a38 None None] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 669.311962] env[69980]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-977287c2-69f8-47e1-8dff-764e9cba9a38 None None] Outdated resources of Type:SegmentPort Are:set() {{(pid=69980) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 669.312113] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-977287c2-69f8-47e1-8dff-764e9cba9a38 None None] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 669.332928] env[69980]: DEBUG networking_nsxv3.common.locking [None req-977287c2-69f8-47e1-8dff-764e9cba9a38 None None] Lock Security Group (Rules) taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.333178] env[69980]: DEBUG oslo_concurrency.lockutils [None req-977287c2-69f8-47e1-8dff-764e9cba9a38 None None] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.333301] env[69980]: DEBUG oslo_concurrency.lockutils [None req-977287c2-69f8-47e1-8dff-764e9cba9a38 None None] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.333624] env[69980]: DEBUG oslo_concurrency.lockutils [None req-977287c2-69f8-47e1-8dff-764e9cba9a38 None None] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.333838] env[69980]: DEBUG oslo_concurrency.lockutils [None req-977287c2-69f8-47e1-8dff-764e9cba9a38 None None] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.334025] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-977287c2-69f8-47e1-8dff-764e9cba9a38 None None] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 669.353919] env[69980]: DEBUG networking_nsxv3.common.locking [None req-977287c2-69f8-47e1-8dff-764e9cba9a38 None None] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.354230] env[69980]: DEBUG oslo_concurrency.lockutils [None req-977287c2-69f8-47e1-8dff-764e9cba9a38 None None] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.354338] env[69980]: DEBUG oslo_concurrency.lockutils [None req-977287c2-69f8-47e1-8dff-764e9cba9a38 None None] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.354680] env[69980]: DEBUG oslo_concurrency.lockutils [None req-977287c2-69f8-47e1-8dff-764e9cba9a38 None None] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.354874] env[69980]: DEBUG oslo_concurrency.lockutils [None req-977287c2-69f8-47e1-8dff-764e9cba9a38 None None] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.355069] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-977287c2-69f8-47e1-8dff-764e9cba9a38 None None] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 669.371835] env[69980]: DEBUG networking_nsxv3.common.locking [None req-977287c2-69f8-47e1-8dff-764e9cba9a38 None None] Lock Address Group taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.372076] env[69980]: DEBUG oslo_concurrency.lockutils [None req-977287c2-69f8-47e1-8dff-764e9cba9a38 None None] Acquiring lock "Address Group" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.372190] env[69980]: DEBUG oslo_concurrency.lockutils [None req-977287c2-69f8-47e1-8dff-764e9cba9a38 None None] Acquired lock "Address Group" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.372528] env[69980]: DEBUG oslo_concurrency.lockutils [None req-977287c2-69f8-47e1-8dff-764e9cba9a38 None None] Acquired external semaphore "Address Group" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.372707] env[69980]: DEBUG oslo_concurrency.lockutils [None req-977287c2-69f8-47e1-8dff-764e9cba9a38 None None] Releasing lock "Address Group" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.372887] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-977287c2-69f8-47e1-8dff-764e9cba9a38 None None] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:0. [ 669.373039] env[69980]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-977287c2-69f8-47e1-8dff-764e9cba9a38 None None] Outdated resources of Type:Security Group (Rules) Are:set() {{(pid=69980) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 669.373178] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-977287c2-69f8-47e1-8dff-764e9cba9a38 None None] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 669.389766] env[69980]: DEBUG networking_nsxv3.common.locking [None req-977287c2-69f8-47e1-8dff-764e9cba9a38 None None] Lock Segment QoS taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.389994] env[69980]: DEBUG oslo_concurrency.lockutils [None req-977287c2-69f8-47e1-8dff-764e9cba9a38 None None] Acquiring lock "Segment QoS" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.390214] env[69980]: DEBUG oslo_concurrency.lockutils [None req-977287c2-69f8-47e1-8dff-764e9cba9a38 None None] Acquired lock "Segment QoS" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.390400] env[69980]: DEBUG oslo_concurrency.lockutils [None req-977287c2-69f8-47e1-8dff-764e9cba9a38 None None] Acquired external semaphore "Segment QoS" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.390561] env[69980]: DEBUG oslo_concurrency.lockutils [None req-977287c2-69f8-47e1-8dff-764e9cba9a38 None None] Releasing lock "Segment QoS" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.390754] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-977287c2-69f8-47e1-8dff-764e9cba9a38 None None] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 669.390890] env[69980]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-977287c2-69f8-47e1-8dff-764e9cba9a38 None None] Outdated resources of Type:Segment QoS Are:set() {{(pid=69980) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 669.391040] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-977287c2-69f8-47e1-8dff-764e9cba9a38 None None] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 669.408820] env[69980]: DEBUG networking_nsxv3.common.locking [None req-977287c2-69f8-47e1-8dff-764e9cba9a38 None None] Lock Security Group (Members) taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.409065] env[69980]: DEBUG oslo_concurrency.lockutils [None req-977287c2-69f8-47e1-8dff-764e9cba9a38 None None] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.409188] env[69980]: DEBUG oslo_concurrency.lockutils [None req-977287c2-69f8-47e1-8dff-764e9cba9a38 None None] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.409497] env[69980]: DEBUG oslo_concurrency.lockutils [None req-977287c2-69f8-47e1-8dff-764e9cba9a38 None None] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.409679] env[69980]: DEBUG oslo_concurrency.lockutils [None req-977287c2-69f8-47e1-8dff-764e9cba9a38 None None] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.409861] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-977287c2-69f8-47e1-8dff-764e9cba9a38 None None] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 669.409998] env[69980]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-977287c2-69f8-47e1-8dff-764e9cba9a38 None None] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=69980) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 669.410138] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [None req-977287c2-69f8-47e1-8dff-764e9cba9a38 None None] Inventory metadata have been refreshed. [ 669.410263] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [None req-977287c2-69f8-47e1-8dff-764e9cba9a38 None None] Dryrun:True. Metadata refresh completed. [ 669.410407] env[69980]: DEBUG oslo_concurrency.lockutils [None req-977287c2-69f8-47e1-8dff-764e9cba9a38 None None] Releasing lock "all" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.412105] env[69980]: INFO neutron.agent.agent_extensions_manager [None req-977287c2-69f8-47e1-8dff-764e9cba9a38 None None] Loaded agent extensions: [] [ 669.412872] env[69980]: DEBUG neutron_lib.callbacks.manager [None req-977287c2-69f8-47e1-8dff-764e9cba9a38 None None] Publish callbacks [] for NSXv3 Agent (None), after_init {{(pid=69980) _notify_loop /opt/stack/data/venv/lib/python3.10/site-packages/neutron_lib/callbacks/manager.py:184}} [ 669.461172] env[69980]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-977287c2-69f8-47e1-8dff-764e9cba9a38 None None] NSXv3 Agent Agent RPC Daemon Started! [ 669.461289] env[69980]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-977287c2-69f8-47e1-8dff-764e9cba9a38 None None] NSXv3 Agent Agent loop - iteration:0 started [ 669.461398] env[69980]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-977287c2-69f8-47e1-8dff-764e9cba9a38 None None] NSXv3 Agent Agent out of sync with plugin! [ 674.413562] env[69980]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 674.413934] env[69980]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 679.415526] env[69980]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 679.415877] env[69980]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 683.260710] env[69980]: INFO networking_nsxv3.common.synchronization [None req-fb9d0d6f-3618-49b5-9a55-06c7f5662c5a demo admin] Enqueued Resource ID: abca118d-8e9b-4ea4-a1ab-e89fbdc5f88a with Priority: HIGHEST for action security_group_rules [ 683.261308] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: abca118d-8e9b-4ea4-a1ab-e89fbdc5f88a with Priority: HIGHEST for action security_group_rules [ 683.261662] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock rules-abca118d-8e9b-4ea4-a1ab-e89fbdc5f88a taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.261854] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-abca118d-8e9b-4ea4-a1ab-e89fbdc5f88a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.261892] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-abca118d-8e9b-4ea4-a1ab-e89fbdc5f88a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.263026] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-abca118d-8e9b-4ea4-a1ab-e89fbdc5f88a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.263026] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('abca118d-8e9b-4ea4-a1ab-e89fbdc5f88a',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 683.786189] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.786400] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.786400] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.786541] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.786635] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.786730] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: abca118d-8e9b-4ea4-a1ab-e89fbdc5f88a already deleted. [ 683.786812] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-abca118d-8e9b-4ea4-a1ab-e89fbdc5f88a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.262449] env[69980]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 688.262863] env[69980]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 688.415535] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.415855] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.415855] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.415968] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.416197] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 688.918642] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 689.420992] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 689.923824] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 689.924035] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 690.678763] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.679192] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.679192] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.679192] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.690761] env[69980]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 690.691533] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.692138] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 690.708436] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.708571] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.708612] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.708812] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.708897] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.709013] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 690.709087] env[69980]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=69980) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 690.709156] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 690.725964] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.726139] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.726182] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.726334] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.726459] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.726563] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 690.743705] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.743836] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.743909] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.744112] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.744214] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.744312] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 690.760764] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.760900] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.760957] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.761111] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.761204] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.761305] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:0. [ 690.761376] env[69980]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:set() {{(pid=69980) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 690.761445] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 690.779466] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.779583] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.779659] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.779797] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.779876] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.779972] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 690.780055] env[69980]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=69980) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 690.780125] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 690.797920] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.798047] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.798111] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.798270] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.798362] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.798464] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 690.798533] env[69980]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=69980) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 690.798599] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 690.798663] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 690.798734] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Security Group Rules [ 690.798798] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Security Group Members [ 690.798858] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:QoS [ 690.799126] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Items outdated since last Agent sanitize:0 [ 690.799188] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Sanitizing provider based on age cycles [ 690.799256] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 690.815776] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.815892] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.815961] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.816128] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.816221] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.816318] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 690.832985] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.833124] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.833175] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.833324] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.833416] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.869257] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.263482] env[69980]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 693.263835] env[69980]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 698.265315] env[69980]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 698.265653] env[69980]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 703.268026] env[69980]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 703.268026] env[69980]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 708.268228] env[69980]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 708.268490] env[69980]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 712.005075] env[69980]: INFO networking_nsxv3.common.synchronization [None req-a0870f9a-cb24-4b54-8ecb-b4a86d596fbe None None] Enqueued Resource ID: 008e4726-d748-4f15-acec-5ec055fa66be with Priority: HIGHEST for action port [ 712.006034] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 008e4726-d748-4f15-acec-5ec055fa66be with Priority: HIGHEST for action port [ 712.007386] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock port-008e4726-d748-4f15-acec-5ec055fa66be taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.007723] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-008e4726-d748-4f15-acec-5ec055fa66be" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.007723] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-008e4726-d748-4f15-acec-5ec055fa66be" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.009151] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-008e4726-d748-4f15-acec-5ec055fa66be" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.009151] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('008e4726-d748-4f15-acec-5ec055fa66be',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 712.513536] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 008e4726-d748-4f15-acec-5ec055fa66be [ 712.514008] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.514254] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.514852] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.515492] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.515651] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.515748] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:008e4726-d748-4f15-acec-5ec055fa66be already deleted. [ 712.515812] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-008e4726-d748-4f15-acec-5ec055fa66be" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.821204] env[69980]: INFO networking_nsxv3.common.synchronization [None req-182a4e9c-4ce3-4fcb-abd8-b2bb9688a8da None None] Enqueued Resource ID: e4e7a2ca-92af-4b2e-8037-7fae4c7d5dba with Priority: HIGHEST for action port [ 713.821485] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e4e7a2ca-92af-4b2e-8037-7fae4c7d5dba with Priority: HIGHEST for action port [ 713.822029] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock port-e4e7a2ca-92af-4b2e-8037-7fae4c7d5dba taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.822126] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e4e7a2ca-92af-4b2e-8037-7fae4c7d5dba" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.822245] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e4e7a2ca-92af-4b2e-8037-7fae4c7d5dba" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.822417] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e4e7a2ca-92af-4b2e-8037-7fae4c7d5dba" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.822500] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e4e7a2ca-92af-4b2e-8037-7fae4c7d5dba',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 713.937740] env[69980]: INFO networking_nsxv3.common.synchronization [None req-189b93c4-1a0e-4550-a026-d6934580972f None None] Enqueued Resource ID: f8e47f0f-c07d-4c2f-9d92-3329b6ce090f with Priority: HIGHEST for action port [ 713.938698] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f8e47f0f-c07d-4c2f-9d92-3329b6ce090f with Priority: HIGHEST for action port [ 713.939369] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock port-f8e47f0f-c07d-4c2f-9d92-3329b6ce090f taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.939610] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f8e47f0f-c07d-4c2f-9d92-3329b6ce090f" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.939827] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f8e47f0f-c07d-4c2f-9d92-3329b6ce090f" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.940773] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f8e47f0f-c07d-4c2f-9d92-3329b6ce090f" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.940861] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f8e47f0f-c07d-4c2f-9d92-3329b6ce090f',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 714.325791] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port e4e7a2ca-92af-4b2e-8037-7fae4c7d5dba [ 714.326026] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.326164] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.326232] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.326445] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.326530] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.327016] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:e4e7a2ca-92af-4b2e-8037-7fae4c7d5dba already deleted. [ 714.327016] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e4e7a2ca-92af-4b2e-8037-7fae4c7d5dba" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.443339] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f8e47f0f-c07d-4c2f-9d92-3329b6ce090f [ 714.445167] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.445167] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.445167] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.445167] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.445167] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.445167] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f8e47f0f-c07d-4c2f-9d92-3329b6ce090f already deleted. [ 714.445167] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f8e47f0f-c07d-4c2f-9d92-3329b6ce090f" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.463740] env[69980]: INFO networking_nsxv3.common.synchronization [None req-99719a9c-f41a-48ba-8fc5-9bffd2f3bc49 None None] Enqueued Resource ID: 6d959a46-ec87-4d48-96aa-883cdb3f0381 with Priority: HIGHEST for action port [ 715.463740] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6d959a46-ec87-4d48-96aa-883cdb3f0381 with Priority: HIGHEST for action port [ 715.464350] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock port-6d959a46-ec87-4d48-96aa-883cdb3f0381 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.466577] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6d959a46-ec87-4d48-96aa-883cdb3f0381" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.466577] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6d959a46-ec87-4d48-96aa-883cdb3f0381" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.466577] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6d959a46-ec87-4d48-96aa-883cdb3f0381" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.466577] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6d959a46-ec87-4d48-96aa-883cdb3f0381',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 715.785536] env[69980]: INFO networking_nsxv3.common.synchronization [None req-9dcb459f-5803-4ab6-976e-2cf673f12b39 None None] Enqueued Resource ID: 2aadcb3f-7f8c-45a0-bc2d-925748ec2c3d with Priority: HIGHEST for action port [ 715.785536] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2aadcb3f-7f8c-45a0-bc2d-925748ec2c3d with Priority: HIGHEST for action port [ 715.785536] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock port-2aadcb3f-7f8c-45a0-bc2d-925748ec2c3d taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.785776] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2aadcb3f-7f8c-45a0-bc2d-925748ec2c3d" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.785776] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2aadcb3f-7f8c-45a0-bc2d-925748ec2c3d" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.785926] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2aadcb3f-7f8c-45a0-bc2d-925748ec2c3d" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.785987] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2aadcb3f-7f8c-45a0-bc2d-925748ec2c3d',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 715.956572] env[69980]: INFO networking_nsxv3.common.synchronization [None req-db27ef29-85d9-4a0c-a958-356c1d08f9ef None None] Enqueued Resource ID: 46961d08-f24c-4bda-8f1d-4964503995ae with Priority: HIGHEST for action port [ 715.956676] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 46961d08-f24c-4bda-8f1d-4964503995ae with Priority: HIGHEST for action port [ 715.958037] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock port-46961d08-f24c-4bda-8f1d-4964503995ae taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.958430] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-46961d08-f24c-4bda-8f1d-4964503995ae" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.958430] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-46961d08-f24c-4bda-8f1d-4964503995ae" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.958641] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-46961d08-f24c-4bda-8f1d-4964503995ae" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.958641] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('46961d08-f24c-4bda-8f1d-4964503995ae',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 715.970330] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 6d959a46-ec87-4d48-96aa-883cdb3f0381 [ 715.971177] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.971254] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.971332] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.971557] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.971678] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.973239] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:6d959a46-ec87-4d48-96aa-883cdb3f0381 already deleted. [ 715.973304] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6d959a46-ec87-4d48-96aa-883cdb3f0381" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.292778] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 2aadcb3f-7f8c-45a0-bc2d-925748ec2c3d [ 716.292778] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.292778] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.292778] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.292778] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.292778] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.293082] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:2aadcb3f-7f8c-45a0-bc2d-925748ec2c3d already deleted. [ 716.293082] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2aadcb3f-7f8c-45a0-bc2d-925748ec2c3d" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.295186] env[69980]: INFO networking_nsxv3.common.synchronization [None req-ce85d1e1-4e58-4c4c-ac18-b3f14ed6bd6a None None] Enqueued Resource ID: f46f46da-0492-4e79-b3ed-f912f855a122 with Priority: HIGHEST for action port [ 716.295325] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f46f46da-0492-4e79-b3ed-f912f855a122 with Priority: HIGHEST for action port [ 716.295977] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock port-f46f46da-0492-4e79-b3ed-f912f855a122 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.296103] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f46f46da-0492-4e79-b3ed-f912f855a122" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.296150] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f46f46da-0492-4e79-b3ed-f912f855a122" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.296397] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f46f46da-0492-4e79-b3ed-f912f855a122" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.296479] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f46f46da-0492-4e79-b3ed-f912f855a122',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 716.461114] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 46961d08-f24c-4bda-8f1d-4964503995ae [ 716.461114] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.461114] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.461114] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.461114] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.461114] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.461114] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:46961d08-f24c-4bda-8f1d-4964503995ae already deleted. [ 716.461114] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-46961d08-f24c-4bda-8f1d-4964503995ae" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.698919] env[69980]: INFO networking_nsxv3.common.synchronization [None req-677336b3-c995-4b3c-b8df-404971af6dd9 None None] Enqueued Resource ID: 3958a786-673b-48c9-9074-978fdcbc9320 with Priority: HIGHEST for action port [ 716.698919] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3958a786-673b-48c9-9074-978fdcbc9320 with Priority: HIGHEST for action port [ 716.698919] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock port-3958a786-673b-48c9-9074-978fdcbc9320 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.699302] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3958a786-673b-48c9-9074-978fdcbc9320" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.699302] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3958a786-673b-48c9-9074-978fdcbc9320" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.699491] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3958a786-673b-48c9-9074-978fdcbc9320" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.699553] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3958a786-673b-48c9-9074-978fdcbc9320',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 716.800035] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f46f46da-0492-4e79-b3ed-f912f855a122 [ 716.800319] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.800905] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.803121] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.803283] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.803377] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.804045] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f46f46da-0492-4e79-b3ed-f912f855a122 already deleted. [ 716.804045] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f46f46da-0492-4e79-b3ed-f912f855a122" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.201521] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 3958a786-673b-48c9-9074-978fdcbc9320 [ 717.202247] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.202474] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.202550] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.202769] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.202855] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.203350] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:3958a786-673b-48c9-9074-978fdcbc9320 already deleted. [ 717.203574] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3958a786-673b-48c9-9074-978fdcbc9320" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.240690] env[69980]: INFO networking_nsxv3.common.synchronization [None req-6203f088-fb04-45a0-8d14-04a8a5cea1b8 None None] Enqueued Resource ID: 03b1668d-cf82-415f-b5a7-87f73e7eccb2 with Priority: HIGHEST for action port [ 718.240960] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 03b1668d-cf82-415f-b5a7-87f73e7eccb2 with Priority: HIGHEST for action port [ 718.241493] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock port-03b1668d-cf82-415f-b5a7-87f73e7eccb2 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.241620] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-03b1668d-cf82-415f-b5a7-87f73e7eccb2" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.241688] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-03b1668d-cf82-415f-b5a7-87f73e7eccb2" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.241940] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-03b1668d-cf82-415f-b5a7-87f73e7eccb2" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.243721] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('03b1668d-cf82-415f-b5a7-87f73e7eccb2',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 718.745885] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 03b1668d-cf82-415f-b5a7-87f73e7eccb2 [ 718.746541] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.747436] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.747519] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.747743] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.747850] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.747990] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:03b1668d-cf82-415f-b5a7-87f73e7eccb2 already deleted. [ 718.748082] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-03b1668d-cf82-415f-b5a7-87f73e7eccb2" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.108770] env[69980]: INFO networking_nsxv3.common.synchronization [None req-67790aaf-f7a9-4964-9df7-bf5909da1186 None None] Enqueued Resource ID: 7e5f9051-e581-4235-aca7-d6899a17688f with Priority: HIGHEST for action port [ 720.108770] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7e5f9051-e581-4235-aca7-d6899a17688f with Priority: HIGHEST for action port [ 720.108770] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock port-7e5f9051-e581-4235-aca7-d6899a17688f taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.108770] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7e5f9051-e581-4235-aca7-d6899a17688f" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.108770] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7e5f9051-e581-4235-aca7-d6899a17688f" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.110091] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7e5f9051-e581-4235-aca7-d6899a17688f" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.110091] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7e5f9051-e581-4235-aca7-d6899a17688f',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 720.468040] env[69980]: INFO networking_nsxv3.common.synchronization [None req-9caaade9-cb5f-435c-be45-626a05fa26d2 None None] Enqueued Resource ID: ca733a9e-f4ce-49f3-bb02-c12613744f75 with Priority: HIGHEST for action port [ 720.468040] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ca733a9e-f4ce-49f3-bb02-c12613744f75 with Priority: HIGHEST for action port [ 720.468388] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock port-ca733a9e-f4ce-49f3-bb02-c12613744f75 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.468488] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ca733a9e-f4ce-49f3-bb02-c12613744f75" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.468523] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ca733a9e-f4ce-49f3-bb02-c12613744f75" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.468763] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ca733a9e-f4ce-49f3-bb02-c12613744f75" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.468839] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ca733a9e-f4ce-49f3-bb02-c12613744f75',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 720.611991] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 7e5f9051-e581-4235-aca7-d6899a17688f [ 720.612267] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.612404] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.612473] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.612772] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.613577] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.613577] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:7e5f9051-e581-4235-aca7-d6899a17688f already deleted. [ 720.613577] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7e5f9051-e581-4235-aca7-d6899a17688f" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.970552] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ca733a9e-f4ce-49f3-bb02-c12613744f75 [ 720.970827] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.970992] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.971085] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.971322] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.971408] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.971522] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ca733a9e-f4ce-49f3-bb02-c12613744f75 already deleted. [ 720.971751] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ca733a9e-f4ce-49f3-bb02-c12613744f75" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.464244] env[69980]: INFO networking_nsxv3.common.synchronization [None req-d17e597e-a9c9-42ad-96cb-c5f1118e6c09 None None] Enqueued Resource ID: c1db4c5d-fba6-4a8f-adcd-58cba2750460 with Priority: HIGHEST for action port [ 721.464538] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c1db4c5d-fba6-4a8f-adcd-58cba2750460 with Priority: HIGHEST for action port [ 721.465166] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock port-c1db4c5d-fba6-4a8f-adcd-58cba2750460 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.465873] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c1db4c5d-fba6-4a8f-adcd-58cba2750460" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.465873] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c1db4c5d-fba6-4a8f-adcd-58cba2750460" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.465873] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c1db4c5d-fba6-4a8f-adcd-58cba2750460" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.465873] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c1db4c5d-fba6-4a8f-adcd-58cba2750460',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 721.481884] env[69980]: INFO networking_nsxv3.common.synchronization [None req-53877316-761c-4bd0-863c-c864f96eafab None None] Enqueued Resource ID: 16575842-6c39-4d59-92da-39329c0df81e with Priority: HIGHEST for action port [ 721.482181] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 16575842-6c39-4d59-92da-39329c0df81e with Priority: HIGHEST for action port [ 721.482746] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock port-16575842-6c39-4d59-92da-39329c0df81e taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.482884] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-16575842-6c39-4d59-92da-39329c0df81e" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.482981] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-16575842-6c39-4d59-92da-39329c0df81e" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.483304] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-16575842-6c39-4d59-92da-39329c0df81e" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.483368] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('16575842-6c39-4d59-92da-39329c0df81e',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 721.903907] env[69980]: INFO networking_nsxv3.common.synchronization [None req-1249e653-7fb8-495f-bb8d-a46cbd72f381 None None] Enqueued Resource ID: 09e259b8-ee9c-4045-a130-1db0c60b0252 with Priority: HIGHEST for action port [ 721.904199] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 09e259b8-ee9c-4045-a130-1db0c60b0252 with Priority: HIGHEST for action port [ 721.904766] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock port-09e259b8-ee9c-4045-a130-1db0c60b0252 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.904921] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-09e259b8-ee9c-4045-a130-1db0c60b0252" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.905023] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-09e259b8-ee9c-4045-a130-1db0c60b0252" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.905206] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-09e259b8-ee9c-4045-a130-1db0c60b0252" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.905287] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('09e259b8-ee9c-4045-a130-1db0c60b0252',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 721.969728] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port c1db4c5d-fba6-4a8f-adcd-58cba2750460 [ 721.970784] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.973141] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.973141] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.973141] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.973141] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.973141] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:c1db4c5d-fba6-4a8f-adcd-58cba2750460 already deleted. [ 721.973141] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c1db4c5d-fba6-4a8f-adcd-58cba2750460" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.986509] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 16575842-6c39-4d59-92da-39329c0df81e [ 721.986911] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.987224] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.987890] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.988471] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.988680] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.989056] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:16575842-6c39-4d59-92da-39329c0df81e already deleted. [ 721.989056] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-16575842-6c39-4d59-92da-39329c0df81e" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.413203] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 09e259b8-ee9c-4045-a130-1db0c60b0252 [ 722.413428] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.413584] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.413731] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.414326] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.414326] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.414326] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:09e259b8-ee9c-4045-a130-1db0c60b0252 already deleted. [ 722.414326] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-09e259b8-ee9c-4045-a130-1db0c60b0252" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.619987] env[69980]: INFO networking_nsxv3.common.synchronization [None req-a839f083-45e7-404e-9cef-f077303ad14d None None] Enqueued Resource ID: 1d204ada-b566-4db3-aa2b-8bd18be6673a with Priority: HIGHEST for action port [ 722.619987] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1d204ada-b566-4db3-aa2b-8bd18be6673a with Priority: HIGHEST for action port [ 722.619987] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock port-1d204ada-b566-4db3-aa2b-8bd18be6673a taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.619987] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1d204ada-b566-4db3-aa2b-8bd18be6673a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.619987] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1d204ada-b566-4db3-aa2b-8bd18be6673a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.619987] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1d204ada-b566-4db3-aa2b-8bd18be6673a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.619987] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1d204ada-b566-4db3-aa2b-8bd18be6673a',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 723.124733] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 1d204ada-b566-4db3-aa2b-8bd18be6673a [ 723.126047] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.126047] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.126047] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.126047] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.126047] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.126467] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:1d204ada-b566-4db3-aa2b-8bd18be6673a already deleted. [ 723.126820] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1d204ada-b566-4db3-aa2b-8bd18be6673a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.570890] env[69980]: INFO networking_nsxv3.common.synchronization [None req-839e8146-4c26-44a6-9904-b5a2ae92e163 tempest-VolumesAdminNegativeTest-1476822754 tempest-VolumesAdminNegativeTest-1476822754-project-member] Enqueued Resource ID: 100806a5-6fdb-4512-83e3-fc77cac134dd with Priority: HIGHEST for action security_group_rules [ 723.571350] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 100806a5-6fdb-4512-83e3-fc77cac134dd with Priority: HIGHEST for action security_group_rules [ 723.571642] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock rules-100806a5-6fdb-4512-83e3-fc77cac134dd taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.571758] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-100806a5-6fdb-4512-83e3-fc77cac134dd" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.571821] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-100806a5-6fdb-4512-83e3-fc77cac134dd" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.574962] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-100806a5-6fdb-4512-83e3-fc77cac134dd" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.575078] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('100806a5-6fdb-4512-83e3-fc77cac134dd',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 723.590513] env[69980]: INFO networking_nsxv3.common.synchronization [None req-5e4cde22-6afd-4549-98e4-ce7904327f1f None None] Enqueued Resource ID: 109938be-9634-47c0-be45-ce0d58146ef2 with Priority: HIGHEST for action port [ 723.590997] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 109938be-9634-47c0-be45-ce0d58146ef2 with Priority: HIGHEST for action port [ 723.592827] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock port-109938be-9634-47c0-be45-ce0d58146ef2 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.592932] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-109938be-9634-47c0-be45-ce0d58146ef2" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.593094] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-109938be-9634-47c0-be45-ce0d58146ef2" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.593379] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-109938be-9634-47c0-be45-ce0d58146ef2" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.593458] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('109938be-9634-47c0-be45-ce0d58146ef2',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 724.097809] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.097809] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.097809] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.097809] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.097809] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.097809] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 100806a5-6fdb-4512-83e3-fc77cac134dd already deleted. [ 724.097809] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-100806a5-6fdb-4512-83e3-fc77cac134dd" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.098931] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 109938be-9634-47c0-be45-ce0d58146ef2 [ 724.099141] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.099260] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.099358] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.099516] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.099596] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.099725] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:109938be-9634-47c0-be45-ce0d58146ef2 already deleted. [ 724.099832] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-109938be-9634-47c0-be45-ce0d58146ef2" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.146641] env[69980]: INFO networking_nsxv3.common.synchronization [None req-3193d41e-e1ad-4994-bc1c-7bef67a4895e tempest-VolumesAdminNegativeTest-1476822754 tempest-VolumesAdminNegativeTest-1476822754-project-member] Enqueued Resource ID: 100806a5-6fdb-4512-83e3-fc77cac134dd with Priority: HIGHEST for action security_group_rules [ 724.147294] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 100806a5-6fdb-4512-83e3-fc77cac134dd with Priority: HIGHEST for action security_group_rules [ 724.147652] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock rules-100806a5-6fdb-4512-83e3-fc77cac134dd taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.149875] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-100806a5-6fdb-4512-83e3-fc77cac134dd" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.149875] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-100806a5-6fdb-4512-83e3-fc77cac134dd" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.149875] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-100806a5-6fdb-4512-83e3-fc77cac134dd" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.149875] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('100806a5-6fdb-4512-83e3-fc77cac134dd',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 724.676648] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.676648] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.676648] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.676648] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.676814] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.676814] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 100806a5-6fdb-4512-83e3-fc77cac134dd already deleted. [ 724.676879] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-100806a5-6fdb-4512-83e3-fc77cac134dd" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.812297] env[69980]: INFO networking_nsxv3.common.synchronization [req-42d54c6f-8e7b-472b-ad6d-6e06668fc11f req-b9d60256-9018-4d96-8ceb-11cf1ebb4aa0 tempest-ImagesOneServerTestJSON-1417450468 tempest-ImagesOneServerTestJSON-1417450468-project-member] Enqueued Resource ID: bf060907-afd6-4dc2-b6bb-9fd99f7f9dad with Priority: HIGHEST for action security_group_members [ 724.812297] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bf060907-afd6-4dc2-b6bb-9fd99f7f9dad with Priority: HIGHEST for action security_group_members [ 724.812297] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-bf060907-afd6-4dc2-b6bb-9fd99f7f9dad taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.812297] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bf060907-afd6-4dc2-b6bb-9fd99f7f9dad" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.812297] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bf060907-afd6-4dc2-b6bb-9fd99f7f9dad" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.813688] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bf060907-afd6-4dc2-b6bb-9fd99f7f9dad" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.813688] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.813688] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.813688] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.813688] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.813688] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.813887] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bf060907-afd6-4dc2-b6bb-9fd99f7f9dad',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 725.275793] env[69980]: INFO networking_nsxv3.common.synchronization [None req-d9922858-52db-4688-a52d-c49013e1e640 None None] Enqueued Resource ID: eed3adae-845f-4286-90ef-4f62c96eaa96 with Priority: HIGHEST for action port [ 725.276082] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eed3adae-845f-4286-90ef-4f62c96eaa96 with Priority: HIGHEST for action port [ 725.276628] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock port-eed3adae-845f-4286-90ef-4f62c96eaa96 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.276773] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-eed3adae-845f-4286-90ef-4f62c96eaa96" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.276813] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-eed3adae-845f-4286-90ef-4f62c96eaa96" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.278056] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-eed3adae-845f-4286-90ef-4f62c96eaa96" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.278157] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('eed3adae-845f-4286-90ef-4f62c96eaa96',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 725.315456] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.315627] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.315697] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.315901] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.315999] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.316205] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.316312] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.316376] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.316530] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.317583] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.317698] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bf060907-afd6-4dc2-b6bb-9fd99f7f9dad already deleted. [ 725.317873] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bf060907-afd6-4dc2-b6bb-9fd99f7f9dad" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.779833] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port eed3adae-845f-4286-90ef-4f62c96eaa96 [ 725.780102] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.782842] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.782842] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.782842] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.782842] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.782842] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:eed3adae-845f-4286-90ef-4f62c96eaa96 already deleted. [ 725.782842] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-eed3adae-845f-4286-90ef-4f62c96eaa96" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.838106] env[69980]: INFO networking_nsxv3.common.synchronization [None req-de570552-e30b-42b4-bee7-89e294609020 None None] Enqueued Resource ID: 15a7df34-82bf-44c2-8cff-8f179d7da796 with Priority: HIGHEST for action port [ 725.839937] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 15a7df34-82bf-44c2-8cff-8f179d7da796 with Priority: HIGHEST for action port [ 725.840749] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock port-15a7df34-82bf-44c2-8cff-8f179d7da796 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.840894] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-15a7df34-82bf-44c2-8cff-8f179d7da796" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.840963] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-15a7df34-82bf-44c2-8cff-8f179d7da796" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.841227] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-15a7df34-82bf-44c2-8cff-8f179d7da796" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.841309] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('15a7df34-82bf-44c2-8cff-8f179d7da796',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 726.043934] env[69980]: INFO networking_nsxv3.common.synchronization [None req-32be1e33-d9b1-4eff-bc9d-c475ad334a02 None None] Enqueued Resource ID: 993cd5da-0077-4fb4-b8ff-dbfd473930c2 with Priority: HIGHEST for action port [ 726.044522] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 993cd5da-0077-4fb4-b8ff-dbfd473930c2 with Priority: HIGHEST for action port [ 726.045752] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock port-993cd5da-0077-4fb4-b8ff-dbfd473930c2 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.045878] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-993cd5da-0077-4fb4-b8ff-dbfd473930c2" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.045945] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-993cd5da-0077-4fb4-b8ff-dbfd473930c2" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.046225] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-993cd5da-0077-4fb4-b8ff-dbfd473930c2" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.046319] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('993cd5da-0077-4fb4-b8ff-dbfd473930c2',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 726.246600] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock network-274 taken with stack trace [, , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.246807] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "network-274" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.246933] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "network-274" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.247261] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "network-274" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.247534] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.247680] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.247910] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.248018] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.248941] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.249945] env[69980]: DEBUG dogpile.cache.region [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] No value present for key: 'zone-id' {{(pid=69980) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 726.250241] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] NeedRegenerationException {{(pid=69980) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 726.250879] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] no value, waiting for create lock {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 726.251151] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] value creation lock acquired {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 726.251445] env[69980]: DEBUG dogpile.cache.region [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] No value present for key: 'zone-id' {{(pid=69980) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 726.251523] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Calling creation function for not-yet-present value {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 726.251669] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 726.270575] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 726.271061] env[69980]: DEBUG dogpile.cache.region [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=69980) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 726.271061] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Released creation lock {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 726.271779] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "network-274" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.274328] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock port-b06acbcc-aaef-4692-991e-81739f0a65cc taken with stack trace [, , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.274737] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "port-b06acbcc-aaef-4692-991e-81739f0a65cc" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.274817] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "port-b06acbcc-aaef-4692-991e-81739f0a65cc" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.275566] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "port-b06acbcc-aaef-4692-991e-81739f0a65cc" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.275965] env[69980]: DEBUG networking_nsxv3.api.rpc [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b06acbcc-aaef-4692-991e-81739f0a65cc',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 726.344088] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 15a7df34-82bf-44c2-8cff-8f179d7da796 [ 726.344330] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.344471] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.344545] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.344743] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.344825] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.344927] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:15a7df34-82bf-44c2-8cff-8f179d7da796 already deleted. [ 726.345015] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-15a7df34-82bf-44c2-8cff-8f179d7da796" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.548849] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 993cd5da-0077-4fb4-b8ff-dbfd473930c2 [ 726.549138] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.549229] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.549369] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.549525] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.549710] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.549710] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:993cd5da-0077-4fb4-b8ff-dbfd473930c2 already deleted. [ 726.549801] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-993cd5da-0077-4fb4-b8ff-dbfd473930c2" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.780088] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.780338] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.780456] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.780662] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.780807] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.780960] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Segment Port b06acbcc-aaef-4692-991e-81739f0a65cc not found, creating... [ 726.781429] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.781571] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.781571] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.781778] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.781944] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.782336] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.782735] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.786811] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.786811] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.786811] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.786811] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Resource: SegmentPort with ID: b06acbcc-aaef-4692-991e-81739f0a65cc is going to be created. [ 726.807460] env[69980]: INFO networking_nsxv3.common.synchronization [None req-5b1c3de9-13f7-4cfd-a926-1edb0d72fa27 None None] Enqueued Resource ID: 421c5db1-c16c-449c-a4d3-cc599e575ade with Priority: HIGHEST for action port [ 726.807995] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 421c5db1-c16c-449c-a4d3-cc599e575ade with Priority: HIGHEST for action port [ 726.808307] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock port-421c5db1-c16c-449c-a4d3-cc599e575ade taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.808453] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-421c5db1-c16c-449c-a4d3-cc599e575ade" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.808490] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-421c5db1-c16c-449c-a4d3-cc599e575ade" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.808722] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-421c5db1-c16c-449c-a4d3-cc599e575ade" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.808798] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('421c5db1-c16c-449c-a4d3-cc599e575ade',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 726.817534] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.819117] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.819117] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.819117] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.819117] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.819117] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "port-b06acbcc-aaef-4692-991e-81739f0a65cc" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.233410] env[69980]: INFO networking_nsxv3.common.synchronization [req-3401e883-628a-4227-8c84-6bc8d66e03ad req-9ab1d73f-ffbe-4d95-a59a-b0cc897f9fca tempest-DeleteServersAdminTestJSON-1963276659 tempest-DeleteServersAdminTestJSON-1963276659-project-member] Enqueued Resource ID: 07d8236a-b9f2-429a-9942-e7cb46920213 with Priority: HIGHEST for action security_group_members [ 727.236623] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 07d8236a-b9f2-429a-9942-e7cb46920213 with Priority: HIGHEST for action security_group_members [ 727.239138] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-07d8236a-b9f2-429a-9942-e7cb46920213 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.239138] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-07d8236a-b9f2-429a-9942-e7cb46920213" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.239138] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-07d8236a-b9f2-429a-9942-e7cb46920213" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.239489] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-07d8236a-b9f2-429a-9942-e7cb46920213" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.239745] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.240929] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.241096] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.241354] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.241528] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.241702] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('07d8236a-b9f2-429a-9942-e7cb46920213',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 727.316356] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 421c5db1-c16c-449c-a4d3-cc599e575ade [ 727.316356] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.316356] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.316356] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.316356] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.316356] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.316356] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:421c5db1-c16c-449c-a4d3-cc599e575ade already deleted. [ 727.316356] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-421c5db1-c16c-449c-a4d3-cc599e575ade" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.732354] env[69980]: INFO networking_nsxv3.common.synchronization [None req-010efcdb-804e-42b9-a9f9-d48a2db80f28 None None] Enqueued Resource ID: 29ef79d1-fae9-4e2e-998c-9172446d834e with Priority: HIGHEST for action port [ 727.732614] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 29ef79d1-fae9-4e2e-998c-9172446d834e with Priority: HIGHEST for action port [ 727.733515] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock port-29ef79d1-fae9-4e2e-998c-9172446d834e taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.733620] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-29ef79d1-fae9-4e2e-998c-9172446d834e" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.733661] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-29ef79d1-fae9-4e2e-998c-9172446d834e" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.733937] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-29ef79d1-fae9-4e2e-998c-9172446d834e" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.734016] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('29ef79d1-fae9-4e2e-998c-9172446d834e',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 727.748879] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.748879] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.748879] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.748879] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.748879] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.748879] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.748879] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.748879] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.748879] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.748879] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.748879] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 07d8236a-b9f2-429a-9942-e7cb46920213 already deleted. [ 727.748879] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-07d8236a-b9f2-429a-9942-e7cb46920213" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.158133] env[69980]: INFO networking_nsxv3.common.synchronization [req-42d54c6f-8e7b-472b-ad6d-6e06668fc11f req-f65c8a8d-f70e-485b-b33c-f4ecc319f2d9 service nova] Enqueued Resource ID: bf060907-afd6-4dc2-b6bb-9fd99f7f9dad with Priority: HIGHEST for action security_group_rules [ 728.158469] env[69980]: INFO networking_nsxv3.common.synchronization [req-42d54c6f-8e7b-472b-ad6d-6e06668fc11f req-f65c8a8d-f70e-485b-b33c-f4ecc319f2d9 service nova] Enqueued Resource ID: bf060907-afd6-4dc2-b6bb-9fd99f7f9dad with Priority: HIGHEST for action security_group_members [ 728.158469] env[69980]: INFO networking_nsxv3.common.synchronization [req-42d54c6f-8e7b-472b-ad6d-6e06668fc11f req-f65c8a8d-f70e-485b-b33c-f4ecc319f2d9 service nova] Enqueued Resource ID: b06acbcc-aaef-4692-991e-81739f0a65cc with Priority: HIGHEST for action port [ 728.158727] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bf060907-afd6-4dc2-b6bb-9fd99f7f9dad with Priority: HIGHEST for action security_group_rules [ 728.158857] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bf060907-afd6-4dc2-b6bb-9fd99f7f9dad with Priority: HIGHEST for action security_group_members [ 728.159017] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b06acbcc-aaef-4692-991e-81739f0a65cc with Priority: HIGHEST for action port [ 728.159554] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock rules-bf060907-afd6-4dc2-b6bb-9fd99f7f9dad taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.159713] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-bf060907-afd6-4dc2-b6bb-9fd99f7f9dad" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.159760] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-bf060907-afd6-4dc2-b6bb-9fd99f7f9dad" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.161070] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-bf060907-afd6-4dc2-b6bb-9fd99f7f9dad" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.161070] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('bf060907-afd6-4dc2-b6bb-9fd99f7f9dad',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 728.162186] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-bf060907-afd6-4dc2-b6bb-9fd99f7f9dad taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.162371] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bf060907-afd6-4dc2-b6bb-9fd99f7f9dad" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.162471] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bf060907-afd6-4dc2-b6bb-9fd99f7f9dad" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.162737] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bf060907-afd6-4dc2-b6bb-9fd99f7f9dad" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.162844] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.162976] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.163031] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.163147] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.163234] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.163324] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bf060907-afd6-4dc2-b6bb-9fd99f7f9dad',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 728.166760] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock port-b06acbcc-aaef-4692-991e-81739f0a65cc taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.167459] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b06acbcc-aaef-4692-991e-81739f0a65cc" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.167459] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b06acbcc-aaef-4692-991e-81739f0a65cc" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.168037] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b06acbcc-aaef-4692-991e-81739f0a65cc" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.168144] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b06acbcc-aaef-4692-991e-81739f0a65cc',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 728.237019] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 29ef79d1-fae9-4e2e-998c-9172446d834e [ 728.237337] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.238769] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.238769] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.238769] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.238769] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.238769] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:29ef79d1-fae9-4e2e-998c-9172446d834e already deleted. [ 728.238769] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-29ef79d1-fae9-4e2e-998c-9172446d834e" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.434217] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock network-557 taken with stack trace [, , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.436090] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "network-557" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.436090] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "network-557" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.436090] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "network-557" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.439133] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.439133] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.439133] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.439133] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.439133] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.439133] env[69980]: DEBUG dogpile.cache.region [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] No value present for key: 'zone-id' {{(pid=69980) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 728.439133] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] NeedRegenerationException {{(pid=69980) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 728.439133] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] no value, waiting for create lock {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 728.439133] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] value creation lock acquired {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 728.439133] env[69980]: DEBUG dogpile.cache.region [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] No value present for key: 'zone-id' {{(pid=69980) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 728.439133] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Calling creation function for not-yet-present value {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 728.439133] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 728.461418] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 728.461716] env[69980]: DEBUG dogpile.cache.region [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=69980) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 728.461891] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Released creation lock {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 728.462640] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "network-557" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.463039] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock port-15b30b02-62ca-4bde-a2e8-62978a63f9e4 taken with stack trace [, , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.463250] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "port-15b30b02-62ca-4bde-a2e8-62978a63f9e4" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.463612] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "port-15b30b02-62ca-4bde-a2e8-62978a63f9e4" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.464598] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "port-15b30b02-62ca-4bde-a2e8-62978a63f9e4" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.464763] env[69980]: DEBUG networking_nsxv3.api.rpc [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('15b30b02-62ca-4bde-a2e8-62978a63f9e4',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 728.670146] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-bf060907-afd6-4dc2-b6bb-9fd99f7f9dad taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.670306] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bf060907-afd6-4dc2-b6bb-9fd99f7f9dad" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.685893] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b06acbcc-aaef-4692-991e-81739f0a65cc with status ACTIVE [ 728.686276] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.686477] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.686578] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.686887] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.687032] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.687296] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.687472] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.687532] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.687765] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.687882] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.688165] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.688308] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.688407] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.688608] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.688721] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.688859] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b06acbcc-aaef-4692-991e-81739f0a65cc is going to be updated. [ 728.695887] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('bf060907-afd6-4dc2-b6bb-9fd99f7f9dad',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 728.715738] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.715738] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.715738] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.716168] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.716168] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.716168] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b06acbcc-aaef-4692-991e-81739f0a65cc" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.855403] env[69980]: INFO networking_nsxv3.common.synchronization [req-bb078d0e-e3d5-459f-835e-34f185b4c1ca req-ab89f5f2-d95d-4912-8f68-f4f38a8167d5 tempest-ListServerFiltersTestJSON-1624918227 tempest-ListServerFiltersTestJSON-1624918227-project-member] Enqueued Resource ID: 1340506f-247e-457d-b5d5-d9db4d9c0250 with Priority: HIGHEST for action security_group_members [ 728.855403] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1340506f-247e-457d-b5d5-d9db4d9c0250 with Priority: HIGHEST for action security_group_members [ 728.855403] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-1340506f-247e-457d-b5d5-d9db4d9c0250 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.855745] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1340506f-247e-457d-b5d5-d9db4d9c0250" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.855745] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1340506f-247e-457d-b5d5-d9db4d9c0250" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.856620] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1340506f-247e-457d-b5d5-d9db4d9c0250" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.856620] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.856620] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.856620] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.857366] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.857366] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.857498] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1340506f-247e-457d-b5d5-d9db4d9c0250',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 728.968093] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.968093] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.968093] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.968339] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.969072] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.969072] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Segment Port 15b30b02-62ca-4bde-a2e8-62978a63f9e4 not found, creating... [ 728.969428] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.969693] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.969976] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.970649] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.970649] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.971015] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.971323] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.971323] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.971943] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.971943] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.971943] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Resource: SegmentPort with ID: 15b30b02-62ca-4bde-a2e8-62978a63f9e4 is going to be created. [ 729.001482] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.001680] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.001888] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.002276] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.002529] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.002778] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "port-15b30b02-62ca-4bde-a2e8-62978a63f9e4" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.200439] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('bf060907-afd6-4dc2-b6bb-9fd99f7f9dad',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 729.362721] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.362897] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.362962] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.363191] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.363288] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.363493] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.363681] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.363681] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.363802] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.363881] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.363990] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1340506f-247e-457d-b5d5-d9db4d9c0250 already deleted. [ 729.364893] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1340506f-247e-457d-b5d5-d9db4d9c0250" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.455529] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock network-568 taken with stack trace [, , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.455848] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "network-568" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.455848] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "network-568" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.456193] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "network-568" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.456444] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.456608] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.456915] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.456978] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.457494] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.457773] env[69980]: DEBUG dogpile.cache.region [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] No value present for key: 'zone-id' {{(pid=69980) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 729.457928] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] NeedRegenerationException {{(pid=69980) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 729.458145] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] no value, waiting for create lock {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 729.458228] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] value creation lock acquired {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 729.458342] env[69980]: DEBUG dogpile.cache.region [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] No value present for key: 'zone-id' {{(pid=69980) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 729.458463] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Calling creation function for not-yet-present value {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 729.458628] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 729.479994] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 729.479994] env[69980]: DEBUG dogpile.cache.region [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=69980) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 729.479994] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Released creation lock {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 729.479994] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "network-568" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.479994] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock port-8120e26f-db11-47f9-9af8-9b50e9e32e72 taken with stack trace [, , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.479994] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "port-8120e26f-db11-47f9-9af8-9b50e9e32e72" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.479994] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "port-8120e26f-db11-47f9-9af8-9b50e9e32e72" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.479994] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "port-8120e26f-db11-47f9-9af8-9b50e9e32e72" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.479994] env[69980]: DEBUG networking_nsxv3.api.rpc [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8120e26f-db11-47f9-9af8-9b50e9e32e72',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 729.704186] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.704384] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.704433] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.704624] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.704713] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.704813] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bf060907-afd6-4dc2-b6bb-9fd99f7f9dad is going to be created. [ 729.784664] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.784664] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.784664] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.784664] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.784664] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.796470] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bf060907-afd6-4dc2-b6bb-9fd99f7f9dad in Status: UNINITIALIZED for 2s [ 729.826435] env[69980]: INFO networking_nsxv3.common.synchronization [None req-a077e45a-6bf7-4c16-af1c-5da1de074dbb tempest-ServersTestManualDisk-1921842284 tempest-ServersTestManualDisk-1921842284-project-member] Enqueued Resource ID: b472d7ce-a3a7-4859-8fa3-f222ee058e66 with Priority: HIGHEST for action security_group_rules [ 729.826435] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b472d7ce-a3a7-4859-8fa3-f222ee058e66 with Priority: HIGHEST for action security_group_rules [ 729.826955] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b472d7ce-a3a7-4859-8fa3-f222ee058e66 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.827297] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b472d7ce-a3a7-4859-8fa3-f222ee058e66" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.827685] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b472d7ce-a3a7-4859-8fa3-f222ee058e66" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.828261] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b472d7ce-a3a7-4859-8fa3-f222ee058e66" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.828439] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b472d7ce-a3a7-4859-8fa3-f222ee058e66',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 729.982611] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.983403] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.983475] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.984316] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.984316] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.984316] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Segment Port 8120e26f-db11-47f9-9af8-9b50e9e32e72 not found, creating... [ 729.984450] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.985955] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.985955] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.985955] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.985955] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.985955] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.985955] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.985955] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.986207] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.986439] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.986439] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Resource: SegmentPort with ID: 8120e26f-db11-47f9-9af8-9b50e9e32e72 is going to be created. [ 729.989584] env[69980]: INFO networking_nsxv3.common.synchronization [None req-0c7ffaba-6c5a-42fa-9bd4-9ce492d1eff4 None None] Enqueued Resource ID: 915d1523-f41c-47b2-b0d9-47c7bda3fb8b with Priority: HIGHEST for action port [ 729.990619] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 915d1523-f41c-47b2-b0d9-47c7bda3fb8b with Priority: HIGHEST for action port [ 729.994263] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock port-915d1523-f41c-47b2-b0d9-47c7bda3fb8b taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.994446] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-915d1523-f41c-47b2-b0d9-47c7bda3fb8b" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.994545] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-915d1523-f41c-47b2-b0d9-47c7bda3fb8b" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.994819] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-915d1523-f41c-47b2-b0d9-47c7bda3fb8b" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.994899] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('915d1523-f41c-47b2-b0d9-47c7bda3fb8b',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 730.008230] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.008448] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.008569] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.008840] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.009097] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.009334] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "port-8120e26f-db11-47f9-9af8-9b50e9e32e72" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.020889] env[69980]: INFO networking_nsxv3.common.synchronization [None req-2affaeac-9306-40eb-8d83-fa2db83e1155 tempest-ServersTestManualDisk-1921842284 tempest-ServersTestManualDisk-1921842284-project-member] Enqueued Resource ID: b472d7ce-a3a7-4859-8fa3-f222ee058e66 with Priority: HIGHEST for action security_group_rules [ 730.021994] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b472d7ce-a3a7-4859-8fa3-f222ee058e66 with Priority: HIGHEST for action security_group_rules [ 730.022451] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b472d7ce-a3a7-4859-8fa3-f222ee058e66 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.022585] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b472d7ce-a3a7-4859-8fa3-f222ee058e66" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.352074] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.352074] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.352074] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.352074] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.352074] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.352074] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b472d7ce-a3a7-4859-8fa3-f222ee058e66 already deleted. [ 730.352074] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b472d7ce-a3a7-4859-8fa3-f222ee058e66" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.352074] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b472d7ce-a3a7-4859-8fa3-f222ee058e66" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.352611] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b472d7ce-a3a7-4859-8fa3-f222ee058e66" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.352611] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b472d7ce-a3a7-4859-8fa3-f222ee058e66',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 730.498313] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 915d1523-f41c-47b2-b0d9-47c7bda3fb8b [ 730.498609] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.498753] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.498818] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.499044] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.499142] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.499242] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:915d1523-f41c-47b2-b0d9-47c7bda3fb8b already deleted. [ 730.499321] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-915d1523-f41c-47b2-b0d9-47c7bda3fb8b" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.753570] env[69980]: INFO networking_nsxv3.common.synchronization [req-3401e883-628a-4227-8c84-6bc8d66e03ad req-0499df21-b023-49fa-b96c-89bb888b1345 service nova] Enqueued Resource ID: 07d8236a-b9f2-429a-9942-e7cb46920213 with Priority: HIGHEST for action security_group_rules [ 730.753570] env[69980]: INFO networking_nsxv3.common.synchronization [req-3401e883-628a-4227-8c84-6bc8d66e03ad req-0499df21-b023-49fa-b96c-89bb888b1345 service nova] Enqueued Resource ID: 07d8236a-b9f2-429a-9942-e7cb46920213 with Priority: HIGHEST for action security_group_members [ 730.753570] env[69980]: INFO networking_nsxv3.common.synchronization [req-3401e883-628a-4227-8c84-6bc8d66e03ad req-0499df21-b023-49fa-b96c-89bb888b1345 service nova] Enqueued Resource ID: 15b30b02-62ca-4bde-a2e8-62978a63f9e4 with Priority: HIGHEST for action port [ 730.753570] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 07d8236a-b9f2-429a-9942-e7cb46920213 with Priority: HIGHEST for action security_group_rules [ 730.753570] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 07d8236a-b9f2-429a-9942-e7cb46920213 with Priority: HIGHEST for action security_group_members [ 730.753570] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 15b30b02-62ca-4bde-a2e8-62978a63f9e4 with Priority: HIGHEST for action port [ 730.753936] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock rules-07d8236a-b9f2-429a-9942-e7cb46920213 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.754220] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-07d8236a-b9f2-429a-9942-e7cb46920213" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.754379] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-07d8236a-b9f2-429a-9942-e7cb46920213" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.754706] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-07d8236a-b9f2-429a-9942-e7cb46920213" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.754896] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('07d8236a-b9f2-429a-9942-e7cb46920213',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 730.755876] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-07d8236a-b9f2-429a-9942-e7cb46920213 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.756172] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-07d8236a-b9f2-429a-9942-e7cb46920213" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.756395] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-07d8236a-b9f2-429a-9942-e7cb46920213" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.756675] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-07d8236a-b9f2-429a-9942-e7cb46920213" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.756936] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.757164] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.757317] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.757552] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.757746] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.757924] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('07d8236a-b9f2-429a-9942-e7cb46920213',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 730.759128] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock port-15b30b02-62ca-4bde-a2e8-62978a63f9e4 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.759353] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-15b30b02-62ca-4bde-a2e8-62978a63f9e4" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.759521] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-15b30b02-62ca-4bde-a2e8-62978a63f9e4" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.759767] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-15b30b02-62ca-4bde-a2e8-62978a63f9e4" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.759944] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('15b30b02-62ca-4bde-a2e8-62978a63f9e4',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 730.875670] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.875909] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.876022] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.876271] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.876413] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.876848] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b472d7ce-a3a7-4859-8fa3-f222ee058e66 already deleted. [ 730.876848] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b472d7ce-a3a7-4859-8fa3-f222ee058e66" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.261529] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('07d8236a-b9f2-429a-9942-e7cb46920213',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 731.262688] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-07d8236a-b9f2-429a-9942-e7cb46920213 taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.262825] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-07d8236a-b9f2-429a-9942-e7cb46920213" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.262969] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 15b30b02-62ca-4bde-a2e8-62978a63f9e4 with status ACTIVE [ 731.263143] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.263248] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.263309] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.263499] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.263582] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.265073] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.265211] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.265276] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.267330] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.267422] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.267633] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.267731] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.267795] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.267943] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.268035] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.268121] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 15b30b02-62ca-4bde-a2e8-62978a63f9e4 is going to be updated. [ 731.298180] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.298180] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.298180] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.298180] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.298180] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.298180] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-15b30b02-62ca-4bde-a2e8-62978a63f9e4" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.443516] env[69980]: INFO networking_nsxv3.common.synchronization [req-bb078d0e-e3d5-459f-835e-34f185b4c1ca req-b3e34019-689c-47fc-af1e-bb9eec845a11 service nova] Enqueued Resource ID: 1340506f-247e-457d-b5d5-d9db4d9c0250 with Priority: HIGHEST for action security_group_rules [ 731.443870] env[69980]: INFO networking_nsxv3.common.synchronization [req-bb078d0e-e3d5-459f-835e-34f185b4c1ca req-b3e34019-689c-47fc-af1e-bb9eec845a11 service nova] Enqueued Resource ID: 1340506f-247e-457d-b5d5-d9db4d9c0250 with Priority: HIGHEST for action security_group_members [ 731.445404] env[69980]: INFO networking_nsxv3.common.synchronization [req-bb078d0e-e3d5-459f-835e-34f185b4c1ca req-b3e34019-689c-47fc-af1e-bb9eec845a11 service nova] Enqueued Resource ID: 8120e26f-db11-47f9-9af8-9b50e9e32e72 with Priority: HIGHEST for action port [ 731.446340] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1340506f-247e-457d-b5d5-d9db4d9c0250 with Priority: HIGHEST for action security_group_rules [ 731.446476] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1340506f-247e-457d-b5d5-d9db4d9c0250 with Priority: HIGHEST for action security_group_members [ 731.446569] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8120e26f-db11-47f9-9af8-9b50e9e32e72 with Priority: HIGHEST for action port [ 731.446838] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1340506f-247e-457d-b5d5-d9db4d9c0250 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.446992] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1340506f-247e-457d-b5d5-d9db4d9c0250" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.447051] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1340506f-247e-457d-b5d5-d9db4d9c0250" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.447281] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1340506f-247e-457d-b5d5-d9db4d9c0250" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.447361] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1340506f-247e-457d-b5d5-d9db4d9c0250',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 731.448234] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-1340506f-247e-457d-b5d5-d9db4d9c0250 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.448345] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1340506f-247e-457d-b5d5-d9db4d9c0250" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.448410] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1340506f-247e-457d-b5d5-d9db4d9c0250" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.448570] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1340506f-247e-457d-b5d5-d9db4d9c0250" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.448712] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.448801] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.448859] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.448992] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.449083] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.449167] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1340506f-247e-457d-b5d5-d9db4d9c0250',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 731.449929] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock port-8120e26f-db11-47f9-9af8-9b50e9e32e72 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.450046] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8120e26f-db11-47f9-9af8-9b50e9e32e72" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.450118] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8120e26f-db11-47f9-9af8-9b50e9e32e72" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.450275] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8120e26f-db11-47f9-9af8-9b50e9e32e72" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.450341] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8120e26f-db11-47f9-9af8-9b50e9e32e72',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 731.576432] env[69980]: INFO networking_nsxv3.common.synchronization [None req-f5c00461-0fac-450d-83b5-a9f9a408a97e tempest-VolumesAssistedSnapshotsTest-973741720 tempest-VolumesAssistedSnapshotsTest-973741720-project-member] Enqueued Resource ID: 701c8f75-0059-44a8-ab17-fcd4ee6f9c0e with Priority: HIGHEST for action security_group_rules [ 731.576937] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 701c8f75-0059-44a8-ab17-fcd4ee6f9c0e with Priority: HIGHEST for action security_group_rules [ 731.577483] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock rules-701c8f75-0059-44a8-ab17-fcd4ee6f9c0e taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.577600] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-701c8f75-0059-44a8-ab17-fcd4ee6f9c0e" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.578207] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-701c8f75-0059-44a8-ab17-fcd4ee6f9c0e" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.578499] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-701c8f75-0059-44a8-ab17-fcd4ee6f9c0e" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.578587] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('701c8f75-0059-44a8-ab17-fcd4ee6f9c0e',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 731.769048] env[69980]: INFO networking_nsxv3.common.synchronization [None req-2ea9b873-0a25-42a1-ac3d-5f5d2b99f55b tempest-VolumesAssistedSnapshotsTest-973741720 tempest-VolumesAssistedSnapshotsTest-973741720-project-member] Enqueued Resource ID: 701c8f75-0059-44a8-ab17-fcd4ee6f9c0e with Priority: HIGHEST for action security_group_rules [ 731.772040] env[69980]: INFO networking_nsxv3.common.synchronization [req-fe405169-3cfb-4c6d-b918-bddef21bfc90 req-fe9a2e04-30af-4484-b81e-2edc9e1cac1a tempest-FloatingIPsAssociationTestJSON-592488877 tempest-FloatingIPsAssociationTestJSON-592488877-project-member] Enqueued Resource ID: 186800b9-4416-4ee9-97e6-a0aa4cad729b with Priority: HIGHEST for action security_group_members [ 731.772226] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 701c8f75-0059-44a8-ab17-fcd4ee6f9c0e with Priority: HIGHEST for action security_group_rules [ 731.772525] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 186800b9-4416-4ee9-97e6-a0aa4cad729b with Priority: HIGHEST for action security_group_members [ 731.773071] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('07d8236a-b9f2-429a-9942-e7cb46920213',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 731.775365] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock rules-701c8f75-0059-44a8-ab17-fcd4ee6f9c0e taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.776627] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-701c8f75-0059-44a8-ab17-fcd4ee6f9c0e" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.776627] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-186800b9-4416-4ee9-97e6-a0aa4cad729b taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.776627] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-186800b9-4416-4ee9-97e6-a0aa4cad729b" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.776627] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-186800b9-4416-4ee9-97e6-a0aa4cad729b" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.776627] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-186800b9-4416-4ee9-97e6-a0aa4cad729b" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.778179] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.779891] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.779891] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.779891] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.779891] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.779891] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('186800b9-4416-4ee9-97e6-a0aa4cad729b',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 731.807808] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bf060907-afd6-4dc2-b6bb-9fd99f7f9dad in Status: SUCCESS [ 731.807808] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bf060907-afd6-4dc2-b6bb-9fd99f7f9dad" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.807808] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bf060907-afd6-4dc2-b6bb-9fd99f7f9dad" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.807937] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bf060907-afd6-4dc2-b6bb-9fd99f7f9dad" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.808085] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.808200] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.808269] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.808427] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.808509] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.808596] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bf060907-afd6-4dc2-b6bb-9fd99f7f9dad" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.808687] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('bf060907-afd6-4dc2-b6bb-9fd99f7f9dad',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 731.952014] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1340506f-247e-457d-b5d5-d9db4d9c0250',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 731.953343] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-1340506f-247e-457d-b5d5-d9db4d9c0250 taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.953343] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1340506f-247e-457d-b5d5-d9db4d9c0250" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.953343] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 8120e26f-db11-47f9-9af8-9b50e9e32e72 with status ACTIVE [ 731.953602] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.953602] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.953602] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.953878] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.953878] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.954012] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.954141] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.954202] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.954447] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.954447] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.954564] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.954645] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.954695] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.954835] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.954904] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.955125] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 8120e26f-db11-47f9-9af8-9b50e9e32e72 is going to be updated. [ 731.977627] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.977772] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.978415] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.978415] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.978415] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.978415] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8120e26f-db11-47f9-9af8-9b50e9e32e72" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.111443] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.111443] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.111443] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.111624] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.111671] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.111837] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 701c8f75-0059-44a8-ab17-fcd4ee6f9c0e already deleted. [ 732.111837] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-701c8f75-0059-44a8-ab17-fcd4ee6f9c0e" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.112050] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-701c8f75-0059-44a8-ab17-fcd4ee6f9c0e" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.112146] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-701c8f75-0059-44a8-ab17-fcd4ee6f9c0e" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.112272] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('701c8f75-0059-44a8-ab17-fcd4ee6f9c0e',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 732.118629] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock network-747 taken with stack trace [, , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.118773] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "network-747" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.118963] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "network-747" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.119559] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "network-747" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.119559] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.119658] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.119796] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.119944] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.122281] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.122281] env[69980]: DEBUG dogpile.cache.region [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] No value present for key: 'zone-id' {{(pid=69980) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 732.122281] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] NeedRegenerationException {{(pid=69980) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 732.122281] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] no value, waiting for create lock {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 732.122281] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] value creation lock acquired {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 732.122281] env[69980]: DEBUG dogpile.cache.region [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] No value present for key: 'zone-id' {{(pid=69980) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 732.122281] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Calling creation function for not-yet-present value {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 732.122281] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 732.144097] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 732.144297] env[69980]: DEBUG dogpile.cache.region [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=69980) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 732.144532] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Released creation lock {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 732.144604] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "network-747" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.144994] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock port-781a8d35-65b6-42cf-bdab-5f653e43678e taken with stack trace [, , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.145268] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "port-781a8d35-65b6-42cf-bdab-5f653e43678e" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.145268] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "port-781a8d35-65b6-42cf-bdab-5f653e43678e" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.145641] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "port-781a8d35-65b6-42cf-bdab-5f653e43678e" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.145784] env[69980]: DEBUG networking_nsxv3.api.rpc [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('781a8d35-65b6-42cf-bdab-5f653e43678e',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 732.252711] env[69980]: INFO networking_nsxv3.common.synchronization [None req-bafb4eed-c11e-4c5a-ba8b-ea1dbc7739ca tempest-ServersWithSpecificFlavorTestJSON-977701913 tempest-ServersWithSpecificFlavorTestJSON-977701913-project-member] Enqueued Resource ID: 3b94a139-70f4-4b1b-82e2-803c78f509bf with Priority: HIGHEST for action security_group_rules [ 732.254823] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3b94a139-70f4-4b1b-82e2-803c78f509bf with Priority: HIGHEST for action security_group_rules [ 732.254823] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3b94a139-70f4-4b1b-82e2-803c78f509bf taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.254823] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3b94a139-70f4-4b1b-82e2-803c78f509bf" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.254823] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3b94a139-70f4-4b1b-82e2-803c78f509bf" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.255190] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3b94a139-70f4-4b1b-82e2-803c78f509bf" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.255190] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3b94a139-70f4-4b1b-82e2-803c78f509bf',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 732.276290] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.276454] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.276522] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.276786] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.276875] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.276978] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 07d8236a-b9f2-429a-9942-e7cb46920213 is going to be created. [ 732.286037] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.286262] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.286335] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.286553] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.286676] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.286907] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.287167] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.287167] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.287319] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.287421] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.287510] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 186800b9-4416-4ee9-97e6-a0aa4cad729b already deleted. [ 732.287604] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-186800b9-4416-4ee9-97e6-a0aa4cad729b" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.298367] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.299997] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.299997] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.299997] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.299997] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.311319] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-bf060907-afd6-4dc2-b6bb-9fd99f7f9dad taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.311492] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bf060907-afd6-4dc2-b6bb-9fd99f7f9dad" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.311557] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bf060907-afd6-4dc2-b6bb-9fd99f7f9dad" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.311777] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bf060907-afd6-4dc2-b6bb-9fd99f7f9dad" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.311947] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.313029] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.313029] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.313029] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.313029] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.313029] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bf060907-afd6-4dc2-b6bb-9fd99f7f9dad" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.313029] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-bf060907-afd6-4dc2-b6bb-9fd99f7f9dad taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.313029] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bf060907-afd6-4dc2-b6bb-9fd99f7f9dad" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.313029] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bf060907-afd6-4dc2-b6bb-9fd99f7f9dad" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.313029] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bf060907-afd6-4dc2-b6bb-9fd99f7f9dad" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.313420] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.313420] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.313420] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.313420] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.313539] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.313698] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bf060907-afd6-4dc2-b6bb-9fd99f7f9dad" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.313698] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('bf060907-afd6-4dc2-b6bb-9fd99f7f9dad',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 732.316066] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 07d8236a-b9f2-429a-9942-e7cb46920213 in Status: UNINITIALIZED for 2s [ 732.459693] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1340506f-247e-457d-b5d5-d9db4d9c0250',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 732.632639] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.635089] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.635089] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.635089] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.635089] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.635089] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 701c8f75-0059-44a8-ab17-fcd4ee6f9c0e already deleted. [ 732.635089] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-701c8f75-0059-44a8-ab17-fcd4ee6f9c0e" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.653739] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.653950] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.654085] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.654362] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.654531] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.654683] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Segment Port 781a8d35-65b6-42cf-bdab-5f653e43678e not found, creating... [ 732.654946] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.657417] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.657704] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.657996] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.658166] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.658744] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.658744] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.658964] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.659032] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.659170] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.659340] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Resource: SegmentPort with ID: 781a8d35-65b6-42cf-bdab-5f653e43678e is going to be created. [ 732.680916] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.680916] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.681379] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.681639] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.681863] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.682512] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "port-781a8d35-65b6-42cf-bdab-5f653e43678e" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.696969] env[69980]: INFO networking_nsxv3.common.synchronization [None req-f3f458f1-0a75-456f-bc7d-e2ce71b8f67a None None] Enqueued Resource ID: e3a85ee9-4d53-463d-bb5c-68f9a276daee with Priority: HIGHEST for action port [ 732.697260] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e3a85ee9-4d53-463d-bb5c-68f9a276daee with Priority: HIGHEST for action port [ 732.698797] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock port-e3a85ee9-4d53-463d-bb5c-68f9a276daee taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.698932] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e3a85ee9-4d53-463d-bb5c-68f9a276daee" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.698999] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e3a85ee9-4d53-463d-bb5c-68f9a276daee" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.699535] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e3a85ee9-4d53-463d-bb5c-68f9a276daee" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.699614] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e3a85ee9-4d53-463d-bb5c-68f9a276daee',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 732.786551] env[69980]: INFO networking_nsxv3.common.synchronization [None req-a7fefcdc-e969-4983-b786-15dc976243ea None None] Enqueued Resource ID: dec54da3-bbaa-40a2-b9c8-ff126341bc17 with Priority: HIGHEST for action port [ 732.786601] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dec54da3-bbaa-40a2-b9c8-ff126341bc17 with Priority: HIGHEST for action port [ 732.787162] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock port-dec54da3-bbaa-40a2-b9c8-ff126341bc17 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.787290] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-dec54da3-bbaa-40a2-b9c8-ff126341bc17" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.787364] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-dec54da3-bbaa-40a2-b9c8-ff126341bc17" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.787601] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-dec54da3-bbaa-40a2-b9c8-ff126341bc17" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.787683] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('dec54da3-bbaa-40a2-b9c8-ff126341bc17',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 732.790934] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.791061] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.791134] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.791314] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.791407] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.791496] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3b94a139-70f4-4b1b-82e2-803c78f509bf already deleted. [ 732.791578] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3b94a139-70f4-4b1b-82e2-803c78f509bf" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.819853] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for bf060907-afd6-4dc2-b6bb-9fd99f7f9dad: rpc.has_security_group_logging(os_id): False [ 732.824329] env[69980]: INFO networking_nsxv3.common.synchronization [None req-6b082a90-59dc-4378-98f8-73315fc45169 tempest-ServersWithSpecificFlavorTestJSON-977701913 tempest-ServersWithSpecificFlavorTestJSON-977701913-project-member] Enqueued Resource ID: 3b94a139-70f4-4b1b-82e2-803c78f509bf with Priority: HIGHEST for action security_group_rules [ 732.825122] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3b94a139-70f4-4b1b-82e2-803c78f509bf with Priority: HIGHEST for action security_group_rules [ 732.826490] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3b94a139-70f4-4b1b-82e2-803c78f509bf taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.826490] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3b94a139-70f4-4b1b-82e2-803c78f509bf" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.826682] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3b94a139-70f4-4b1b-82e2-803c78f509bf" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.826827] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3b94a139-70f4-4b1b-82e2-803c78f509bf" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.826924] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3b94a139-70f4-4b1b-82e2-803c78f509bf',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 732.848245] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.848416] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.848450] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.848650] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.848733] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.848923] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.849026] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.849107] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.849317] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.849397] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.849602] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.849695] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.849753] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.849895] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.849967] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.854385] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.855175] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.855175] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.855175] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.855175] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.855175] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bf060907-afd6-4dc2-b6bb-9fd99f7f9dad is going to be created. [ 732.950377] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.950503] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.950557] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.953023] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.953023] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.971713] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bf060907-afd6-4dc2-b6bb-9fd99f7f9dad in Status: IN_PROGRESS for 2s [ 732.971713] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.971713] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.971713] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.971713] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.971713] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.971713] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1340506f-247e-457d-b5d5-d9db4d9c0250 is going to be created. [ 732.991827] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.991827] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.991827] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.991827] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.991827] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.999098] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1340506f-247e-457d-b5d5-d9db4d9c0250 in Status: UNINITIALIZED for 2s [ 733.160852] env[69980]: INFO networking_nsxv3.common.synchronization [None req-3b0b518c-9156-4ac7-8472-c1f88aae84cd None None] Enqueued Resource ID: b5ae32a7-c009-4017-942e-17b28e8e8ac2 with Priority: HIGHEST for action port [ 733.162940] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b5ae32a7-c009-4017-942e-17b28e8e8ac2 with Priority: HIGHEST for action port [ 733.163096] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock port-b5ae32a7-c009-4017-942e-17b28e8e8ac2 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.163181] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b5ae32a7-c009-4017-942e-17b28e8e8ac2" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.163366] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b5ae32a7-c009-4017-942e-17b28e8e8ac2" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.163569] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b5ae32a7-c009-4017-942e-17b28e8e8ac2" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.163658] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b5ae32a7-c009-4017-942e-17b28e8e8ac2',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 733.201979] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port e3a85ee9-4d53-463d-bb5c-68f9a276daee [ 733.201979] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.201979] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.201979] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.201979] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.202269] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.202269] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:e3a85ee9-4d53-463d-bb5c-68f9a276daee already deleted. [ 733.202269] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e3a85ee9-4d53-463d-bb5c-68f9a276daee" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.299252] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port dec54da3-bbaa-40a2-b9c8-ff126341bc17 [ 733.299252] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.299252] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.299252] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.299252] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.299252] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.299252] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:dec54da3-bbaa-40a2-b9c8-ff126341bc17 already deleted. [ 733.299252] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-dec54da3-bbaa-40a2-b9c8-ff126341bc17" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.363733] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.367269] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.368912] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.371464] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.371464] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.371464] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3b94a139-70f4-4b1b-82e2-803c78f509bf already deleted. [ 733.371464] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3b94a139-70f4-4b1b-82e2-803c78f509bf" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.670040] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b5ae32a7-c009-4017-942e-17b28e8e8ac2 [ 733.670040] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.670040] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.670040] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.670040] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.670040] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.670040] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b5ae32a7-c009-4017-942e-17b28e8e8ac2 already deleted. [ 733.670040] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b5ae32a7-c009-4017-942e-17b28e8e8ac2" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.763984] env[69980]: INFO networking_nsxv3.common.synchronization [req-d45b1c1f-5062-44ee-8493-913eedeabfeb req-7843a6f9-e01f-4d61-b7c7-9007c3c93fed tempest-ImagesTestJSON-600722714 tempest-ImagesTestJSON-600722714-project-member] Enqueued Resource ID: 80e3ea48-91a5-4863-b1c2-f3e887204e39 with Priority: HIGHEST for action security_group_members [ 733.763984] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 80e3ea48-91a5-4863-b1c2-f3e887204e39 with Priority: HIGHEST for action security_group_members [ 733.764623] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-80e3ea48-91a5-4863-b1c2-f3e887204e39 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.764623] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-80e3ea48-91a5-4863-b1c2-f3e887204e39" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.764623] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-80e3ea48-91a5-4863-b1c2-f3e887204e39" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.764830] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-80e3ea48-91a5-4863-b1c2-f3e887204e39" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.765210] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.767947] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.768021] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.769075] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.769075] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.769075] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('80e3ea48-91a5-4863-b1c2-f3e887204e39',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 733.989138] env[69980]: INFO networking_nsxv3.common.synchronization [req-fe405169-3cfb-4c6d-b918-bddef21bfc90 req-b9e9427f-f492-4081-b930-d2fc88f665d0 service nova] Enqueued Resource ID: 186800b9-4416-4ee9-97e6-a0aa4cad729b with Priority: HIGHEST for action security_group_rules [ 733.989326] env[69980]: INFO networking_nsxv3.common.synchronization [req-fe405169-3cfb-4c6d-b918-bddef21bfc90 req-b9e9427f-f492-4081-b930-d2fc88f665d0 service nova] Enqueued Resource ID: 186800b9-4416-4ee9-97e6-a0aa4cad729b with Priority: HIGHEST for action security_group_members [ 733.989464] env[69980]: INFO networking_nsxv3.common.synchronization [req-fe405169-3cfb-4c6d-b918-bddef21bfc90 req-b9e9427f-f492-4081-b930-d2fc88f665d0 service nova] Enqueued Resource ID: 781a8d35-65b6-42cf-bdab-5f653e43678e with Priority: HIGHEST for action port [ 733.989706] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 186800b9-4416-4ee9-97e6-a0aa4cad729b with Priority: HIGHEST for action security_group_rules [ 733.989830] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 186800b9-4416-4ee9-97e6-a0aa4cad729b with Priority: HIGHEST for action security_group_members [ 733.989924] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 781a8d35-65b6-42cf-bdab-5f653e43678e with Priority: HIGHEST for action port [ 733.990497] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock rules-186800b9-4416-4ee9-97e6-a0aa4cad729b taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.997024] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-186800b9-4416-4ee9-97e6-a0aa4cad729b" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.997024] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-186800b9-4416-4ee9-97e6-a0aa4cad729b" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.997024] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-186800b9-4416-4ee9-97e6-a0aa4cad729b" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.997024] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('186800b9-4416-4ee9-97e6-a0aa4cad729b',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 733.997024] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-186800b9-4416-4ee9-97e6-a0aa4cad729b taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.997024] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-186800b9-4416-4ee9-97e6-a0aa4cad729b" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.997024] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-186800b9-4416-4ee9-97e6-a0aa4cad729b" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.997696] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-186800b9-4416-4ee9-97e6-a0aa4cad729b" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.997696] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.001062] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.001187] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.001390] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.001489] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.001595] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('186800b9-4416-4ee9-97e6-a0aa4cad729b',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 734.002653] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock port-781a8d35-65b6-42cf-bdab-5f653e43678e taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.002775] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-781a8d35-65b6-42cf-bdab-5f653e43678e" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.002843] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-781a8d35-65b6-42cf-bdab-5f653e43678e" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.003020] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-781a8d35-65b6-42cf-bdab-5f653e43678e" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.003104] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('781a8d35-65b6-42cf-bdab-5f653e43678e',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 734.274147] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.274312] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.274980] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.274980] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.274980] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.274980] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.274980] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.275275] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.275275] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.275275] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.275413] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 80e3ea48-91a5-4863-b1c2-f3e887204e39 already deleted. [ 734.275413] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-80e3ea48-91a5-4863-b1c2-f3e887204e39" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.329202] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 07d8236a-b9f2-429a-9942-e7cb46920213 in Status: SUCCESS [ 734.329494] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-07d8236a-b9f2-429a-9942-e7cb46920213" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.329697] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-07d8236a-b9f2-429a-9942-e7cb46920213" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.330328] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-07d8236a-b9f2-429a-9942-e7cb46920213" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.330896] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.331049] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.331133] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.331312] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.331395] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.331484] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-07d8236a-b9f2-429a-9942-e7cb46920213" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.331576] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('07d8236a-b9f2-429a-9942-e7cb46920213',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 734.506656] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('186800b9-4416-4ee9-97e6-a0aa4cad729b',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 734.507325] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-186800b9-4416-4ee9-97e6-a0aa4cad729b taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.507763] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-186800b9-4416-4ee9-97e6-a0aa4cad729b" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.510511] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 781a8d35-65b6-42cf-bdab-5f653e43678e with status ACTIVE [ 734.510511] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.510511] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.510511] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.510511] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.510511] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.510511] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.511959] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.511959] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.511959] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.511959] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.513167] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.513167] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.513167] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.513167] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.513167] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.513167] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 781a8d35-65b6-42cf-bdab-5f653e43678e is going to be updated. [ 734.533954] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.533954] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.533954] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.534287] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.534376] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.534725] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-781a8d35-65b6-42cf-bdab-5f653e43678e" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.539467] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock network-136 taken with stack trace [, , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.539611] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "network-136" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.540060] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "network-136" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.540060] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "network-136" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.540275] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.540433] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.540606] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.542501] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.542501] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.545915] env[69980]: DEBUG dogpile.cache.region [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] No value present for key: 'zone-id' {{(pid=69980) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 734.545915] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] NeedRegenerationException {{(pid=69980) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 734.545915] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] no value, waiting for create lock {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 734.545915] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] value creation lock acquired {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 734.545915] env[69980]: DEBUG dogpile.cache.region [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] No value present for key: 'zone-id' {{(pid=69980) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 734.545915] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Calling creation function for not-yet-present value {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 734.545915] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 734.562064] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 734.562263] env[69980]: DEBUG dogpile.cache.region [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=69980) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 734.562444] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Released creation lock {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 734.562634] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "network-136" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.564637] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock port-92c67b91-1a1f-48d6-a604-932c1e357651 taken with stack trace [, , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.564885] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "port-92c67b91-1a1f-48d6-a604-932c1e357651" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.565012] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "port-92c67b91-1a1f-48d6-a604-932c1e357651" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.565417] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "port-92c67b91-1a1f-48d6-a604-932c1e357651" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.565615] env[69980]: DEBUG networking_nsxv3.api.rpc [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('92c67b91-1a1f-48d6-a604-932c1e357651',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 734.841208] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-07d8236a-b9f2-429a-9942-e7cb46920213 taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.841208] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-07d8236a-b9f2-429a-9942-e7cb46920213" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.841208] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-07d8236a-b9f2-429a-9942-e7cb46920213" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.841208] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-07d8236a-b9f2-429a-9942-e7cb46920213" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.841208] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.841208] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.841208] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.841208] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.841208] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.841208] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-07d8236a-b9f2-429a-9942-e7cb46920213" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.841208] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-07d8236a-b9f2-429a-9942-e7cb46920213 taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.841208] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-07d8236a-b9f2-429a-9942-e7cb46920213" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.841208] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-07d8236a-b9f2-429a-9942-e7cb46920213" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.841208] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-07d8236a-b9f2-429a-9942-e7cb46920213" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.841208] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.841208] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.842250] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.842250] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.842250] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.842250] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-07d8236a-b9f2-429a-9942-e7cb46920213" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.842250] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('07d8236a-b9f2-429a-9942-e7cb46920213',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 734.980616] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bf060907-afd6-4dc2-b6bb-9fd99f7f9dad in Status: SUCCESS [ 734.980616] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-bf060907-afd6-4dc2-b6bb-9fd99f7f9dad" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.010805] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1340506f-247e-457d-b5d5-d9db4d9c0250 in Status: SUCCESS [ 735.013361] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1340506f-247e-457d-b5d5-d9db4d9c0250" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.013361] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('186800b9-4416-4ee9-97e6-a0aa4cad729b',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 735.013361] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1340506f-247e-457d-b5d5-d9db4d9c0250" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.013361] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1340506f-247e-457d-b5d5-d9db4d9c0250" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.013361] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.021228] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.021228] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.021228] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.021828] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.021828] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1340506f-247e-457d-b5d5-d9db4d9c0250" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.021828] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1340506f-247e-457d-b5d5-d9db4d9c0250',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 735.071031] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.072999] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.073443] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.073881] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.074179] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.074451] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Segment Port 92c67b91-1a1f-48d6-a604-932c1e357651 not found, creating... [ 735.074984] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.075320] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.076466] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.076873] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.077181] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.077765] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.078141] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.083233] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.083233] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.083233] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.083233] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Resource: SegmentPort with ID: 92c67b91-1a1f-48d6-a604-932c1e357651 is going to be created. [ 735.116500] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.117034] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.117329] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.118404] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.119131] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.121178] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "port-92c67b91-1a1f-48d6-a604-932c1e357651" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.346536] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 07d8236a-b9f2-429a-9942-e7cb46920213: rpc.has_security_group_logging(os_id): False [ 735.364169] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.364169] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.364286] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.364434] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.364520] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.364731] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.364830] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.364893] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.365053] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.365129] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.365326] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.365445] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.365480] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.365618] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.365681] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.365963] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.366075] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.366135] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.366278] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.366371] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.366456] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 07d8236a-b9f2-429a-9942-e7cb46920213 is going to be created. [ 735.426786] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.426923] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.426968] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.427281] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.427524] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.437630] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 07d8236a-b9f2-429a-9942-e7cb46920213 in Status: IN_PROGRESS for 2s [ 735.525582] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.525930] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.525930] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.526209] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.526353] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.526491] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 186800b9-4416-4ee9-97e6-a0aa4cad729b is going to be created. [ 735.528309] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-1340506f-247e-457d-b5d5-d9db4d9c0250 taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.528602] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1340506f-247e-457d-b5d5-d9db4d9c0250" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.528602] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1340506f-247e-457d-b5d5-d9db4d9c0250" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.528782] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1340506f-247e-457d-b5d5-d9db4d9c0250" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.529027] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.529149] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.529219] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.529417] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.529554] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.529643] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1340506f-247e-457d-b5d5-d9db4d9c0250" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.529834] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-1340506f-247e-457d-b5d5-d9db4d9c0250 taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.530301] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1340506f-247e-457d-b5d5-d9db4d9c0250" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.530301] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1340506f-247e-457d-b5d5-d9db4d9c0250" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.530301] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1340506f-247e-457d-b5d5-d9db4d9c0250" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.530422] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.530528] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.530614] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.530815] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.530921] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.532675] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1340506f-247e-457d-b5d5-d9db4d9c0250" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.532675] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1340506f-247e-457d-b5d5-d9db4d9c0250',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 735.562400] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.562570] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.562656] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.562872] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.563083] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.572552] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 186800b9-4416-4ee9-97e6-a0aa4cad729b in Status: UNINITIALIZED for 2s [ 736.020462] env[69980]: INFO networking_nsxv3.common.synchronization [req-0130b50e-7f84-4011-b8e0-5f1e02a200ac req-5c9258d7-f73a-49b4-8832-41c943a57f8e tempest-ServerExternalEventsTest-1880996192 tempest-ServerExternalEventsTest-1880996192-project-member] Enqueued Resource ID: c3e6d316-0225-4e87-99d5-6c58ff0694cb with Priority: HIGHEST for action security_group_members [ 736.020462] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c3e6d316-0225-4e87-99d5-6c58ff0694cb with Priority: HIGHEST for action security_group_members [ 736.024555] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-c3e6d316-0225-4e87-99d5-6c58ff0694cb taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.024555] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c3e6d316-0225-4e87-99d5-6c58ff0694cb" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.024555] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c3e6d316-0225-4e87-99d5-6c58ff0694cb" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.024555] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c3e6d316-0225-4e87-99d5-6c58ff0694cb" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.024555] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.024555] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.024555] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.024555] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.024555] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.024555] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c3e6d316-0225-4e87-99d5-6c58ff0694cb',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 736.034721] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1340506f-247e-457d-b5d5-d9db4d9c0250: rpc.has_security_group_logging(os_id): False [ 736.053277] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.053277] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.053277] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.053508] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.053551] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.055060] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.055060] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.055060] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.056177] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.056275] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.056509] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.056613] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.056689] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.057068] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.057145] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.057287] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.057414] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.057456] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.058717] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.058960] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.059083] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1340506f-247e-457d-b5d5-d9db4d9c0250 is going to be created. [ 736.082127] env[69980]: INFO networking_nsxv3.common.synchronization [req-d45b1c1f-5062-44ee-8493-913eedeabfeb req-a56f7060-ef96-4c15-9575-2319144306bf service nova] Enqueued Resource ID: 80e3ea48-91a5-4863-b1c2-f3e887204e39 with Priority: HIGHEST for action security_group_rules [ 736.082405] env[69980]: INFO networking_nsxv3.common.synchronization [req-d45b1c1f-5062-44ee-8493-913eedeabfeb req-a56f7060-ef96-4c15-9575-2319144306bf service nova] Enqueued Resource ID: 80e3ea48-91a5-4863-b1c2-f3e887204e39 with Priority: HIGHEST for action security_group_members [ 736.082405] env[69980]: INFO networking_nsxv3.common.synchronization [req-d45b1c1f-5062-44ee-8493-913eedeabfeb req-a56f7060-ef96-4c15-9575-2319144306bf service nova] Enqueued Resource ID: 92c67b91-1a1f-48d6-a604-932c1e357651 with Priority: HIGHEST for action port [ 736.082905] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 80e3ea48-91a5-4863-b1c2-f3e887204e39 with Priority: HIGHEST for action security_group_rules [ 736.086030] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 80e3ea48-91a5-4863-b1c2-f3e887204e39 with Priority: HIGHEST for action security_group_members [ 736.086030] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 92c67b91-1a1f-48d6-a604-932c1e357651 with Priority: HIGHEST for action port [ 736.086030] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock rules-80e3ea48-91a5-4863-b1c2-f3e887204e39 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.086030] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-80e3ea48-91a5-4863-b1c2-f3e887204e39" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.086030] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-80e3ea48-91a5-4863-b1c2-f3e887204e39" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.086030] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-80e3ea48-91a5-4863-b1c2-f3e887204e39" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.086030] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('80e3ea48-91a5-4863-b1c2-f3e887204e39',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 736.086030] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-80e3ea48-91a5-4863-b1c2-f3e887204e39 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.086030] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-80e3ea48-91a5-4863-b1c2-f3e887204e39" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.086030] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-80e3ea48-91a5-4863-b1c2-f3e887204e39" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.086030] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-80e3ea48-91a5-4863-b1c2-f3e887204e39" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.086030] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.086030] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.086030] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.086030] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.086030] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.086030] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('80e3ea48-91a5-4863-b1c2-f3e887204e39',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 736.087052] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock port-92c67b91-1a1f-48d6-a604-932c1e357651 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.087052] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-92c67b91-1a1f-48d6-a604-932c1e357651" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.088349] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-92c67b91-1a1f-48d6-a604-932c1e357651" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.088349] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-92c67b91-1a1f-48d6-a604-932c1e357651" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.088491] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('92c67b91-1a1f-48d6-a604-932c1e357651',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 736.115640] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.116915] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.116915] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.116915] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.116915] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.137146] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1340506f-247e-457d-b5d5-d9db4d9c0250 in Status: IN_PROGRESS for 2s [ 736.528026] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.528026] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.528026] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.528026] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.528026] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.528026] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.528026] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.528026] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.528026] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.528026] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.528026] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c3e6d316-0225-4e87-99d5-6c58ff0694cb already deleted. [ 736.528026] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c3e6d316-0225-4e87-99d5-6c58ff0694cb" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.591811] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('80e3ea48-91a5-4863-b1c2-f3e887204e39',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 736.591811] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-80e3ea48-91a5-4863-b1c2-f3e887204e39 taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.591811] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-80e3ea48-91a5-4863-b1c2-f3e887204e39" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.591811] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 92c67b91-1a1f-48d6-a604-932c1e357651 with status ACTIVE [ 736.591811] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.591811] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.591811] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.592117] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.592117] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.592943] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.592943] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.592943] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.592943] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.592943] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.592943] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.592943] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.593221] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.596402] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.596402] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.596402] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 92c67b91-1a1f-48d6-a604-932c1e357651 is going to be updated. [ 736.596819] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock network-557 taken with stack trace [, , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.596966] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "network-557" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.597178] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "network-557" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.597463] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "network-557" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.597779] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.597997] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.598181] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.598442] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.598629] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.598872] env[69980]: DEBUG dogpile.cache.region [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] No value present for key: 'zone-id' {{(pid=69980) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 736.599101] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] NeedRegenerationException {{(pid=69980) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 736.599256] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] no value, waiting for create lock {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 736.599681] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] value creation lock acquired {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 736.599962] env[69980]: DEBUG dogpile.cache.region [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] No value present for key: 'zone-id' {{(pid=69980) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 736.600144] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Calling creation function for not-yet-present value {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 736.600447] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 736.628128] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 736.628302] env[69980]: DEBUG dogpile.cache.region [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Cache value generated in 0.028 seconds for key(s): 'zone-id' {{(pid=69980) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 736.628444] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Released creation lock {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 736.628623] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "network-557" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.629049] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock port-03d2710f-03fd-4de8-8ab8-dd3311da510a taken with stack trace [, , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.629236] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "port-03d2710f-03fd-4de8-8ab8-dd3311da510a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.629355] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "port-03d2710f-03fd-4de8-8ab8-dd3311da510a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.629670] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "port-03d2710f-03fd-4de8-8ab8-dd3311da510a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.629810] env[69980]: DEBUG networking_nsxv3.api.rpc [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('03d2710f-03fd-4de8-8ab8-dd3311da510a',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 736.634892] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.634892] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.634892] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.634892] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.634892] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.634892] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-92c67b91-1a1f-48d6-a604-932c1e357651" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.097464] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('80e3ea48-91a5-4863-b1c2-f3e887204e39',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 737.133897] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.134153] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.134279] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.134572] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.134746] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.134905] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Segment Port 03d2710f-03fd-4de8-8ab8-dd3311da510a not found, creating... [ 737.135181] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.135338] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.135457] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.135683] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.135818] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.136110] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.136268] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.136385] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.136604] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.136704] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.136855] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Resource: SegmentPort with ID: 03d2710f-03fd-4de8-8ab8-dd3311da510a is going to be created. [ 737.156574] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.156783] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.156906] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.157326] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.157607] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.157825] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "port-03d2710f-03fd-4de8-8ab8-dd3311da510a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.449187] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 07d8236a-b9f2-429a-9942-e7cb46920213 in Status: SUCCESS [ 737.449421] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-07d8236a-b9f2-429a-9942-e7cb46920213" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.583473] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 186800b9-4416-4ee9-97e6-a0aa4cad729b in Status: SUCCESS [ 737.583473] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-186800b9-4416-4ee9-97e6-a0aa4cad729b" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.583473] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-186800b9-4416-4ee9-97e6-a0aa4cad729b" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.583473] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-186800b9-4416-4ee9-97e6-a0aa4cad729b" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.583473] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.583473] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.583473] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.583473] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.583473] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.583473] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-186800b9-4416-4ee9-97e6-a0aa4cad729b" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.583473] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('186800b9-4416-4ee9-97e6-a0aa4cad729b',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 737.602839] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.602839] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.603143] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.603143] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.603338] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.603338] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 80e3ea48-91a5-4863-b1c2-f3e887204e39 is going to be created. [ 737.631777] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.631777] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.631777] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.631777] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.631777] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.642165] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 80e3ea48-91a5-4863-b1c2-f3e887204e39 in Status: UNINITIALIZED for 2s [ 738.069015] env[69980]: INFO networking_nsxv3.common.synchronization [req-0130b50e-7f84-4011-b8e0-5f1e02a200ac req-ddee9d4d-0977-4106-a082-92a64e5ea2ea service nova] Enqueued Resource ID: c3e6d316-0225-4e87-99d5-6c58ff0694cb with Priority: HIGHEST for action security_group_rules [ 738.069015] env[69980]: INFO networking_nsxv3.common.synchronization [req-0130b50e-7f84-4011-b8e0-5f1e02a200ac req-ddee9d4d-0977-4106-a082-92a64e5ea2ea service nova] Enqueued Resource ID: c3e6d316-0225-4e87-99d5-6c58ff0694cb with Priority: HIGHEST for action security_group_members [ 738.069015] env[69980]: INFO networking_nsxv3.common.synchronization [req-0130b50e-7f84-4011-b8e0-5f1e02a200ac req-ddee9d4d-0977-4106-a082-92a64e5ea2ea service nova] Enqueued Resource ID: 03d2710f-03fd-4de8-8ab8-dd3311da510a with Priority: HIGHEST for action port [ 738.069868] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c3e6d316-0225-4e87-99d5-6c58ff0694cb with Priority: HIGHEST for action security_group_rules [ 738.070360] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c3e6d316-0225-4e87-99d5-6c58ff0694cb with Priority: HIGHEST for action security_group_members [ 738.070360] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 03d2710f-03fd-4de8-8ab8-dd3311da510a with Priority: HIGHEST for action port [ 738.070962] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c3e6d316-0225-4e87-99d5-6c58ff0694cb taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.071093] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c3e6d316-0225-4e87-99d5-6c58ff0694cb" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.071283] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c3e6d316-0225-4e87-99d5-6c58ff0694cb" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.071625] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c3e6d316-0225-4e87-99d5-6c58ff0694cb" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.071785] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c3e6d316-0225-4e87-99d5-6c58ff0694cb',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 738.072828] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-c3e6d316-0225-4e87-99d5-6c58ff0694cb taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.072895] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c3e6d316-0225-4e87-99d5-6c58ff0694cb" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.072929] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c3e6d316-0225-4e87-99d5-6c58ff0694cb" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.076033] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c3e6d316-0225-4e87-99d5-6c58ff0694cb" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.076033] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.076033] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.076033] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.076033] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.076033] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.076033] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c3e6d316-0225-4e87-99d5-6c58ff0694cb',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 738.076033] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock port-03d2710f-03fd-4de8-8ab8-dd3311da510a taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.076033] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-03d2710f-03fd-4de8-8ab8-dd3311da510a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.076033] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-03d2710f-03fd-4de8-8ab8-dd3311da510a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.078120] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-03d2710f-03fd-4de8-8ab8-dd3311da510a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.078120] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('03d2710f-03fd-4de8-8ab8-dd3311da510a',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 738.086770] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-186800b9-4416-4ee9-97e6-a0aa4cad729b taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.087252] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-186800b9-4416-4ee9-97e6-a0aa4cad729b" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.087252] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-186800b9-4416-4ee9-97e6-a0aa4cad729b" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.087659] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-186800b9-4416-4ee9-97e6-a0aa4cad729b" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.087659] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.087769] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.088196] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.088299] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.089507] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.089507] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-186800b9-4416-4ee9-97e6-a0aa4cad729b" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.089507] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-186800b9-4416-4ee9-97e6-a0aa4cad729b taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.089507] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-186800b9-4416-4ee9-97e6-a0aa4cad729b" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.089507] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-186800b9-4416-4ee9-97e6-a0aa4cad729b" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.089507] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-186800b9-4416-4ee9-97e6-a0aa4cad729b" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.089507] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.090009] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.090043] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.091664] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.091664] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.091664] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-186800b9-4416-4ee9-97e6-a0aa4cad729b" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.091664] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('186800b9-4416-4ee9-97e6-a0aa4cad729b',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 738.149883] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1340506f-247e-457d-b5d5-d9db4d9c0250 in Status: SUCCESS [ 738.149883] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1340506f-247e-457d-b5d5-d9db4d9c0250" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.401564] env[69980]: INFO networking_nsxv3.common.synchronization [req-961fe06b-9e08-4eac-a5d3-12b1035122f1 req-78842196-4f9b-4b4e-a174-d50facb139ba tempest-ListServerFiltersTestJSON-1624918227 tempest-ListServerFiltersTestJSON-1624918227-project-member] Enqueued Resource ID: 1340506f-247e-457d-b5d5-d9db4d9c0250 with Priority: HIGHEST for action security_group_members [ 738.401564] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1340506f-247e-457d-b5d5-d9db4d9c0250 with Priority: HIGHEST for action security_group_members [ 738.401564] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-1340506f-247e-457d-b5d5-d9db4d9c0250 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.401564] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1340506f-247e-457d-b5d5-d9db4d9c0250" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.403294] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1340506f-247e-457d-b5d5-d9db4d9c0250" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.403528] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1340506f-247e-457d-b5d5-d9db4d9c0250" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.403716] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.403830] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.403894] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.404068] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.404162] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.404261] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1340506f-247e-457d-b5d5-d9db4d9c0250',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 738.543708] env[69980]: INFO networking_nsxv3.common.synchronization [None req-9def7cbd-d062-44c8-bf53-8407f38f45c1 None None] Enqueued Resource ID: 480ba357-34ae-4242-aca5-bec48962c0ed with Priority: HIGHEST for action port [ 738.544197] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 480ba357-34ae-4242-aca5-bec48962c0ed with Priority: HIGHEST for action port [ 738.546856] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock port-480ba357-34ae-4242-aca5-bec48962c0ed taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.546856] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-480ba357-34ae-4242-aca5-bec48962c0ed" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.546856] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-480ba357-34ae-4242-aca5-bec48962c0ed" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.547315] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-480ba357-34ae-4242-aca5-bec48962c0ed" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.547315] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('480ba357-34ae-4242-aca5-bec48962c0ed',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 738.581790] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-c3e6d316-0225-4e87-99d5-6c58ff0694cb taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.581790] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c3e6d316-0225-4e87-99d5-6c58ff0694cb" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.582973] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c3e6d316-0225-4e87-99d5-6c58ff0694cb',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 738.584552] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 03d2710f-03fd-4de8-8ab8-dd3311da510a with status ACTIVE [ 738.584552] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.584552] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.584552] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.584552] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.584552] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.585342] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.585342] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.585342] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.585342] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.585342] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.585342] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.585621] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.585621] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.585621] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.585942] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.585942] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 03d2710f-03fd-4de8-8ab8-dd3311da510a is going to be updated. [ 738.593570] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 186800b9-4416-4ee9-97e6-a0aa4cad729b: rpc.has_security_group_logging(os_id): False [ 738.607693] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.608497] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.608497] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.608497] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.608497] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.608497] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-03d2710f-03fd-4de8-8ab8-dd3311da510a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.611930] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.612241] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.612428] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.612759] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.613046] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.613422] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.613935] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.614107] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.614398] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.614645] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.614947] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.617719] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.617719] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.617719] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.617719] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.617719] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.617719] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.617719] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.617719] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.617719] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.617719] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 186800b9-4416-4ee9-97e6-a0aa4cad729b is going to be created. [ 738.688120] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.688120] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.688542] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.688745] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.689148] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.703388] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 186800b9-4416-4ee9-97e6-a0aa4cad729b in Status: IN_PROGRESS for 2s [ 738.895398] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock network-568 taken with stack trace [, , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.895398] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "network-568" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.895797] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "network-568" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.895797] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "network-568" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.896426] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.896630] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.896807] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.897138] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.897138] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.897397] env[69980]: DEBUG dogpile.cache.region [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] No value present for key: 'zone-id' {{(pid=69980) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 738.897465] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] NeedRegenerationException {{(pid=69980) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 738.897568] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] no value, waiting for create lock {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 738.897672] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] value creation lock acquired {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 738.897776] env[69980]: DEBUG dogpile.cache.region [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] No value present for key: 'zone-id' {{(pid=69980) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 738.897890] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Calling creation function for not-yet-present value {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 738.898043] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 738.909782] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1340506f-247e-457d-b5d5-d9db4d9c0250',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 738.917518] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 738.917690] env[69980]: DEBUG dogpile.cache.region [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=69980) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 738.917870] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Released creation lock {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 738.918126] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "network-568" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.918458] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock port-65863284-c8a4-48ac-bd4a-0b478b527a3a taken with stack trace [, , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.918698] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "port-65863284-c8a4-48ac-bd4a-0b478b527a3a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.918836] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "port-65863284-c8a4-48ac-bd4a-0b478b527a3a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.919193] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "port-65863284-c8a4-48ac-bd4a-0b478b527a3a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.919382] env[69980]: DEBUG networking_nsxv3.api.rpc [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('65863284-c8a4-48ac-bd4a-0b478b527a3a',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 739.053093] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 480ba357-34ae-4242-aca5-bec48962c0ed [ 739.053374] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.053529] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.053775] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.053823] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.053993] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.053993] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:480ba357-34ae-4242-aca5-bec48962c0ed already deleted. [ 739.054084] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-480ba357-34ae-4242-aca5-bec48962c0ed" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.089825] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c3e6d316-0225-4e87-99d5-6c58ff0694cb',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 739.412623] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1340506f-247e-457d-b5d5-d9db4d9c0250',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 739.423748] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.423951] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.424125] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.424418] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.424623] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.424862] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Segment Port 65863284-c8a4-48ac-bd4a-0b478b527a3a not found, creating... [ 739.425202] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.425862] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.425862] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.428303] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.428476] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.428785] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.429063] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.429151] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.429319] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.429462] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.429621] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Resource: SegmentPort with ID: 65863284-c8a4-48ac-bd4a-0b478b527a3a is going to be created. [ 739.450064] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.450379] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.450540] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.450846] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.451138] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.451422] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "port-65863284-c8a4-48ac-bd4a-0b478b527a3a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.595025] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.595025] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.595025] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.595025] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.595025] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.595025] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c3e6d316-0225-4e87-99d5-6c58ff0694cb is going to be created. [ 739.627271] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.627271] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.627271] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.627271] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.627449] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.640178] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c3e6d316-0225-4e87-99d5-6c58ff0694cb in Status: UNINITIALIZED for 2s [ 739.656381] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 80e3ea48-91a5-4863-b1c2-f3e887204e39 in Status: SUCCESS [ 739.656552] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-80e3ea48-91a5-4863-b1c2-f3e887204e39" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.656726] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-80e3ea48-91a5-4863-b1c2-f3e887204e39" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.656953] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-80e3ea48-91a5-4863-b1c2-f3e887204e39" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.657162] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.657268] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.657333] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.657492] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.657572] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.657659] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-80e3ea48-91a5-4863-b1c2-f3e887204e39" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.657748] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('80e3ea48-91a5-4863-b1c2-f3e887204e39',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 739.914411] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.914583] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.914680] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.914868] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.914957] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.915071] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1340506f-247e-457d-b5d5-d9db4d9c0250 is going to be updated. [ 739.951512] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.951656] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.951741] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.951935] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.952093] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.960949] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1340506f-247e-457d-b5d5-d9db4d9c0250 in Status: IN_PROGRESS for 2s [ 740.162135] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-80e3ea48-91a5-4863-b1c2-f3e887204e39 taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.162354] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-80e3ea48-91a5-4863-b1c2-f3e887204e39" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.163246] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-80e3ea48-91a5-4863-b1c2-f3e887204e39" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.163627] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-80e3ea48-91a5-4863-b1c2-f3e887204e39" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.163968] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.164211] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.164325] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.164972] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.165247] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.165517] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-80e3ea48-91a5-4863-b1c2-f3e887204e39" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.165819] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-80e3ea48-91a5-4863-b1c2-f3e887204e39 taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.166016] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-80e3ea48-91a5-4863-b1c2-f3e887204e39" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.166124] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-80e3ea48-91a5-4863-b1c2-f3e887204e39" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.166418] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-80e3ea48-91a5-4863-b1c2-f3e887204e39" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.166695] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.166893] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.166985] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.167438] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.167634] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.167757] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-80e3ea48-91a5-4863-b1c2-f3e887204e39" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.167922] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('80e3ea48-91a5-4863-b1c2-f3e887204e39',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 740.509315] env[69980]: INFO networking_nsxv3.common.synchronization [req-961fe06b-9e08-4eac-a5d3-12b1035122f1 req-d245f8df-30d4-4751-90c2-149e202f4bdd service nova] Enqueued Resource ID: 1340506f-247e-457d-b5d5-d9db4d9c0250 with Priority: HIGHEST for action security_group_rules [ 740.509544] env[69980]: INFO networking_nsxv3.common.synchronization [req-961fe06b-9e08-4eac-a5d3-12b1035122f1 req-d245f8df-30d4-4751-90c2-149e202f4bdd service nova] Enqueued Resource ID: 1340506f-247e-457d-b5d5-d9db4d9c0250 with Priority: HIGHEST for action security_group_members [ 740.509578] env[69980]: INFO networking_nsxv3.common.synchronization [req-961fe06b-9e08-4eac-a5d3-12b1035122f1 req-d245f8df-30d4-4751-90c2-149e202f4bdd service nova] Enqueued Resource ID: 65863284-c8a4-48ac-bd4a-0b478b527a3a with Priority: HIGHEST for action port [ 740.511023] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1340506f-247e-457d-b5d5-d9db4d9c0250 with Priority: HIGHEST for action security_group_rules [ 740.511023] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1340506f-247e-457d-b5d5-d9db4d9c0250 with Priority: HIGHEST for action security_group_members [ 740.511023] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 65863284-c8a4-48ac-bd4a-0b478b527a3a with Priority: HIGHEST for action port [ 740.511023] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1340506f-247e-457d-b5d5-d9db4d9c0250 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.511023] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1340506f-247e-457d-b5d5-d9db4d9c0250" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.511023] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1340506f-247e-457d-b5d5-d9db4d9c0250" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.511527] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1340506f-247e-457d-b5d5-d9db4d9c0250" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.511527] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1340506f-247e-457d-b5d5-d9db4d9c0250',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 740.512346] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-1340506f-247e-457d-b5d5-d9db4d9c0250 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.512462] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1340506f-247e-457d-b5d5-d9db4d9c0250" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.512664] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock port-65863284-c8a4-48ac-bd4a-0b478b527a3a taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.512761] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-65863284-c8a4-48ac-bd4a-0b478b527a3a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.512822] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-65863284-c8a4-48ac-bd4a-0b478b527a3a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.513435] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-65863284-c8a4-48ac-bd4a-0b478b527a3a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.513435] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('65863284-c8a4-48ac-bd4a-0b478b527a3a',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 740.671436] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 80e3ea48-91a5-4863-b1c2-f3e887204e39: rpc.has_security_group_logging(os_id): False [ 740.691327] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.691327] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.691327] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.691327] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.691327] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.691327] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.691327] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.691327] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.691327] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.691327] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.691327] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.691327] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.691327] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.691752] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.691752] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.691752] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.691752] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.692152] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.692152] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.692152] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.692152] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 80e3ea48-91a5-4863-b1c2-f3e887204e39 is going to be created. [ 740.715622] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 186800b9-4416-4ee9-97e6-a0aa4cad729b in Status: SUCCESS [ 740.716265] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-186800b9-4416-4ee9-97e6-a0aa4cad729b" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.772814] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.772957] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.773034] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.773248] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.773460] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.787073] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 80e3ea48-91a5-4863-b1c2-f3e887204e39 in Status: IN_PROGRESS for 2s [ 741.015941] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-1340506f-247e-457d-b5d5-d9db4d9c0250 taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.016129] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1340506f-247e-457d-b5d5-d9db4d9c0250" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.016331] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 65863284-c8a4-48ac-bd4a-0b478b527a3a with status ACTIVE [ 741.016730] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.016951] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.017037] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.017253] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.017467] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.017724] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.017890] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.018143] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.018771] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.018771] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.018771] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.019052] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.019052] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.022014] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.022014] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.022014] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 65863284-c8a4-48ac-bd4a-0b478b527a3a is going to be updated. [ 741.044744] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.045207] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.045325] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.046236] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.046508] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.047179] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-65863284-c8a4-48ac-bd4a-0b478b527a3a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.216519] env[69980]: INFO networking_nsxv3.common.synchronization [None req-e628788a-39d5-4616-b1da-c7d494e7e2cc None None] Enqueued Resource ID: 1e8381a5-05ac-4714-b5b4-e8bed6298678 with Priority: HIGHEST for action port [ 741.216918] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1e8381a5-05ac-4714-b5b4-e8bed6298678 with Priority: HIGHEST for action port [ 741.217796] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock port-1e8381a5-05ac-4714-b5b4-e8bed6298678 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.217796] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1e8381a5-05ac-4714-b5b4-e8bed6298678" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.217796] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1e8381a5-05ac-4714-b5b4-e8bed6298678" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.218672] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1e8381a5-05ac-4714-b5b4-e8bed6298678" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.218672] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1e8381a5-05ac-4714-b5b4-e8bed6298678',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 741.652157] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c3e6d316-0225-4e87-99d5-6c58ff0694cb in Status: UNINITIALIZED for 4s [ 741.720749] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 1e8381a5-05ac-4714-b5b4-e8bed6298678 [ 741.721034] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.721209] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.721260] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.721598] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.721598] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.721700] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:1e8381a5-05ac-4714-b5b4-e8bed6298678 already deleted. [ 741.722127] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1e8381a5-05ac-4714-b5b4-e8bed6298678" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.970389] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1340506f-247e-457d-b5d5-d9db4d9c0250 in Status: SUCCESS [ 741.970594] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1340506f-247e-457d-b5d5-d9db4d9c0250" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.970801] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1340506f-247e-457d-b5d5-d9db4d9c0250" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.971040] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1340506f-247e-457d-b5d5-d9db4d9c0250" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.971234] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.971356] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.971423] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.971578] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.971657] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.971756] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1340506f-247e-457d-b5d5-d9db4d9c0250',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 742.474615] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1340506f-247e-457d-b5d5-d9db4d9c0250',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 742.800397] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 80e3ea48-91a5-4863-b1c2-f3e887204e39 in Status: SUCCESS [ 742.800694] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-80e3ea48-91a5-4863-b1c2-f3e887204e39" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.980032] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1340506f-247e-457d-b5d5-d9db4d9c0250',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 743.433838] env[69980]: INFO networking_nsxv3.common.synchronization [req-16dae732-9efa-4197-ab93-88ed8c16e1fb req-9576f89e-9196-42c2-8196-e34d0f380267 tempest-ListServerFiltersTestJSON-1624918227 tempest-ListServerFiltersTestJSON-1624918227-project-member] Enqueued Resource ID: 1340506f-247e-457d-b5d5-d9db4d9c0250 with Priority: HIGHEST for action security_group_members [ 743.437495] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1340506f-247e-457d-b5d5-d9db4d9c0250 with Priority: HIGHEST for action security_group_members [ 743.437495] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-1340506f-247e-457d-b5d5-d9db4d9c0250 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.437495] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1340506f-247e-457d-b5d5-d9db4d9c0250" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.482111] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.482308] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.482412] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.482634] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.482724] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.482822] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1340506f-247e-457d-b5d5-d9db4d9c0250 is going to be updated. [ 743.525501] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.525501] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.525761] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.525916] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.526062] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.540405] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1340506f-247e-457d-b5d5-d9db4d9c0250 in Status: IN_PROGRESS for 2s [ 743.665022] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c3e6d316-0225-4e87-99d5-6c58ff0694cb in Status: SUCCESS [ 743.665022] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c3e6d316-0225-4e87-99d5-6c58ff0694cb" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.665022] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c3e6d316-0225-4e87-99d5-6c58ff0694cb" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.665022] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c3e6d316-0225-4e87-99d5-6c58ff0694cb" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.665022] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.665022] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.665022] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.665022] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.665022] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.665022] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c3e6d316-0225-4e87-99d5-6c58ff0694cb" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.665022] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c3e6d316-0225-4e87-99d5-6c58ff0694cb',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 743.914552] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock network-568 taken with stack trace [, , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.914920] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "network-568" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.914983] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "network-568" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.915770] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "network-568" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.915770] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.915943] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.916022] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.916316] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.916493] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.916769] env[69980]: DEBUG dogpile.cache.region [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] No value present for key: 'zone-id' {{(pid=69980) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 743.916906] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] NeedRegenerationException {{(pid=69980) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 743.917092] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] no value, waiting for create lock {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 743.917233] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] value creation lock acquired {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 743.917419] env[69980]: DEBUG dogpile.cache.region [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] No value present for key: 'zone-id' {{(pid=69980) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 743.917574] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Calling creation function for not-yet-present value {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 743.917742] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 743.938882] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 743.938882] env[69980]: DEBUG dogpile.cache.region [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=69980) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 743.938882] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Released creation lock {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 743.938882] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "network-568" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.938882] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock port-ab56a6c5-17a8-4762-ba5c-d5c37dc93c49 taken with stack trace [, , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.938882] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "port-ab56a6c5-17a8-4762-ba5c-d5c37dc93c49" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.938882] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "port-ab56a6c5-17a8-4762-ba5c-d5c37dc93c49" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.938882] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "port-ab56a6c5-17a8-4762-ba5c-d5c37dc93c49" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.938882] env[69980]: DEBUG networking_nsxv3.api.rpc [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ab56a6c5-17a8-4762-ba5c-d5c37dc93c49',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 744.168826] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-c3e6d316-0225-4e87-99d5-6c58ff0694cb taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.168996] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c3e6d316-0225-4e87-99d5-6c58ff0694cb" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.169079] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c3e6d316-0225-4e87-99d5-6c58ff0694cb" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.171847] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c3e6d316-0225-4e87-99d5-6c58ff0694cb" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.171847] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.171847] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.171847] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.171847] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.171847] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.171847] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c3e6d316-0225-4e87-99d5-6c58ff0694cb" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.171847] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-c3e6d316-0225-4e87-99d5-6c58ff0694cb taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.171847] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c3e6d316-0225-4e87-99d5-6c58ff0694cb" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.171847] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c3e6d316-0225-4e87-99d5-6c58ff0694cb" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.171847] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c3e6d316-0225-4e87-99d5-6c58ff0694cb" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.171847] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.172262] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.172262] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.172262] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.172262] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.172480] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c3e6d316-0225-4e87-99d5-6c58ff0694cb" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.172480] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c3e6d316-0225-4e87-99d5-6c58ff0694cb',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 744.445540] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.445769] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.446206] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.446206] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.446335] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.446526] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Segment Port ab56a6c5-17a8-4762-ba5c-d5c37dc93c49 not found, creating... [ 744.446764] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.446937] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.447068] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.447288] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.447434] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.447720] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.448121] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.448121] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.449285] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.449563] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.449720] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Resource: SegmentPort with ID: ab56a6c5-17a8-4762-ba5c-d5c37dc93c49 is going to be created. [ 744.470075] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.470075] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.470075] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.470075] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.470075] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.470075] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "port-ab56a6c5-17a8-4762-ba5c-d5c37dc93c49" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.645544] env[69980]: INFO networking_nsxv3.common.synchronization [req-bfc7e797-cf97-434f-ba50-0d0124c42d67 req-af24cfc0-f2ee-41b5-a946-40d3c0a48413 tempest-DeleteServersAdminTestJSON-252978323 tempest-DeleteServersAdminTestJSON-252978323-project-admin] Enqueued Resource ID: 07d8236a-b9f2-429a-9942-e7cb46920213 with Priority: HIGHEST for action security_group_members [ 744.645751] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 07d8236a-b9f2-429a-9942-e7cb46920213 with Priority: HIGHEST for action security_group_members [ 744.646283] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-07d8236a-b9f2-429a-9942-e7cb46920213 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.646406] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-07d8236a-b9f2-429a-9942-e7cb46920213" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.646648] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-07d8236a-b9f2-429a-9942-e7cb46920213" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.646714] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-07d8236a-b9f2-429a-9942-e7cb46920213" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.646815] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.646906] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.646959] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.648212] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.648212] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.648276] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('07d8236a-b9f2-429a-9942-e7cb46920213',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 744.674889] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c3e6d316-0225-4e87-99d5-6c58ff0694cb: rpc.has_security_group_logging(os_id): False [ 744.696035] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.696186] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.696362] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.696502] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.696553] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.696763] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.696852] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.696904] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.697924] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.697924] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.697924] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.697924] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.697924] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.697924] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.697924] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.697924] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.697924] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.698373] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.698373] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.698373] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.698373] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c3e6d316-0225-4e87-99d5-6c58ff0694cb is going to be created. [ 744.778034] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.778245] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.778340] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.778580] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.779277] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.797029] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c3e6d316-0225-4e87-99d5-6c58ff0694cb in Status: IN_PROGRESS for 2s [ 745.156148] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.156148] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.156148] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.156148] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.156148] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.156148] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.156148] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.156148] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.156148] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.156148] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.156148] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 07d8236a-b9f2-429a-9942-e7cb46920213 is going to be updated. [ 745.197827] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.197827] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.197827] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.198965] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.200977] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.211722] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 07d8236a-b9f2-429a-9942-e7cb46920213 in Status: IN_PROGRESS for 2s [ 745.555530] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1340506f-247e-457d-b5d5-d9db4d9c0250 in Status: SUCCESS [ 745.557536] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1340506f-247e-457d-b5d5-d9db4d9c0250" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.557536] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1340506f-247e-457d-b5d5-d9db4d9c0250" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.557810] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1340506f-247e-457d-b5d5-d9db4d9c0250" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.558064] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.558132] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.558174] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.558966] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.558966] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.558966] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1340506f-247e-457d-b5d5-d9db4d9c0250" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.558966] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1340506f-247e-457d-b5d5-d9db4d9c0250',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 745.560365] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1340506f-247e-457d-b5d5-d9db4d9c0250" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.561658] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1340506f-247e-457d-b5d5-d9db4d9c0250" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.561658] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.561658] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.561658] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.561658] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.561658] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.561658] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1340506f-247e-457d-b5d5-d9db4d9c0250',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 745.863397] env[69980]: INFO networking_nsxv3.common.synchronization [req-16dae732-9efa-4197-ab93-88ed8c16e1fb req-820a700e-cec7-40e0-ad34-19bdad444599 service nova] Enqueued Resource ID: 1340506f-247e-457d-b5d5-d9db4d9c0250 with Priority: HIGHEST for action security_group_rules [ 745.865547] env[69980]: INFO networking_nsxv3.common.synchronization [req-16dae732-9efa-4197-ab93-88ed8c16e1fb req-820a700e-cec7-40e0-ad34-19bdad444599 service nova] Enqueued Resource ID: 1340506f-247e-457d-b5d5-d9db4d9c0250 with Priority: HIGHEST for action security_group_members [ 745.865547] env[69980]: INFO networking_nsxv3.common.synchronization [req-16dae732-9efa-4197-ab93-88ed8c16e1fb req-820a700e-cec7-40e0-ad34-19bdad444599 service nova] Enqueued Resource ID: ab56a6c5-17a8-4762-ba5c-d5c37dc93c49 with Priority: HIGHEST for action port [ 745.868215] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1340506f-247e-457d-b5d5-d9db4d9c0250 with Priority: HIGHEST for action security_group_rules [ 745.868270] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1340506f-247e-457d-b5d5-d9db4d9c0250 with Priority: HIGHEST for action security_group_members [ 745.868395] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ab56a6c5-17a8-4762-ba5c-d5c37dc93c49 with Priority: HIGHEST for action port [ 745.869436] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1340506f-247e-457d-b5d5-d9db4d9c0250 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.869566] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1340506f-247e-457d-b5d5-d9db4d9c0250" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.869781] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-1340506f-247e-457d-b5d5-d9db4d9c0250 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.869880] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1340506f-247e-457d-b5d5-d9db4d9c0250" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.870057] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock port-ab56a6c5-17a8-4762-ba5c-d5c37dc93c49 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.870614] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ab56a6c5-17a8-4762-ba5c-d5c37dc93c49" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.870614] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ab56a6c5-17a8-4762-ba5c-d5c37dc93c49" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.870614] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ab56a6c5-17a8-4762-ba5c-d5c37dc93c49" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.870614] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ab56a6c5-17a8-4762-ba5c-d5c37dc93c49',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 746.066864] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-1340506f-247e-457d-b5d5-d9db4d9c0250 taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.067294] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1340506f-247e-457d-b5d5-d9db4d9c0250" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.067645] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1340506f-247e-457d-b5d5-d9db4d9c0250',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 746.375026] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port ab56a6c5-17a8-4762-ba5c-d5c37dc93c49 with status ACTIVE [ 746.375390] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.375390] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.375811] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.375811] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.375811] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.375994] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.376228] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.376228] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.376413] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.376413] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.376628] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.376726] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.376803] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.376928] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.377010] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.377100] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: ab56a6c5-17a8-4762-ba5c-d5c37dc93c49 is going to be updated. [ 746.390209] env[69980]: INFO networking_nsxv3.common.synchronization [req-ba98b5d8-8fed-4527-9bb5-86406d714db6 req-954fe722-62f5-4b3c-8289-c4544e2992e7 tempest-MigrationsAdminTest-1290478568 tempest-MigrationsAdminTest-1290478568-project-member] Enqueued Resource ID: 462431af-62e3-426c-a50e-a61604f20358 with Priority: HIGHEST for action security_group_members [ 746.390209] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 462431af-62e3-426c-a50e-a61604f20358 with Priority: HIGHEST for action security_group_members [ 746.390209] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-462431af-62e3-426c-a50e-a61604f20358 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.390209] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-462431af-62e3-426c-a50e-a61604f20358" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.390584] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-462431af-62e3-426c-a50e-a61604f20358" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.390584] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-462431af-62e3-426c-a50e-a61604f20358" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.390922] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.390922] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.390922] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.391191] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.391191] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.391284] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('462431af-62e3-426c-a50e-a61604f20358',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 746.403157] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.403336] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.403423] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.403670] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.403812] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.403976] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ab56a6c5-17a8-4762-ba5c-d5c37dc93c49" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.570233] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1340506f-247e-457d-b5d5-d9db4d9c0250',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 746.807153] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c3e6d316-0225-4e87-99d5-6c58ff0694cb in Status: SUCCESS [ 746.807153] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c3e6d316-0225-4e87-99d5-6c58ff0694cb" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.897849] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.897849] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.897849] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.897849] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.897849] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.897849] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.897849] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.897849] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.897849] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.897849] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.897849] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 462431af-62e3-426c-a50e-a61604f20358 already deleted. [ 746.897849] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-462431af-62e3-426c-a50e-a61604f20358" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.074157] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.074157] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.077297] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.077606] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.077860] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.078129] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1340506f-247e-457d-b5d5-d9db4d9c0250 is going to be updated. [ 747.108068] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.108283] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.108345] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.108562] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.108676] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.117465] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1340506f-247e-457d-b5d5-d9db4d9c0250 in Status: IN_PROGRESS for 2s [ 747.222037] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 07d8236a-b9f2-429a-9942-e7cb46920213 in Status: SUCCESS [ 747.222330] env[69980]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 07d8236a-b9f2-429a-9942-e7cb46920213 deletion is rescheduled due to dependency. [ 747.222513] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-07d8236a-b9f2-429a-9942-e7cb46920213" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.352514] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock network-557 taken with stack trace [, , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.352727] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "network-557" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.352847] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "network-557" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.353141] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "network-557" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.353437] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.353672] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.353802] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.358162] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.358402] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.358975] env[69980]: DEBUG dogpile.cache.region [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] No value present for key: 'zone-id' {{(pid=69980) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 747.358975] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] NeedRegenerationException {{(pid=69980) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 747.358975] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] no value, waiting for create lock {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 747.358975] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] value creation lock acquired {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 747.359152] env[69980]: DEBUG dogpile.cache.region [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] No value present for key: 'zone-id' {{(pid=69980) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 747.359152] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Calling creation function for not-yet-present value {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 747.362795] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 747.375627] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 747.376919] env[69980]: DEBUG dogpile.cache.region [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Cache value generated in 0.016 seconds for key(s): 'zone-id' {{(pid=69980) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 747.376919] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Released creation lock {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 747.376919] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "network-557" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.376919] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock port-6fd2b3c5-d441-4079-8ecc-715a4c3da32d taken with stack trace [, , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.376919] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "port-6fd2b3c5-d441-4079-8ecc-715a4c3da32d" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.376919] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "port-6fd2b3c5-d441-4079-8ecc-715a4c3da32d" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.377220] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "port-6fd2b3c5-d441-4079-8ecc-715a4c3da32d" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.377251] env[69980]: DEBUG networking_nsxv3.api.rpc [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6fd2b3c5-d441-4079-8ecc-715a4c3da32d',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 747.618802] env[69980]: INFO networking_nsxv3.common.synchronization [None req-d2c53e6d-7d7f-421b-bad5-e651dc97dbc2 None None] Enqueued Resource ID: 1b2f5b0d-c551-44ad-97c2-686746c7084e with Priority: HIGHEST for action port [ 747.619443] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1b2f5b0d-c551-44ad-97c2-686746c7084e with Priority: HIGHEST for action port [ 747.620072] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock port-1b2f5b0d-c551-44ad-97c2-686746c7084e taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.620380] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1b2f5b0d-c551-44ad-97c2-686746c7084e" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.620531] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1b2f5b0d-c551-44ad-97c2-686746c7084e" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.620803] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1b2f5b0d-c551-44ad-97c2-686746c7084e" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.620907] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1b2f5b0d-c551-44ad-97c2-686746c7084e',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 747.887405] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.887405] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.887405] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.887405] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.887405] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.887405] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Segment Port 6fd2b3c5-d441-4079-8ecc-715a4c3da32d not found, creating... [ 747.887405] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.887708] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.887708] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.887788] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.887934] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.888231] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.888387] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.888505] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.888760] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.888838] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.889155] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Resource: SegmentPort with ID: 6fd2b3c5-d441-4079-8ecc-715a4c3da32d is going to be created. [ 747.911102] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.911360] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.911531] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.911833] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.912089] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.912379] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "port-6fd2b3c5-d441-4079-8ecc-715a4c3da32d" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.055760] env[69980]: INFO networking_nsxv3.common.synchronization [None req-635aac60-659a-43ea-a77e-5111c410932d None None] Enqueued Resource ID: 23f6e2a5-7c71-4fc2-b43b-8119857d172e with Priority: HIGHEST for action port [ 748.056335] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 23f6e2a5-7c71-4fc2-b43b-8119857d172e with Priority: HIGHEST for action port [ 748.056641] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock port-23f6e2a5-7c71-4fc2-b43b-8119857d172e taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.056888] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-23f6e2a5-7c71-4fc2-b43b-8119857d172e" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.056888] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-23f6e2a5-7c71-4fc2-b43b-8119857d172e" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.060543] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-23f6e2a5-7c71-4fc2-b43b-8119857d172e" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.060543] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('23f6e2a5-7c71-4fc2-b43b-8119857d172e',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 748.122748] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 1b2f5b0d-c551-44ad-97c2-686746c7084e [ 748.123069] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.123160] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.123230] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.123480] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.123572] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.123757] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:1b2f5b0d-c551-44ad-97c2-686746c7084e already deleted. [ 748.123757] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1b2f5b0d-c551-44ad-97c2-686746c7084e" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.563067] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 23f6e2a5-7c71-4fc2-b43b-8119857d172e [ 748.563986] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.564292] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.564483] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.565071] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.565287] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.565549] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:23f6e2a5-7c71-4fc2-b43b-8119857d172e already deleted. [ 748.566030] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-23f6e2a5-7c71-4fc2-b43b-8119857d172e" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.716778] env[69980]: INFO networking_nsxv3.common.synchronization [req-a0420085-2ea4-49e6-9beb-735b290afbb3 req-8d6f4db9-00a6-4b3b-a0aa-9bf7de500b23 tempest-VolumesAdminNegativeTest-1476822754 tempest-VolumesAdminNegativeTest-1476822754-project-member] Enqueued Resource ID: 100806a5-6fdb-4512-83e3-fc77cac134dd with Priority: HIGHEST for action security_group_members [ 748.716778] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 100806a5-6fdb-4512-83e3-fc77cac134dd with Priority: HIGHEST for action security_group_members [ 748.716778] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-100806a5-6fdb-4512-83e3-fc77cac134dd taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.716778] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-100806a5-6fdb-4512-83e3-fc77cac134dd" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.716778] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-100806a5-6fdb-4512-83e3-fc77cac134dd" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.716778] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-100806a5-6fdb-4512-83e3-fc77cac134dd" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.717604] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.717748] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.717748] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.717936] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.718050] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.718158] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('100806a5-6fdb-4512-83e3-fc77cac134dd',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 749.127680] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1340506f-247e-457d-b5d5-d9db4d9c0250 in Status: SUCCESS [ 749.127680] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1340506f-247e-457d-b5d5-d9db4d9c0250" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.127954] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1340506f-247e-457d-b5d5-d9db4d9c0250" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.127954] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1340506f-247e-457d-b5d5-d9db4d9c0250" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.128160] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.128286] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.128353] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.128537] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.128627] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.128743] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1340506f-247e-457d-b5d5-d9db4d9c0250',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 749.220182] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.220355] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.220427] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.220674] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.220762] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.220970] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.221090] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.221154] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.221327] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.221410] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.221502] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 100806a5-6fdb-4512-83e3-fc77cac134dd already deleted. [ 749.221582] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-100806a5-6fdb-4512-83e3-fc77cac134dd" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.468202] env[69980]: INFO networking_nsxv3.common.synchronization [req-ba98b5d8-8fed-4527-9bb5-86406d714db6 req-099bc74c-a80b-4533-ae87-13791789cb8f service nova] Enqueued Resource ID: 462431af-62e3-426c-a50e-a61604f20358 with Priority: HIGHEST for action security_group_rules [ 749.468411] env[69980]: INFO networking_nsxv3.common.synchronization [req-ba98b5d8-8fed-4527-9bb5-86406d714db6 req-099bc74c-a80b-4533-ae87-13791789cb8f service nova] Enqueued Resource ID: 462431af-62e3-426c-a50e-a61604f20358 with Priority: HIGHEST for action security_group_members [ 749.468528] env[69980]: INFO networking_nsxv3.common.synchronization [req-ba98b5d8-8fed-4527-9bb5-86406d714db6 req-099bc74c-a80b-4533-ae87-13791789cb8f service nova] Enqueued Resource ID: 6fd2b3c5-d441-4079-8ecc-715a4c3da32d with Priority: HIGHEST for action port [ 749.468811] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 462431af-62e3-426c-a50e-a61604f20358 with Priority: HIGHEST for action security_group_rules [ 749.468811] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 462431af-62e3-426c-a50e-a61604f20358 with Priority: HIGHEST for action security_group_members [ 749.469106] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6fd2b3c5-d441-4079-8ecc-715a4c3da32d with Priority: HIGHEST for action port [ 749.470999] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock rules-462431af-62e3-426c-a50e-a61604f20358 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.470999] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-462431af-62e3-426c-a50e-a61604f20358" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.471152] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-462431af-62e3-426c-a50e-a61604f20358" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.471411] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-462431af-62e3-426c-a50e-a61604f20358" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.471626] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('462431af-62e3-426c-a50e-a61604f20358',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 749.474301] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-462431af-62e3-426c-a50e-a61604f20358 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.474703] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-462431af-62e3-426c-a50e-a61604f20358" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.474703] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-462431af-62e3-426c-a50e-a61604f20358" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.474703] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-462431af-62e3-426c-a50e-a61604f20358" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.475103] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.475842] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.475946] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.476154] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.476222] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.477106] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('462431af-62e3-426c-a50e-a61604f20358',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 749.478465] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock port-6fd2b3c5-d441-4079-8ecc-715a4c3da32d taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.478581] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6fd2b3c5-d441-4079-8ecc-715a4c3da32d" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.478638] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6fd2b3c5-d441-4079-8ecc-715a4c3da32d" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.478881] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6fd2b3c5-d441-4079-8ecc-715a4c3da32d" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.478881] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6fd2b3c5-d441-4079-8ecc-715a4c3da32d',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 749.632368] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1340506f-247e-457d-b5d5-d9db4d9c0250',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 749.755290] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock network-131 taken with stack trace [, , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.755542] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "network-131" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.755625] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "network-131" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.756069] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "network-131" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.756328] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.756419] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.756814] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.756814] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.757044] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.760382] env[69980]: DEBUG dogpile.cache.region [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] No value present for key: 'zone-id' {{(pid=69980) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 749.760527] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] NeedRegenerationException {{(pid=69980) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 749.760638] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] no value, waiting for create lock {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 749.760747] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] value creation lock acquired {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 749.760859] env[69980]: DEBUG dogpile.cache.region [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] No value present for key: 'zone-id' {{(pid=69980) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 749.760961] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Calling creation function for not-yet-present value {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 749.761148] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 749.790679] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 749.791364] env[69980]: DEBUG dogpile.cache.region [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Cache value generated in 0.030 seconds for key(s): 'zone-id' {{(pid=69980) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 749.791364] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Released creation lock {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 749.791364] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "network-131" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.791585] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock port-aebcdc36-727b-4de0-a444-2c7b8facfdee taken with stack trace [, , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.791860] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "port-aebcdc36-727b-4de0-a444-2c7b8facfdee" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.791901] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "port-aebcdc36-727b-4de0-a444-2c7b8facfdee" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.795782] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "port-aebcdc36-727b-4de0-a444-2c7b8facfdee" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.795782] env[69980]: DEBUG networking_nsxv3.api.rpc [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('aebcdc36-727b-4de0-a444-2c7b8facfdee',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 749.974025] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-462431af-62e3-426c-a50e-a61604f20358 taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.974025] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-462431af-62e3-426c-a50e-a61604f20358" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.980379] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('462431af-62e3-426c-a50e-a61604f20358',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 749.984669] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 6fd2b3c5-d441-4079-8ecc-715a4c3da32d with status ACTIVE [ 749.985936] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.985936] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.985936] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.985936] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.985936] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.985936] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.985936] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.985936] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.985936] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.987042] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.987042] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.987042] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.987042] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.987042] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.987042] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.987042] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 6fd2b3c5-d441-4079-8ecc-715a4c3da32d is going to be updated. [ 750.006115] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.006583] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.006660] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.007498] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.007498] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.007498] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6fd2b3c5-d441-4079-8ecc-715a4c3da32d" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.137481] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1340506f-247e-457d-b5d5-d9db4d9c0250',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 750.296896] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.297278] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.297444] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.297798] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.297951] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.298226] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Segment Port aebcdc36-727b-4de0-a444-2c7b8facfdee not found, creating... [ 750.298634] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.298912] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.300285] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.303505] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.303505] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.303505] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.303505] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.303505] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.303505] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.303505] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.303505] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Resource: SegmentPort with ID: aebcdc36-727b-4de0-a444-2c7b8facfdee is going to be created. [ 750.329406] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.329628] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.329689] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.329950] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.330495] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.330734] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "port-aebcdc36-727b-4de0-a444-2c7b8facfdee" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.491985] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('462431af-62e3-426c-a50e-a61604f20358',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 750.640491] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.640852] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.640852] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.641156] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.641156] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.641564] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1340506f-247e-457d-b5d5-d9db4d9c0250 is going to be updated. [ 750.668069] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.668218] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.668295] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.668549] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.668757] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.679538] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1340506f-247e-457d-b5d5-d9db4d9c0250 in Status: IN_PROGRESS for 2s [ 751.000023] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.000023] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.000023] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.000023] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.000023] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.000023] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 462431af-62e3-426c-a50e-a61604f20358 is going to be created. [ 751.007828] env[69980]: INFO networking_nsxv3.common.synchronization [None req-17360c05-abe0-4c0b-8092-4e872efd7ebb None None] Enqueued Resource ID: f563b322-3ca7-4304-b47d-89a90a6a95ba with Priority: HIGHEST for action port [ 751.007828] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f563b322-3ca7-4304-b47d-89a90a6a95ba with Priority: HIGHEST for action port [ 751.007828] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock port-f563b322-3ca7-4304-b47d-89a90a6a95ba taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.007828] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f563b322-3ca7-4304-b47d-89a90a6a95ba" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.007828] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f563b322-3ca7-4304-b47d-89a90a6a95ba" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.007828] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f563b322-3ca7-4304-b47d-89a90a6a95ba" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.007828] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f563b322-3ca7-4304-b47d-89a90a6a95ba',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 751.020459] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.020459] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.020459] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.020770] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.020858] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.035119] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 462431af-62e3-426c-a50e-a61604f20358 in Status: UNINITIALIZED for 2s [ 751.517967] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f563b322-3ca7-4304-b47d-89a90a6a95ba [ 751.518269] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.518416] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.518503] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.518717] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.518801] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.522019] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f563b322-3ca7-4304-b47d-89a90a6a95ba already deleted. [ 751.522019] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f563b322-3ca7-4304-b47d-89a90a6a95ba" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.575053] env[69980]: INFO networking_nsxv3.common.synchronization [None req-3b4cb3b8-bce2-4084-80ac-04cb150d5278 tempest-ServersV294TestFqdnHostnames-550580335 tempest-ServersV294TestFqdnHostnames-550580335-project-member] Enqueued Resource ID: 61b51096-066e-4c5d-b696-b9c061599dcc with Priority: HIGHEST for action security_group_rules [ 751.575598] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 61b51096-066e-4c5d-b696-b9c061599dcc with Priority: HIGHEST for action security_group_rules [ 751.575941] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock rules-61b51096-066e-4c5d-b696-b9c061599dcc taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.577141] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-61b51096-066e-4c5d-b696-b9c061599dcc" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.577236] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-61b51096-066e-4c5d-b696-b9c061599dcc" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.577494] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-61b51096-066e-4c5d-b696-b9c061599dcc" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.577581] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('61b51096-066e-4c5d-b696-b9c061599dcc',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 751.763485] env[69980]: INFO networking_nsxv3.common.synchronization [None req-6ea69d9d-4f00-46ae-9f56-4c146d101c3e None None] Enqueued Resource ID: 40c83047-189d-4479-81cc-d18ca4b341b2 with Priority: HIGHEST for action port [ 751.764303] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 40c83047-189d-4479-81cc-d18ca4b341b2 with Priority: HIGHEST for action port [ 751.764376] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock port-40c83047-189d-4479-81cc-d18ca4b341b2 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.764481] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-40c83047-189d-4479-81cc-d18ca4b341b2" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.764547] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-40c83047-189d-4479-81cc-d18ca4b341b2" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.764868] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-40c83047-189d-4479-81cc-d18ca4b341b2" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.764952] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('40c83047-189d-4479-81cc-d18ca4b341b2',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 751.918347] env[69980]: INFO networking_nsxv3.common.synchronization [req-a0420085-2ea4-49e6-9beb-735b290afbb3 req-99c74028-a0a2-4e8b-adbe-30f71a68d837 service nova] Enqueued Resource ID: 100806a5-6fdb-4512-83e3-fc77cac134dd with Priority: HIGHEST for action security_group_rules [ 751.918347] env[69980]: INFO networking_nsxv3.common.synchronization [req-a0420085-2ea4-49e6-9beb-735b290afbb3 req-99c74028-a0a2-4e8b-adbe-30f71a68d837 service nova] Enqueued Resource ID: 100806a5-6fdb-4512-83e3-fc77cac134dd with Priority: HIGHEST for action security_group_members [ 751.918347] env[69980]: INFO networking_nsxv3.common.synchronization [req-a0420085-2ea4-49e6-9beb-735b290afbb3 req-99c74028-a0a2-4e8b-adbe-30f71a68d837 service nova] Enqueued Resource ID: aebcdc36-727b-4de0-a444-2c7b8facfdee with Priority: HIGHEST for action port [ 751.918347] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 100806a5-6fdb-4512-83e3-fc77cac134dd with Priority: HIGHEST for action security_group_rules [ 751.918347] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 100806a5-6fdb-4512-83e3-fc77cac134dd with Priority: HIGHEST for action security_group_members [ 751.918347] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aebcdc36-727b-4de0-a444-2c7b8facfdee with Priority: HIGHEST for action port [ 751.918347] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock rules-100806a5-6fdb-4512-83e3-fc77cac134dd taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.919058] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-100806a5-6fdb-4512-83e3-fc77cac134dd" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.919097] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-100806a5-6fdb-4512-83e3-fc77cac134dd" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.919646] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-100806a5-6fdb-4512-83e3-fc77cac134dd" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.919646] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('100806a5-6fdb-4512-83e3-fc77cac134dd',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 751.920554] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-100806a5-6fdb-4512-83e3-fc77cac134dd taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.920707] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-100806a5-6fdb-4512-83e3-fc77cac134dd" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.920801] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-100806a5-6fdb-4512-83e3-fc77cac134dd" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.921025] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-100806a5-6fdb-4512-83e3-fc77cac134dd" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.921206] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.921418] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.921418] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.921635] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.922825] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.924692] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('100806a5-6fdb-4512-83e3-fc77cac134dd',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 751.924797] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock port-aebcdc36-727b-4de0-a444-2c7b8facfdee taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.924912] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-aebcdc36-727b-4de0-a444-2c7b8facfdee" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.924980] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-aebcdc36-727b-4de0-a444-2c7b8facfdee" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.925210] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-aebcdc36-727b-4de0-a444-2c7b8facfdee" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.925531] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('aebcdc36-727b-4de0-a444-2c7b8facfdee',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 751.930535] env[69980]: INFO networking_nsxv3.common.synchronization [None req-70c49ee6-c4f3-45b0-b19f-47904af2b184 tempest-ServersV294TestFqdnHostnames-550580335 tempest-ServersV294TestFqdnHostnames-550580335-project-member] Enqueued Resource ID: 61b51096-066e-4c5d-b696-b9c061599dcc with Priority: HIGHEST for action security_group_rules [ 751.931012] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 61b51096-066e-4c5d-b696-b9c061599dcc with Priority: HIGHEST for action security_group_rules [ 751.932073] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock rules-61b51096-066e-4c5d-b696-b9c061599dcc taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.932073] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-61b51096-066e-4c5d-b696-b9c061599dcc" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.105222] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.105222] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.105222] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.105222] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.105222] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.105222] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 61b51096-066e-4c5d-b696-b9c061599dcc already deleted. [ 752.105222] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-61b51096-066e-4c5d-b696-b9c061599dcc" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.105222] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-61b51096-066e-4c5d-b696-b9c061599dcc" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.105222] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-61b51096-066e-4c5d-b696-b9c061599dcc" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.105222] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('61b51096-066e-4c5d-b696-b9c061599dcc',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 752.184058] env[69980]: INFO networking_nsxv3.common.synchronization [req-e8350e3d-2533-43f1-bc0d-90a19bd4fa2d req-30baa2d1-f3b4-49e8-9bab-d859cb02f728 tempest-ServerDiagnosticsTest-1264243932 tempest-ServerDiagnosticsTest-1264243932-project-member] Enqueued Resource ID: 6719a83d-3363-4339-a277-6e1ec27ec7bc with Priority: HIGHEST for action security_group_members [ 752.184200] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6719a83d-3363-4339-a277-6e1ec27ec7bc with Priority: HIGHEST for action security_group_members [ 752.184665] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-6719a83d-3363-4339-a277-6e1ec27ec7bc taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.184818] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6719a83d-3363-4339-a277-6e1ec27ec7bc" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.184966] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6719a83d-3363-4339-a277-6e1ec27ec7bc" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.185221] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6719a83d-3363-4339-a277-6e1ec27ec7bc" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.185365] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.185486] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.185534] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.185684] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.185768] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.185887] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6719a83d-3363-4339-a277-6e1ec27ec7bc',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 752.270114] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 40c83047-189d-4479-81cc-d18ca4b341b2 [ 752.270370] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.270586] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.270586] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.270789] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.270882] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.270981] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:40c83047-189d-4479-81cc-d18ca4b341b2 already deleted. [ 752.271122] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-40c83047-189d-4479-81cc-d18ca4b341b2" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.427567] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-100806a5-6fdb-4512-83e3-fc77cac134dd taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.427567] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-100806a5-6fdb-4512-83e3-fc77cac134dd" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.430691] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('100806a5-6fdb-4512-83e3-fc77cac134dd',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 752.431868] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port aebcdc36-727b-4de0-a444-2c7b8facfdee with status ACTIVE [ 752.432049] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.432195] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.432228] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.432511] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.432595] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.432821] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.432921] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.432969] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.433139] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.433334] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.433407] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.433622] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.433622] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.433745] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.433830] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.433875] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: aebcdc36-727b-4de0-a444-2c7b8facfdee is going to be updated. [ 752.455531] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.455531] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.455531] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.455755] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.455980] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.456269] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-aebcdc36-727b-4de0-a444-2c7b8facfdee" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.621331] env[69980]: INFO networking_nsxv3.common.synchronization [None req-78a9ccb9-3054-454a-8ea8-8b51101215bb None None] Enqueued Resource ID: 4aa41726-f1b3-42c7-8cb0-c497cc342f4a with Priority: HIGHEST for action port [ 752.622310] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4aa41726-f1b3-42c7-8cb0-c497cc342f4a with Priority: HIGHEST for action port [ 752.622571] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock port-4aa41726-f1b3-42c7-8cb0-c497cc342f4a taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.622571] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4aa41726-f1b3-42c7-8cb0-c497cc342f4a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.623492] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4aa41726-f1b3-42c7-8cb0-c497cc342f4a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.623492] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4aa41726-f1b3-42c7-8cb0-c497cc342f4a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.623492] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4aa41726-f1b3-42c7-8cb0-c497cc342f4a',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 752.628176] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.628341] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.628910] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.629187] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.629410] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.629410] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 61b51096-066e-4c5d-b696-b9c061599dcc already deleted. [ 752.629700] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-61b51096-066e-4c5d-b696-b9c061599dcc" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.688602] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.689037] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.689037] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.689037] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.689201] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.689363] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.689460] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.689836] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.689836] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.689836] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.689836] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6719a83d-3363-4339-a277-6e1ec27ec7bc already deleted. [ 752.689958] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6719a83d-3363-4339-a277-6e1ec27ec7bc" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.691687] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1340506f-247e-457d-b5d5-d9db4d9c0250 in Status: SUCCESS [ 752.691807] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1340506f-247e-457d-b5d5-d9db4d9c0250" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.692656] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1340506f-247e-457d-b5d5-d9db4d9c0250" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.692933] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1340506f-247e-457d-b5d5-d9db4d9c0250" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.692993] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.693248] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.693248] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.693379] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.693426] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.693484] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1340506f-247e-457d-b5d5-d9db4d9c0250" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.693668] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-1340506f-247e-457d-b5d5-d9db4d9c0250 taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.693773] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1340506f-247e-457d-b5d5-d9db4d9c0250" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.693831] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1340506f-247e-457d-b5d5-d9db4d9c0250" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.694012] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1340506f-247e-457d-b5d5-d9db4d9c0250" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.694460] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.694460] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.694460] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.694460] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.694808] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.694808] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1340506f-247e-457d-b5d5-d9db4d9c0250" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.694808] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1340506f-247e-457d-b5d5-d9db4d9c0250',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 752.936066] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('100806a5-6fdb-4512-83e3-fc77cac134dd',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 753.047698] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 462431af-62e3-426c-a50e-a61604f20358 in Status: SUCCESS [ 753.048552] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-462431af-62e3-426c-a50e-a61604f20358" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.048552] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-462431af-62e3-426c-a50e-a61604f20358" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.048552] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-462431af-62e3-426c-a50e-a61604f20358" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.048707] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.050179] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.050179] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.050179] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.050179] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.050179] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-462431af-62e3-426c-a50e-a61604f20358" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.050179] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('462431af-62e3-426c-a50e-a61604f20358',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 753.127063] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 4aa41726-f1b3-42c7-8cb0-c497cc342f4a [ 753.127063] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.127063] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.127063] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.127063] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.127063] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.127063] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:4aa41726-f1b3-42c7-8cb0-c497cc342f4a already deleted. [ 753.127063] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4aa41726-f1b3-42c7-8cb0-c497cc342f4a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.198445] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1340506f-247e-457d-b5d5-d9db4d9c0250: rpc.has_security_group_logging(os_id): False [ 753.219633] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.219781] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.219781] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.220328] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.221702] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.222401] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.222401] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.222401] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.222401] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.222604] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.224334] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.224334] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.224334] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.224334] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.224334] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.224334] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.224334] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.224334] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.224686] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.224686] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.224814] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1340506f-247e-457d-b5d5-d9db4d9c0250 is going to be updated. [ 753.283380] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.283380] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.283380] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.283732] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.283732] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.297706] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1340506f-247e-457d-b5d5-d9db4d9c0250 in Status: IN_PROGRESS for 2s [ 753.441576] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.441576] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.441576] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.441576] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.441576] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.441576] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 100806a5-6fdb-4512-83e3-fc77cac134dd is going to be created. [ 753.481228] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.481416] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.481490] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.481713] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.481887] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.495877] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 100806a5-6fdb-4512-83e3-fc77cac134dd in Status: UNINITIALIZED for 2s [ 753.556166] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-462431af-62e3-426c-a50e-a61604f20358 taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.556166] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-462431af-62e3-426c-a50e-a61604f20358" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.556166] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-462431af-62e3-426c-a50e-a61604f20358" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.556166] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-462431af-62e3-426c-a50e-a61604f20358" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.556166] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.556166] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.556166] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.556166] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.556166] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.556166] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-462431af-62e3-426c-a50e-a61604f20358" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.556166] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-462431af-62e3-426c-a50e-a61604f20358 taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.556166] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-462431af-62e3-426c-a50e-a61604f20358" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.556166] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-462431af-62e3-426c-a50e-a61604f20358" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.556166] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-462431af-62e3-426c-a50e-a61604f20358" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.556166] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.556166] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.556922] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.556922] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.556922] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.556922] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-462431af-62e3-426c-a50e-a61604f20358" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.558917] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('462431af-62e3-426c-a50e-a61604f20358',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 753.918232] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock network-557 taken with stack trace [, , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.918232] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "network-557" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.918383] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "network-557" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.918753] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "network-557" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.919038] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.919419] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.919588] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.920480] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.920558] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.920934] env[69980]: DEBUG dogpile.cache.region [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] No value present for key: 'zone-id' {{(pid=69980) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 753.921095] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] NeedRegenerationException {{(pid=69980) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 753.921240] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] no value, waiting for create lock {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 753.921315] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] value creation lock acquired {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 753.921427] env[69980]: DEBUG dogpile.cache.region [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] No value present for key: 'zone-id' {{(pid=69980) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 753.921530] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Calling creation function for not-yet-present value {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 753.921780] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 753.942478] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 753.942841] env[69980]: DEBUG dogpile.cache.region [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=69980) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 753.942841] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Released creation lock {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 753.943154] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "network-557" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.943481] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock port-90a2426a-69ab-4eec-9d8c-b0392e15c70e taken with stack trace [, , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.943708] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "port-90a2426a-69ab-4eec-9d8c-b0392e15c70e" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.943866] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "port-90a2426a-69ab-4eec-9d8c-b0392e15c70e" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.944368] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "port-90a2426a-69ab-4eec-9d8c-b0392e15c70e" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.944491] env[69980]: DEBUG networking_nsxv3.api.rpc [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('90a2426a-69ab-4eec-9d8c-b0392e15c70e',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 754.060526] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 462431af-62e3-426c-a50e-a61604f20358: rpc.has_security_group_logging(os_id): False [ 754.080091] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.080269] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.081182] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.081182] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.081182] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.081182] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.081182] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.084710] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.084928] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.085039] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.085263] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.085369] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.085436] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.085675] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.085675] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.085858] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.085952] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.086020] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.086571] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.086571] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.086571] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 462431af-62e3-426c-a50e-a61604f20358 is going to be created. [ 754.166885] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.167046] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.167126] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.167720] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.167720] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.182751] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 462431af-62e3-426c-a50e-a61604f20358 in Status: IN_PROGRESS for 2s [ 754.448378] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.450724] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.451022] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.451304] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.451452] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.451959] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Segment Port 90a2426a-69ab-4eec-9d8c-b0392e15c70e not found, creating... [ 754.453864] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.453864] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.453864] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.453864] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.453864] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.454654] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.454654] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.454793] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.455708] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.455888] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.455947] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Resource: SegmentPort with ID: 90a2426a-69ab-4eec-9d8c-b0392e15c70e is going to be created. [ 754.477041] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.477709] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.477709] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.477709] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.478116] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.478420] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "port-90a2426a-69ab-4eec-9d8c-b0392e15c70e" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.526587] env[69980]: INFO networking_nsxv3.common.synchronization [req-303cda09-9e35-43bb-89ea-c071e75e3369 req-95a385fb-8d55-44e8-afe6-ec3e0a0d9228 tempest-ServerDiskConfigTestJSON-214268531 tempest-ServerDiskConfigTestJSON-214268531-project-member] Enqueued Resource ID: 0dbf2bcd-0572-43ef-b18d-cc3cca7fcfd5 with Priority: HIGHEST for action security_group_members [ 754.527444] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0dbf2bcd-0572-43ef-b18d-cc3cca7fcfd5 with Priority: HIGHEST for action security_group_members [ 754.528686] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-0dbf2bcd-0572-43ef-b18d-cc3cca7fcfd5 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.528799] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0dbf2bcd-0572-43ef-b18d-cc3cca7fcfd5" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.528902] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0dbf2bcd-0572-43ef-b18d-cc3cca7fcfd5" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.529241] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0dbf2bcd-0572-43ef-b18d-cc3cca7fcfd5" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.529463] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.529625] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.529734] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.529954] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.530118] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.530268] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0dbf2bcd-0572-43ef-b18d-cc3cca7fcfd5',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 755.032757] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.033077] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.033077] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.033219] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.033552] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.033552] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.033678] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.033678] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.033941] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.033941] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.034037] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0dbf2bcd-0572-43ef-b18d-cc3cca7fcfd5 already deleted. [ 755.034132] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0dbf2bcd-0572-43ef-b18d-cc3cca7fcfd5" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.313925] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1340506f-247e-457d-b5d5-d9db4d9c0250 in Status: SUCCESS [ 755.314161] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1340506f-247e-457d-b5d5-d9db4d9c0250" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.314348] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1340506f-247e-457d-b5d5-d9db4d9c0250" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.314553] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1340506f-247e-457d-b5d5-d9db4d9c0250" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.314639] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1340506f-247e-457d-b5d5-d9db4d9c0250',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 755.345691] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock network-932 taken with stack trace [, , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.345971] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "network-932" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.346079] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "network-932" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.346399] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "network-932" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.346667] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.346892] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.346947] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.347163] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.347332] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.347544] env[69980]: DEBUG dogpile.cache.region [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] No value present for key: 'zone-id' {{(pid=69980) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 755.347939] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] NeedRegenerationException {{(pid=69980) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 755.347939] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] no value, waiting for create lock {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 755.347939] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] value creation lock acquired {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 755.348496] env[69980]: DEBUG dogpile.cache.region [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] No value present for key: 'zone-id' {{(pid=69980) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 755.348496] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Calling creation function for not-yet-present value {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 755.348496] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 755.376475] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 755.376780] env[69980]: DEBUG dogpile.cache.region [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Cache value generated in 0.028 seconds for key(s): 'zone-id' {{(pid=69980) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 755.376996] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Released creation lock {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 755.377569] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "network-932" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.377809] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock port-42f3f79a-9b50-4e77-8332-60932c7e2291 taken with stack trace [, , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.380154] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "port-42f3f79a-9b50-4e77-8332-60932c7e2291" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.380154] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "port-42f3f79a-9b50-4e77-8332-60932c7e2291" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.380154] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "port-42f3f79a-9b50-4e77-8332-60932c7e2291" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.380154] env[69980]: DEBUG networking_nsxv3.api.rpc [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('42f3f79a-9b50-4e77-8332-60932c7e2291',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 755.388033] env[69980]: INFO networking_nsxv3.common.synchronization [None req-8e486d37-62f2-47e9-958d-db941379150d None None] Enqueued Resource ID: 2c3722fb-cb8b-4da2-9828-ceaec55a08a8 with Priority: HIGHEST for action port [ 755.390339] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2c3722fb-cb8b-4da2-9828-ceaec55a08a8 with Priority: HIGHEST for action port [ 755.390339] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock port-2c3722fb-cb8b-4da2-9828-ceaec55a08a8 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.390339] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2c3722fb-cb8b-4da2-9828-ceaec55a08a8" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.390339] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2c3722fb-cb8b-4da2-9828-ceaec55a08a8" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.390598] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2c3722fb-cb8b-4da2-9828-ceaec55a08a8" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.390818] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2c3722fb-cb8b-4da2-9828-ceaec55a08a8',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 755.505087] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 100806a5-6fdb-4512-83e3-fc77cac134dd in Status: SUCCESS [ 755.505317] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-100806a5-6fdb-4512-83e3-fc77cac134dd" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.505522] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-100806a5-6fdb-4512-83e3-fc77cac134dd" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.505752] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-100806a5-6fdb-4512-83e3-fc77cac134dd" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.506033] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.506171] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.506224] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.506368] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.506450] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.506550] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-100806a5-6fdb-4512-83e3-fc77cac134dd" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.506647] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('100806a5-6fdb-4512-83e3-fc77cac134dd',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 755.574080] env[69980]: INFO networking_nsxv3.common.synchronization [None req-625a4f9b-94fb-4c53-8f21-72733f44889e None None] Enqueued Resource ID: 68ec6fb8-88ea-42ce-9fcd-64fb1f815e55 with Priority: HIGHEST for action port [ 755.576146] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 68ec6fb8-88ea-42ce-9fcd-64fb1f815e55 with Priority: HIGHEST for action port [ 755.576146] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock port-68ec6fb8-88ea-42ce-9fcd-64fb1f815e55 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.576146] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-68ec6fb8-88ea-42ce-9fcd-64fb1f815e55" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.576146] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-68ec6fb8-88ea-42ce-9fcd-64fb1f815e55" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.576146] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-68ec6fb8-88ea-42ce-9fcd-64fb1f815e55" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.576146] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('68ec6fb8-88ea-42ce-9fcd-64fb1f815e55',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 755.816897] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-1340506f-247e-457d-b5d5-d9db4d9c0250 taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.817094] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1340506f-247e-457d-b5d5-d9db4d9c0250" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.817166] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1340506f-247e-457d-b5d5-d9db4d9c0250" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.817390] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1340506f-247e-457d-b5d5-d9db4d9c0250" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.817556] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.817660] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.817724] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.817874] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.818028] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.818061] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1340506f-247e-457d-b5d5-d9db4d9c0250" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.818145] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1340506f-247e-457d-b5d5-d9db4d9c0250',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 755.883508] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.883849] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.883938] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.884195] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.884331] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.884608] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Segment Port 42f3f79a-9b50-4e77-8332-60932c7e2291 not found, creating... [ 755.884835] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.885062] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.885193] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.885440] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.885639] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.886317] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.886583] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.886858] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.887189] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.887651] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.887651] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Resource: SegmentPort with ID: 42f3f79a-9b50-4e77-8332-60932c7e2291 is going to be created. [ 755.893049] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 2c3722fb-cb8b-4da2-9828-ceaec55a08a8 [ 755.893269] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.893425] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.893728] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.893814] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.893926] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.894050] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:2c3722fb-cb8b-4da2-9828-ceaec55a08a8 already deleted. [ 755.894140] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2c3722fb-cb8b-4da2-9828-ceaec55a08a8" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.909863] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.910133] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.910283] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.910642] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.910818] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.911334] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "port-42f3f79a-9b50-4e77-8332-60932c7e2291" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.963140] env[69980]: INFO networking_nsxv3.common.synchronization [req-e8350e3d-2533-43f1-bc0d-90a19bd4fa2d req-a3d5fe9b-e8a8-46d5-b41a-1b6a2d735475 service nova] Enqueued Resource ID: 6719a83d-3363-4339-a277-6e1ec27ec7bc with Priority: HIGHEST for action security_group_rules [ 755.963140] env[69980]: INFO networking_nsxv3.common.synchronization [req-e8350e3d-2533-43f1-bc0d-90a19bd4fa2d req-a3d5fe9b-e8a8-46d5-b41a-1b6a2d735475 service nova] Enqueued Resource ID: 6719a83d-3363-4339-a277-6e1ec27ec7bc with Priority: HIGHEST for action security_group_members [ 755.963140] env[69980]: INFO networking_nsxv3.common.synchronization [req-e8350e3d-2533-43f1-bc0d-90a19bd4fa2d req-a3d5fe9b-e8a8-46d5-b41a-1b6a2d735475 service nova] Enqueued Resource ID: 90a2426a-69ab-4eec-9d8c-b0392e15c70e with Priority: HIGHEST for action port [ 755.963362] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6719a83d-3363-4339-a277-6e1ec27ec7bc with Priority: HIGHEST for action security_group_rules [ 755.963490] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6719a83d-3363-4339-a277-6e1ec27ec7bc with Priority: HIGHEST for action security_group_members [ 755.963595] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 90a2426a-69ab-4eec-9d8c-b0392e15c70e with Priority: HIGHEST for action port [ 755.963878] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6719a83d-3363-4339-a277-6e1ec27ec7bc taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.964016] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6719a83d-3363-4339-a277-6e1ec27ec7bc" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.964684] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6719a83d-3363-4339-a277-6e1ec27ec7bc" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.965728] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6719a83d-3363-4339-a277-6e1ec27ec7bc" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.965728] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6719a83d-3363-4339-a277-6e1ec27ec7bc',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 755.966048] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-6719a83d-3363-4339-a277-6e1ec27ec7bc taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.966185] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6719a83d-3363-4339-a277-6e1ec27ec7bc" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.966287] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6719a83d-3363-4339-a277-6e1ec27ec7bc" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.966431] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6719a83d-3363-4339-a277-6e1ec27ec7bc" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.966542] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.966639] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.966701] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.966834] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.966914] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.967010] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6719a83d-3363-4339-a277-6e1ec27ec7bc',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 755.967782] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock port-90a2426a-69ab-4eec-9d8c-b0392e15c70e taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.967914] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-90a2426a-69ab-4eec-9d8c-b0392e15c70e" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.967977] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-90a2426a-69ab-4eec-9d8c-b0392e15c70e" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.970802] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-90a2426a-69ab-4eec-9d8c-b0392e15c70e" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.970802] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('90a2426a-69ab-4eec-9d8c-b0392e15c70e',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 756.009865] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('100806a5-6fdb-4512-83e3-fc77cac134dd',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 756.013211] env[69980]: INFO networking_nsxv3.common.synchronization [req-c1f24ec1-39f0-4837-a118-fd1558becf3f req-b9c21d3b-0201-4e0a-b216-5411d2120084 tempest-ServerExternalEventsTest-1880996192 tempest-ServerExternalEventsTest-1880996192-project-member] Enqueued Resource ID: c3e6d316-0225-4e87-99d5-6c58ff0694cb with Priority: HIGHEST for action security_group_members [ 756.013211] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c3e6d316-0225-4e87-99d5-6c58ff0694cb with Priority: HIGHEST for action security_group_members [ 756.013211] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-c3e6d316-0225-4e87-99d5-6c58ff0694cb taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.013760] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c3e6d316-0225-4e87-99d5-6c58ff0694cb" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.014122] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c3e6d316-0225-4e87-99d5-6c58ff0694cb" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.015479] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c3e6d316-0225-4e87-99d5-6c58ff0694cb" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.015479] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.015479] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.015479] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.015479] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.015479] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.015479] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c3e6d316-0225-4e87-99d5-6c58ff0694cb',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 756.078261] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 68ec6fb8-88ea-42ce-9fcd-64fb1f815e55 [ 756.078525] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.078649] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.078748] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.079027] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.079158] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.080455] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:68ec6fb8-88ea-42ce-9fcd-64fb1f815e55 already deleted. [ 756.080609] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-68ec6fb8-88ea-42ce-9fcd-64fb1f815e55" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.195264] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 462431af-62e3-426c-a50e-a61604f20358 in Status: SUCCESS [ 756.195498] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-462431af-62e3-426c-a50e-a61604f20358" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.288011] env[69980]: INFO networking_nsxv3.common.synchronization [None req-e7420741-1cd3-4cee-9055-6897ecbb1fd3 None None] Enqueued Resource ID: ec942416-42b5-4710-9274-e3cde80829cb with Priority: HIGHEST for action port [ 756.288011] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ec942416-42b5-4710-9274-e3cde80829cb with Priority: HIGHEST for action port [ 756.288011] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock port-ec942416-42b5-4710-9274-e3cde80829cb taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.288011] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ec942416-42b5-4710-9274-e3cde80829cb" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.288011] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ec942416-42b5-4710-9274-e3cde80829cb" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.288011] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ec942416-42b5-4710-9274-e3cde80829cb" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.288011] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ec942416-42b5-4710-9274-e3cde80829cb',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 756.323514] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-1340506f-247e-457d-b5d5-d9db4d9c0250 taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.323514] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1340506f-247e-457d-b5d5-d9db4d9c0250" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.323514] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1340506f-247e-457d-b5d5-d9db4d9c0250" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.323514] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1340506f-247e-457d-b5d5-d9db4d9c0250" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.323514] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.323514] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.323514] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.323514] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.323514] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.323514] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1340506f-247e-457d-b5d5-d9db4d9c0250" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.323514] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-1340506f-247e-457d-b5d5-d9db4d9c0250 taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.323514] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1340506f-247e-457d-b5d5-d9db4d9c0250" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.323514] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1340506f-247e-457d-b5d5-d9db4d9c0250" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.323514] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1340506f-247e-457d-b5d5-d9db4d9c0250" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.323514] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.323514] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.324145] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.324145] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.324145] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.324145] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1340506f-247e-457d-b5d5-d9db4d9c0250" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.324145] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1340506f-247e-457d-b5d5-d9db4d9c0250',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 756.469975] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6719a83d-3363-4339-a277-6e1ec27ec7bc',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 756.471678] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-6719a83d-3363-4339-a277-6e1ec27ec7bc taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.471825] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6719a83d-3363-4339-a277-6e1ec27ec7bc" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.472580] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 90a2426a-69ab-4eec-9d8c-b0392e15c70e with status ACTIVE [ 756.472782] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.472896] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.472962] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.473177] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.473388] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.477334] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.477452] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.477499] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.477681] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.477776] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.477983] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.478082] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.478143] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.478302] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.478379] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.478466] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 90a2426a-69ab-4eec-9d8c-b0392e15c70e is going to be updated. [ 756.501607] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.501826] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.501826] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.502060] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.502209] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.502379] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-90a2426a-69ab-4eec-9d8c-b0392e15c70e" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.511278] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 100806a5-6fdb-4512-83e3-fc77cac134dd: rpc.has_security_group_logging(os_id): False [ 756.518219] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.518392] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.518457] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.518656] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.518755] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.519033] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.519033] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.519205] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.519250] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.519323] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.519404] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c3e6d316-0225-4e87-99d5-6c58ff0694cb is going to be updated. [ 756.528708] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.529047] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.529047] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.529047] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.529282] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.529419] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.529513] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.529571] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.529715] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.529789] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.529871] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 100806a5-6fdb-4512-83e3-fc77cac134dd is going to be created. [ 756.551599] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.551755] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.551755] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.552013] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.552120] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.564034] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c3e6d316-0225-4e87-99d5-6c58ff0694cb in Status: IN_PROGRESS for 2s [ 756.601877] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.603072] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.603266] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.603540] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.603761] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.623058] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 100806a5-6fdb-4512-83e3-fc77cac134dd in Status: IN_PROGRESS for 2s [ 756.790386] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ec942416-42b5-4710-9274-e3cde80829cb [ 756.790677] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.790822] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.790888] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.791151] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.791254] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.791415] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ec942416-42b5-4710-9274-e3cde80829cb already deleted. [ 756.791504] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ec942416-42b5-4710-9274-e3cde80829cb" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.827549] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1340506f-247e-457d-b5d5-d9db4d9c0250: rpc.has_security_group_logging(os_id): False [ 756.849730] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.849730] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.849730] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.849854] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.849948] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.850157] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.850254] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.850315] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.850753] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.850753] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.850849] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.850849] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.850933] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.851724] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.851724] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.851724] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.851724] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.851724] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.851938] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.851938] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.852019] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1340506f-247e-457d-b5d5-d9db4d9c0250 is going to be updated. [ 756.909960] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.910095] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.910187] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.914569] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.914569] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.931230] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1340506f-247e-457d-b5d5-d9db4d9c0250 in Status: IN_PROGRESS for 2s [ 756.973180] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6719a83d-3363-4339-a277-6e1ec27ec7bc',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 757.013012] env[69980]: INFO networking_nsxv3.common.synchronization [None req-b2446243-6b6c-4d0b-a011-af1d692c07c0 None None] Enqueued Resource ID: 6d316256-f508-4215-b4d6-5a66a98c2a94 with Priority: HIGHEST for action port [ 757.013012] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6d316256-f508-4215-b4d6-5a66a98c2a94 with Priority: HIGHEST for action port [ 757.013012] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock port-6d316256-f508-4215-b4d6-5a66a98c2a94 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.013012] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6d316256-f508-4215-b4d6-5a66a98c2a94" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.013012] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6d316256-f508-4215-b4d6-5a66a98c2a94" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.013012] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6d316256-f508-4215-b4d6-5a66a98c2a94" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.013012] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6d316256-f508-4215-b4d6-5a66a98c2a94',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 757.483366] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.483366] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.483366] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.483366] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.483366] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.483366] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6719a83d-3363-4339-a277-6e1ec27ec7bc is going to be created. [ 757.483899] env[69980]: INFO networking_nsxv3.common.synchronization [req-303cda09-9e35-43bb-89ea-c071e75e3369 req-03e04dc5-a4ea-4be5-9e5d-458d6aa6e770 service nova] Enqueued Resource ID: 0dbf2bcd-0572-43ef-b18d-cc3cca7fcfd5 with Priority: HIGHEST for action security_group_rules [ 757.483931] env[69980]: INFO networking_nsxv3.common.synchronization [req-303cda09-9e35-43bb-89ea-c071e75e3369 req-03e04dc5-a4ea-4be5-9e5d-458d6aa6e770 service nova] Enqueued Resource ID: 0dbf2bcd-0572-43ef-b18d-cc3cca7fcfd5 with Priority: HIGHEST for action security_group_members [ 757.484070] env[69980]: INFO networking_nsxv3.common.synchronization [req-303cda09-9e35-43bb-89ea-c071e75e3369 req-03e04dc5-a4ea-4be5-9e5d-458d6aa6e770 service nova] Enqueued Resource ID: 42f3f79a-9b50-4e77-8332-60932c7e2291 with Priority: HIGHEST for action port [ 757.484645] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0dbf2bcd-0572-43ef-b18d-cc3cca7fcfd5 with Priority: HIGHEST for action security_group_rules [ 757.484743] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0dbf2bcd-0572-43ef-b18d-cc3cca7fcfd5 with Priority: HIGHEST for action security_group_members [ 757.484830] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 42f3f79a-9b50-4e77-8332-60932c7e2291 with Priority: HIGHEST for action port [ 757.485589] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0dbf2bcd-0572-43ef-b18d-cc3cca7fcfd5 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.485725] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0dbf2bcd-0572-43ef-b18d-cc3cca7fcfd5" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.485782] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0dbf2bcd-0572-43ef-b18d-cc3cca7fcfd5" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.486198] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0dbf2bcd-0572-43ef-b18d-cc3cca7fcfd5" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.487440] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0dbf2bcd-0572-43ef-b18d-cc3cca7fcfd5',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 757.488432] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-0dbf2bcd-0572-43ef-b18d-cc3cca7fcfd5 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.488553] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0dbf2bcd-0572-43ef-b18d-cc3cca7fcfd5" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.488553] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0dbf2bcd-0572-43ef-b18d-cc3cca7fcfd5" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.488752] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0dbf2bcd-0572-43ef-b18d-cc3cca7fcfd5" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.489195] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.489195] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.489195] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.489331] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.489331] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.496553] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0dbf2bcd-0572-43ef-b18d-cc3cca7fcfd5',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 757.496553] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock port-42f3f79a-9b50-4e77-8332-60932c7e2291 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.496553] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-42f3f79a-9b50-4e77-8332-60932c7e2291" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.496553] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-42f3f79a-9b50-4e77-8332-60932c7e2291" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.496553] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-42f3f79a-9b50-4e77-8332-60932c7e2291" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.496553] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('42f3f79a-9b50-4e77-8332-60932c7e2291',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 757.505265] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.505427] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.505493] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.506026] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.506026] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.517035] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6719a83d-3363-4339-a277-6e1ec27ec7bc in Status: UNINITIALIZED for 2s [ 757.517035] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 6d316256-f508-4215-b4d6-5a66a98c2a94 [ 757.517035] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.517035] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.517035] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.517035] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.517035] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.517035] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:6d316256-f508-4215-b4d6-5a66a98c2a94 already deleted. [ 757.517382] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6d316256-f508-4215-b4d6-5a66a98c2a94" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.992798] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-0dbf2bcd-0572-43ef-b18d-cc3cca7fcfd5 taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.992933] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0dbf2bcd-0572-43ef-b18d-cc3cca7fcfd5" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.993144] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0dbf2bcd-0572-43ef-b18d-cc3cca7fcfd5',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 757.994054] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 42f3f79a-9b50-4e77-8332-60932c7e2291 with status ACTIVE [ 757.994319] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.994437] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.994437] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.995069] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.995174] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.995349] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.995450] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.995515] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.995677] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.995831] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.998085] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.999544] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.999544] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.999544] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.999544] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.999544] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 42f3f79a-9b50-4e77-8332-60932c7e2291 is going to be updated. [ 758.018584] env[69980]: INFO networking_nsxv3.common.synchronization [req-c5c81711-3f88-4fc1-b06e-1b483769c9ba req-e3ae9ba8-f8e1-466d-89ec-3bc3f733acb2 tempest-SecurityGroupRulesNegativeTestJSON-835986164 tempest-SecurityGroupRulesNegativeTestJSON-835986164-project-member] Enqueued Resource ID: c32091cf-2cec-428d-bf0f-bb96269a8195 with Priority: HIGHEST for action security_group_rules [ 758.019287] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.019438] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.019503] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.019689] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.020054] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.020054] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-42f3f79a-9b50-4e77-8332-60932c7e2291" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.020571] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c32091cf-2cec-428d-bf0f-bb96269a8195 with Priority: HIGHEST for action security_group_rules [ 758.021263] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c32091cf-2cec-428d-bf0f-bb96269a8195 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.021263] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c32091cf-2cec-428d-bf0f-bb96269a8195" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.021263] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c32091cf-2cec-428d-bf0f-bb96269a8195" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.021263] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c32091cf-2cec-428d-bf0f-bb96269a8195" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.021543] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c32091cf-2cec-428d-bf0f-bb96269a8195',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 758.401354] env[69980]: INFO networking_nsxv3.common.synchronization [None req-a1863d42-e1df-46fa-a6c2-7ba1528afdd7 None None] Enqueued Resource ID: d41b5209-7cec-4383-af2a-19ebb382a1a5 with Priority: HIGHEST for action port [ 758.401580] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d41b5209-7cec-4383-af2a-19ebb382a1a5 with Priority: HIGHEST for action port [ 758.401860] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock port-d41b5209-7cec-4383-af2a-19ebb382a1a5 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.401988] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d41b5209-7cec-4383-af2a-19ebb382a1a5" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.402921] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d41b5209-7cec-4383-af2a-19ebb382a1a5" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.403247] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d41b5209-7cec-4383-af2a-19ebb382a1a5" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.403341] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d41b5209-7cec-4383-af2a-19ebb382a1a5',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 758.501085] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0dbf2bcd-0572-43ef-b18d-cc3cca7fcfd5',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 758.543392] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.544873] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.544873] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.544873] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.544873] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.544873] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c32091cf-2cec-428d-bf0f-bb96269a8195 already deleted. [ 758.544873] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c32091cf-2cec-428d-bf0f-bb96269a8195" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.573386] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c3e6d316-0225-4e87-99d5-6c58ff0694cb in Status: SUCCESS [ 758.573634] env[69980]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c3e6d316-0225-4e87-99d5-6c58ff0694cb deletion is rescheduled due to dependency. [ 758.573754] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c3e6d316-0225-4e87-99d5-6c58ff0694cb" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.634580] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 100806a5-6fdb-4512-83e3-fc77cac134dd in Status: SUCCESS [ 758.634800] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-100806a5-6fdb-4512-83e3-fc77cac134dd" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.742095] env[69980]: INFO networking_nsxv3.common.synchronization [None req-33ae146a-78ae-40f7-9a2d-88c9cb4d0e74 None None] Enqueued Resource ID: b5aeb167-9782-464e-8d57-8a20997ab0a1 with Priority: HIGHEST for action port [ 758.742095] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b5aeb167-9782-464e-8d57-8a20997ab0a1 with Priority: HIGHEST for action port [ 758.742095] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock port-b5aeb167-9782-464e-8d57-8a20997ab0a1 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.742095] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b5aeb167-9782-464e-8d57-8a20997ab0a1" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.742616] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b5aeb167-9782-464e-8d57-8a20997ab0a1" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.743014] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b5aeb167-9782-464e-8d57-8a20997ab0a1" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.743166] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b5aeb167-9782-464e-8d57-8a20997ab0a1',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 758.906388] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port d41b5209-7cec-4383-af2a-19ebb382a1a5 [ 758.906661] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.906917] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.906917] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.907434] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.907587] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.907860] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:d41b5209-7cec-4383-af2a-19ebb382a1a5 already deleted. [ 758.907995] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d41b5209-7cec-4383-af2a-19ebb382a1a5" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.945260] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1340506f-247e-457d-b5d5-d9db4d9c0250 in Status: SUCCESS [ 758.946594] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1340506f-247e-457d-b5d5-d9db4d9c0250" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.004202] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.004348] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.005353] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.005353] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.005353] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.005353] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0dbf2bcd-0572-43ef-b18d-cc3cca7fcfd5 is going to be created. [ 759.033732] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.033907] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.033944] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.034167] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.034326] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.047564] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0dbf2bcd-0572-43ef-b18d-cc3cca7fcfd5 in Status: UNINITIALIZED for 2s [ 759.154174] env[69980]: INFO networking_nsxv3.common.synchronization [None req-1168f509-b810-44c4-9a95-a2795b6505a4 None None] Enqueued Resource ID: 0f167f45-c0aa-4877-89a1-e11b5002951c with Priority: HIGHEST for action port [ 759.154648] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0f167f45-c0aa-4877-89a1-e11b5002951c with Priority: HIGHEST for action port [ 759.155130] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock port-0f167f45-c0aa-4877-89a1-e11b5002951c taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.155259] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0f167f45-c0aa-4877-89a1-e11b5002951c" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.155324] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0f167f45-c0aa-4877-89a1-e11b5002951c" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.155583] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0f167f45-c0aa-4877-89a1-e11b5002951c" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.156354] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0f167f45-c0aa-4877-89a1-e11b5002951c',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 759.246167] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b5aeb167-9782-464e-8d57-8a20997ab0a1 [ 759.246167] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.246167] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.246167] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.246167] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.246661] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.249027] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b5aeb167-9782-464e-8d57-8a20997ab0a1 already deleted. [ 759.249027] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b5aeb167-9782-464e-8d57-8a20997ab0a1" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.528615] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6719a83d-3363-4339-a277-6e1ec27ec7bc in Status: SUCCESS [ 759.528907] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6719a83d-3363-4339-a277-6e1ec27ec7bc" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.530317] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6719a83d-3363-4339-a277-6e1ec27ec7bc" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.531829] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6719a83d-3363-4339-a277-6e1ec27ec7bc" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.532079] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.532215] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.532642] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.532642] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.532642] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.532787] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6719a83d-3363-4339-a277-6e1ec27ec7bc" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.532787] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6719a83d-3363-4339-a277-6e1ec27ec7bc',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 759.657628] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 0f167f45-c0aa-4877-89a1-e11b5002951c [ 759.658180] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.658386] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.658461] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.658679] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.658895] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.658895] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:0f167f45-c0aa-4877-89a1-e11b5002951c already deleted. [ 759.659013] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0f167f45-c0aa-4877-89a1-e11b5002951c" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.038454] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-6719a83d-3363-4339-a277-6e1ec27ec7bc taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.038454] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6719a83d-3363-4339-a277-6e1ec27ec7bc" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.038454] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6719a83d-3363-4339-a277-6e1ec27ec7bc" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.038454] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6719a83d-3363-4339-a277-6e1ec27ec7bc" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.038454] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.038454] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.038454] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.038454] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.038454] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.038454] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6719a83d-3363-4339-a277-6e1ec27ec7bc" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.038454] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-6719a83d-3363-4339-a277-6e1ec27ec7bc taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.038454] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6719a83d-3363-4339-a277-6e1ec27ec7bc" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.038454] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6719a83d-3363-4339-a277-6e1ec27ec7bc" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.039187] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6719a83d-3363-4339-a277-6e1ec27ec7bc" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.039187] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.039187] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.039187] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.039187] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.039187] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.039407] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6719a83d-3363-4339-a277-6e1ec27ec7bc" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.039407] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6719a83d-3363-4339-a277-6e1ec27ec7bc',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 760.213017] env[69980]: INFO networking_nsxv3.common.synchronization [None req-4aab0492-16cf-424d-bc71-be7fc7a40f13 None None] Enqueued Resource ID: c8703793-0d30-4541-976d-dae82e139261 with Priority: HIGHEST for action port [ 760.213017] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c8703793-0d30-4541-976d-dae82e139261 with Priority: HIGHEST for action port [ 760.213017] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock port-c8703793-0d30-4541-976d-dae82e139261 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.213017] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c8703793-0d30-4541-976d-dae82e139261" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.213285] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c8703793-0d30-4541-976d-dae82e139261" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.213962] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c8703793-0d30-4541-976d-dae82e139261" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.213962] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c8703793-0d30-4541-976d-dae82e139261',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 760.543860] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6719a83d-3363-4339-a277-6e1ec27ec7bc: rpc.has_security_group_logging(os_id): False [ 760.563315] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.563494] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.563648] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.563929] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.564098] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.564357] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.564469] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.564576] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.564879] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.565000] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.565382] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.565498] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.565551] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.565764] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.565855] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.566129] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.566252] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.569179] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.569179] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.569179] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.569179] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6719a83d-3363-4339-a277-6e1ec27ec7bc is going to be created. [ 760.616645] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.616806] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.616873] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.617114] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.617327] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.627650] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6719a83d-3363-4339-a277-6e1ec27ec7bc in Status: IN_PROGRESS for 2s [ 760.716480] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port c8703793-0d30-4541-976d-dae82e139261 [ 760.716723] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.716876] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.717311] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.717311] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.717311] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.717812] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:c8703793-0d30-4541-976d-dae82e139261 already deleted. [ 760.717812] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c8703793-0d30-4541-976d-dae82e139261" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.057147] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0dbf2bcd-0572-43ef-b18d-cc3cca7fcfd5 in Status: SUCCESS [ 761.057147] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0dbf2bcd-0572-43ef-b18d-cc3cca7fcfd5" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.057147] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0dbf2bcd-0572-43ef-b18d-cc3cca7fcfd5" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.057291] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0dbf2bcd-0572-43ef-b18d-cc3cca7fcfd5" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.057455] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.057608] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.057687] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.057850] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.057962] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.058051] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0dbf2bcd-0572-43ef-b18d-cc3cca7fcfd5" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.058142] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('0dbf2bcd-0572-43ef-b18d-cc3cca7fcfd5',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 761.561056] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-0dbf2bcd-0572-43ef-b18d-cc3cca7fcfd5 taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.561356] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0dbf2bcd-0572-43ef-b18d-cc3cca7fcfd5" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.561356] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0dbf2bcd-0572-43ef-b18d-cc3cca7fcfd5" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.561519] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0dbf2bcd-0572-43ef-b18d-cc3cca7fcfd5" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.561700] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.561798] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.561862] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.562022] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.562142] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.562187] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0dbf2bcd-0572-43ef-b18d-cc3cca7fcfd5" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.562334] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-0dbf2bcd-0572-43ef-b18d-cc3cca7fcfd5 taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.562469] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0dbf2bcd-0572-43ef-b18d-cc3cca7fcfd5" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.562469] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0dbf2bcd-0572-43ef-b18d-cc3cca7fcfd5" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.562634] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0dbf2bcd-0572-43ef-b18d-cc3cca7fcfd5" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.562775] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.562869] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.562927] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.563570] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.563668] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.563758] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0dbf2bcd-0572-43ef-b18d-cc3cca7fcfd5" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.563850] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('0dbf2bcd-0572-43ef-b18d-cc3cca7fcfd5',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 761.768064] env[69980]: INFO networking_nsxv3.common.synchronization [req-4e0ee254-53a1-4315-93cd-3e28d132178a req-af2591aa-bf04-4d5a-a741-8bd4c24ab5ac tempest-SecurityGroupRulesNegativeTestJSON-835986164 tempest-SecurityGroupRulesNegativeTestJSON-835986164-project-member] Enqueued Resource ID: c32091cf-2cec-428d-bf0f-bb96269a8195 with Priority: HIGHEST for action security_group_rules [ 761.768551] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c32091cf-2cec-428d-bf0f-bb96269a8195 with Priority: HIGHEST for action security_group_rules [ 761.768855] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c32091cf-2cec-428d-bf0f-bb96269a8195 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.768970] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c32091cf-2cec-428d-bf0f-bb96269a8195" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.769136] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c32091cf-2cec-428d-bf0f-bb96269a8195" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.769258] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c32091cf-2cec-428d-bf0f-bb96269a8195" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.769366] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c32091cf-2cec-428d-bf0f-bb96269a8195',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 761.996343] env[69980]: INFO networking_nsxv3.common.synchronization [None req-eb67f7d0-0c54-4219-baf6-9a863a3fc8c8 None None] Enqueued Resource ID: 06139a10-1cfe-4dd9-a457-45b65622fa14 with Priority: HIGHEST for action port [ 761.996914] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 06139a10-1cfe-4dd9-a457-45b65622fa14 with Priority: HIGHEST for action port [ 761.997925] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock port-06139a10-1cfe-4dd9-a457-45b65622fa14 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.997925] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-06139a10-1cfe-4dd9-a457-45b65622fa14" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.997925] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-06139a10-1cfe-4dd9-a457-45b65622fa14" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.997925] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-06139a10-1cfe-4dd9-a457-45b65622fa14" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.997925] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('06139a10-1cfe-4dd9-a457-45b65622fa14',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 762.067775] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 0dbf2bcd-0572-43ef-b18d-cc3cca7fcfd5: rpc.has_security_group_logging(os_id): False [ 762.084437] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.084437] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.084637] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.084771] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.084885] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.085180] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.085299] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.085609] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.085609] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.085609] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.085964] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.085964] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.086095] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.086855] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.086855] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.086855] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.086855] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.086855] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.086855] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.087296] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.087296] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0dbf2bcd-0572-43ef-b18d-cc3cca7fcfd5 is going to be created. [ 762.152332] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.152332] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.152332] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.152332] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.152332] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.163628] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0dbf2bcd-0572-43ef-b18d-cc3cca7fcfd5 in Status: IN_PROGRESS for 2s [ 762.290677] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.290677] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.290677] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.290677] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.290677] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.290677] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c32091cf-2cec-428d-bf0f-bb96269a8195 already deleted. [ 762.290677] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c32091cf-2cec-428d-bf0f-bb96269a8195" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.500599] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 06139a10-1cfe-4dd9-a457-45b65622fa14 [ 762.500920] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.501090] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.501166] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.501403] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.501493] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.501591] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:06139a10-1cfe-4dd9-a457-45b65622fa14 already deleted. [ 762.501677] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-06139a10-1cfe-4dd9-a457-45b65622fa14" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.643237] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6719a83d-3363-4339-a277-6e1ec27ec7bc in Status: SUCCESS [ 762.643614] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6719a83d-3363-4339-a277-6e1ec27ec7bc" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.716406] env[69980]: INFO networking_nsxv3.common.synchronization [None req-d302f2ca-de85-449d-ba0b-51b0ebb6100c None None] Enqueued Resource ID: aad585ad-9afc-458b-9c3c-29d0d24082d5 with Priority: HIGHEST for action port [ 762.716679] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aad585ad-9afc-458b-9c3c-29d0d24082d5 with Priority: HIGHEST for action port [ 762.717238] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock port-aad585ad-9afc-458b-9c3c-29d0d24082d5 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.717352] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-aad585ad-9afc-458b-9c3c-29d0d24082d5" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.717415] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-aad585ad-9afc-458b-9c3c-29d0d24082d5" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.717711] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-aad585ad-9afc-458b-9c3c-29d0d24082d5" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.717794] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('aad585ad-9afc-458b-9c3c-29d0d24082d5',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 763.224260] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port aad585ad-9afc-458b-9c3c-29d0d24082d5 [ 763.224495] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.224685] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.224762] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.224930] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.225039] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.225180] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:aad585ad-9afc-458b-9c3c-29d0d24082d5 already deleted. [ 763.225429] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-aad585ad-9afc-458b-9c3c-29d0d24082d5" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.616313] env[69980]: INFO networking_nsxv3.common.synchronization [None req-0f890e34-cb3c-4aa7-94b0-c0a35565d5c4 None None] Enqueued Resource ID: cc1c7c6d-bc62-4bda-827e-f4975a47e60b with Priority: HIGHEST for action port [ 763.616313] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cc1c7c6d-bc62-4bda-827e-f4975a47e60b with Priority: HIGHEST for action port [ 763.616313] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock port-cc1c7c6d-bc62-4bda-827e-f4975a47e60b taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.616313] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-cc1c7c6d-bc62-4bda-827e-f4975a47e60b" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.616313] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-cc1c7c6d-bc62-4bda-827e-f4975a47e60b" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.617036] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-cc1c7c6d-bc62-4bda-827e-f4975a47e60b" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.617231] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cc1c7c6d-bc62-4bda-827e-f4975a47e60b',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 764.120525] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port cc1c7c6d-bc62-4bda-827e-f4975a47e60b [ 764.120840] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.120908] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.120982] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.121272] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.121376] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.121478] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:cc1c7c6d-bc62-4bda-827e-f4975a47e60b already deleted. [ 764.121562] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-cc1c7c6d-bc62-4bda-827e-f4975a47e60b" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.175686] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0dbf2bcd-0572-43ef-b18d-cc3cca7fcfd5 in Status: SUCCESS [ 764.175924] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0dbf2bcd-0572-43ef-b18d-cc3cca7fcfd5" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.697255] env[69980]: INFO networking_nsxv3.common.synchronization [None req-7f3c4c9e-8ecc-4e53-bb49-1884a5907551 None None] Enqueued Resource ID: c721b888-849b-43f4-8b04-4dd6af5c7e16 with Priority: HIGHEST for action port [ 765.697255] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c721b888-849b-43f4-8b04-4dd6af5c7e16 with Priority: HIGHEST for action port [ 765.697255] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock port-c721b888-849b-43f4-8b04-4dd6af5c7e16 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.697255] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c721b888-849b-43f4-8b04-4dd6af5c7e16" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.697255] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c721b888-849b-43f4-8b04-4dd6af5c7e16" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.697255] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c721b888-849b-43f4-8b04-4dd6af5c7e16" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.697725] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c721b888-849b-43f4-8b04-4dd6af5c7e16',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 765.977083] env[69980]: INFO networking_nsxv3.common.synchronization [None req-890ff5aa-f577-4d1e-ab00-5465e1ee598b None None] Enqueued Resource ID: e8433fd9-04d1-4052-829d-95d0b694237a with Priority: HIGHEST for action port [ 765.977584] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e8433fd9-04d1-4052-829d-95d0b694237a with Priority: HIGHEST for action port [ 765.978636] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock port-e8433fd9-04d1-4052-829d-95d0b694237a taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.978636] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e8433fd9-04d1-4052-829d-95d0b694237a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.978636] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e8433fd9-04d1-4052-829d-95d0b694237a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.978636] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e8433fd9-04d1-4052-829d-95d0b694237a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.978636] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e8433fd9-04d1-4052-829d-95d0b694237a',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 766.199402] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port c721b888-849b-43f4-8b04-4dd6af5c7e16 [ 766.199723] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.199877] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.199947] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.200246] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.200366] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.200466] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:c721b888-849b-43f4-8b04-4dd6af5c7e16 already deleted. [ 766.200554] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c721b888-849b-43f4-8b04-4dd6af5c7e16" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.481248] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port e8433fd9-04d1-4052-829d-95d0b694237a [ 766.481496] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.481638] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.481703] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.481917] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.482017] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.482122] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:e8433fd9-04d1-4052-829d-95d0b694237a already deleted. [ 766.482207] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e8433fd9-04d1-4052-829d-95d0b694237a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.707038] env[69980]: INFO networking_nsxv3.common.synchronization [None req-52242e21-0c19-4eab-bfae-696cff5fb3fb tempest-ServersTestBootFromVolume-1163221882 tempest-ServersTestBootFromVolume-1163221882-project-member] Enqueued Resource ID: f2b778ac-011d-472f-9220-d8d50a881380 with Priority: HIGHEST for action security_group_rules [ 766.707612] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f2b778ac-011d-472f-9220-d8d50a881380 with Priority: HIGHEST for action security_group_rules [ 766.707907] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f2b778ac-011d-472f-9220-d8d50a881380 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.709088] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f2b778ac-011d-472f-9220-d8d50a881380" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.709088] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f2b778ac-011d-472f-9220-d8d50a881380" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.709088] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f2b778ac-011d-472f-9220-d8d50a881380" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.709088] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f2b778ac-011d-472f-9220-d8d50a881380',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 766.848469] env[69980]: INFO networking_nsxv3.common.synchronization [None req-ce38399d-34fe-49f7-a560-ba9fceb71b17 tempest-ServersTestBootFromVolume-1163221882 tempest-ServersTestBootFromVolume-1163221882-project-member] Enqueued Resource ID: f2b778ac-011d-472f-9220-d8d50a881380 with Priority: HIGHEST for action security_group_rules [ 766.849024] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f2b778ac-011d-472f-9220-d8d50a881380 with Priority: HIGHEST for action security_group_rules [ 766.849563] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f2b778ac-011d-472f-9220-d8d50a881380 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.849563] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f2b778ac-011d-472f-9220-d8d50a881380" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.230730] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.230730] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.230730] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.230935] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.231035] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.231129] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f2b778ac-011d-472f-9220-d8d50a881380 already deleted. [ 767.231222] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f2b778ac-011d-472f-9220-d8d50a881380" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.231405] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f2b778ac-011d-472f-9220-d8d50a881380" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.231578] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f2b778ac-011d-472f-9220-d8d50a881380" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.231673] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f2b778ac-011d-472f-9220-d8d50a881380',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 767.511171] env[69980]: INFO networking_nsxv3.common.synchronization [req-80530177-525e-4801-8a52-a69bf350eeb5 req-1813abd6-a696-44d4-8835-34d89479ba2a tempest-ServersTestManualDisk-1921842284 tempest-ServersTestManualDisk-1921842284-project-member] Enqueued Resource ID: b472d7ce-a3a7-4859-8fa3-f222ee058e66 with Priority: HIGHEST for action security_group_members [ 767.511171] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b472d7ce-a3a7-4859-8fa3-f222ee058e66 with Priority: HIGHEST for action security_group_members [ 767.511171] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-b472d7ce-a3a7-4859-8fa3-f222ee058e66 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.511171] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b472d7ce-a3a7-4859-8fa3-f222ee058e66" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.511171] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b472d7ce-a3a7-4859-8fa3-f222ee058e66" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.519153] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b472d7ce-a3a7-4859-8fa3-f222ee058e66" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.519153] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.519153] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.519153] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.519153] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.519153] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.519153] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b472d7ce-a3a7-4859-8fa3-f222ee058e66',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 767.750439] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.750793] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.750900] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.751133] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.755112] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.755287] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f2b778ac-011d-472f-9220-d8d50a881380 already deleted. [ 767.755400] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f2b778ac-011d-472f-9220-d8d50a881380" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.025529] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.025717] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.025790] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.026013] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.026113] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.026307] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.026406] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.026471] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.026666] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.026720] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.026783] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b472d7ce-a3a7-4859-8fa3-f222ee058e66 already deleted. [ 768.026863] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b472d7ce-a3a7-4859-8fa3-f222ee058e66" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.155099] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock network-233 taken with stack trace [, , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.155099] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "network-233" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.155099] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "network-233" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.155298] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "network-233" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.155481] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.155645] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.155832] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.155984] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.158281] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.158545] env[69980]: DEBUG dogpile.cache.region [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] No value present for key: 'zone-id' {{(pid=69980) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 768.158670] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] NeedRegenerationException {{(pid=69980) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 768.158785] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] no value, waiting for create lock {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 768.158895] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] value creation lock acquired {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 768.159008] env[69980]: DEBUG dogpile.cache.region [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] No value present for key: 'zone-id' {{(pid=69980) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 768.159146] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Calling creation function for not-yet-present value {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 768.159249] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 768.178209] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 768.178391] env[69980]: DEBUG dogpile.cache.region [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=69980) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 768.178526] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Released creation lock {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 768.178702] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "network-233" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.179051] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock port-771825c6-04b2-4e7a-998a-440bd6b13844 taken with stack trace [, , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.179226] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "port-771825c6-04b2-4e7a-998a-440bd6b13844" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.179346] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "port-771825c6-04b2-4e7a-998a-440bd6b13844" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.179709] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "port-771825c6-04b2-4e7a-998a-440bd6b13844" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.179845] env[69980]: DEBUG networking_nsxv3.api.rpc [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('771825c6-04b2-4e7a-998a-440bd6b13844',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 768.232349] env[69980]: INFO networking_nsxv3.common.synchronization [None req-5506ca4c-86f7-4718-88d3-c29a587e16e8 None None] Enqueued Resource ID: e6eeb28f-c52b-40ca-8774-92f3eeac8376 with Priority: HIGHEST for action port [ 768.234312] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e6eeb28f-c52b-40ca-8774-92f3eeac8376 with Priority: HIGHEST for action port [ 768.234861] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock port-e6eeb28f-c52b-40ca-8774-92f3eeac8376 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.234861] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e6eeb28f-c52b-40ca-8774-92f3eeac8376" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.234861] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e6eeb28f-c52b-40ca-8774-92f3eeac8376" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.235986] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e6eeb28f-c52b-40ca-8774-92f3eeac8376" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.235986] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e6eeb28f-c52b-40ca-8774-92f3eeac8376',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 768.683715] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.683859] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.683988] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.684292] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.684439] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.684591] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Segment Port 771825c6-04b2-4e7a-998a-440bd6b13844 not found, creating... [ 768.684851] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.685013] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.685200] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.689176] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.689176] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.689176] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.689176] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.689176] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.689176] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.689176] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.689176] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Resource: SegmentPort with ID: 771825c6-04b2-4e7a-998a-440bd6b13844 is going to be created. [ 768.707395] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.707395] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.707395] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.707395] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.707395] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.707395] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "port-771825c6-04b2-4e7a-998a-440bd6b13844" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.740681] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port e6eeb28f-c52b-40ca-8774-92f3eeac8376 [ 768.740681] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.740681] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.740681] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.740681] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.740681] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.740681] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:e6eeb28f-c52b-40ca-8774-92f3eeac8376 already deleted. [ 768.740681] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e6eeb28f-c52b-40ca-8774-92f3eeac8376" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.484074] env[69980]: INFO networking_nsxv3.common.synchronization [req-0e6c9b51-6d33-4255-a2cb-92c189d6cd56 req-82f80b9e-4a00-4142-a771-199f6732b240 tempest-VolumesAssistedSnapshotsTest-973741720 tempest-VolumesAssistedSnapshotsTest-973741720-project-member] Enqueued Resource ID: 701c8f75-0059-44a8-ab17-fcd4ee6f9c0e with Priority: HIGHEST for action security_group_members [ 769.487382] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 701c8f75-0059-44a8-ab17-fcd4ee6f9c0e with Priority: HIGHEST for action security_group_members [ 769.487382] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-701c8f75-0059-44a8-ab17-fcd4ee6f9c0e taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.487382] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-701c8f75-0059-44a8-ab17-fcd4ee6f9c0e" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.487382] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-701c8f75-0059-44a8-ab17-fcd4ee6f9c0e" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.487382] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-701c8f75-0059-44a8-ab17-fcd4ee6f9c0e" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.487382] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.487382] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.487382] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.487382] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.487382] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.487382] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('701c8f75-0059-44a8-ab17-fcd4ee6f9c0e',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 769.607162] env[69980]: INFO networking_nsxv3.common.synchronization [None req-a4ac189d-3479-4178-89be-a3a6496ae649 None None] Enqueued Resource ID: 02bc73c2-9e0b-428d-970f-e6d992b61407 with Priority: HIGHEST for action port [ 769.607448] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 02bc73c2-9e0b-428d-970f-e6d992b61407 with Priority: HIGHEST for action port [ 769.608050] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock port-02bc73c2-9e0b-428d-970f-e6d992b61407 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.608185] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-02bc73c2-9e0b-428d-970f-e6d992b61407" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.608268] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-02bc73c2-9e0b-428d-970f-e6d992b61407" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.608584] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-02bc73c2-9e0b-428d-970f-e6d992b61407" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.608685] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('02bc73c2-9e0b-428d-970f-e6d992b61407',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 769.856222] env[69980]: INFO networking_nsxv3.common.synchronization [req-80530177-525e-4801-8a52-a69bf350eeb5 req-ec3e9bc0-d732-4499-9e24-4a6e78c50ac9 service nova] Enqueued Resource ID: b472d7ce-a3a7-4859-8fa3-f222ee058e66 with Priority: HIGHEST for action security_group_rules [ 769.856222] env[69980]: INFO networking_nsxv3.common.synchronization [req-80530177-525e-4801-8a52-a69bf350eeb5 req-ec3e9bc0-d732-4499-9e24-4a6e78c50ac9 service nova] Enqueued Resource ID: b472d7ce-a3a7-4859-8fa3-f222ee058e66 with Priority: HIGHEST for action security_group_members [ 769.856222] env[69980]: INFO networking_nsxv3.common.synchronization [req-80530177-525e-4801-8a52-a69bf350eeb5 req-ec3e9bc0-d732-4499-9e24-4a6e78c50ac9 service nova] Enqueued Resource ID: 771825c6-04b2-4e7a-998a-440bd6b13844 with Priority: HIGHEST for action port [ 769.856222] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b472d7ce-a3a7-4859-8fa3-f222ee058e66 with Priority: HIGHEST for action security_group_rules [ 769.856222] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b472d7ce-a3a7-4859-8fa3-f222ee058e66 with Priority: HIGHEST for action security_group_members [ 769.856222] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 771825c6-04b2-4e7a-998a-440bd6b13844 with Priority: HIGHEST for action port [ 769.857876] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b472d7ce-a3a7-4859-8fa3-f222ee058e66 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.858071] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b472d7ce-a3a7-4859-8fa3-f222ee058e66" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.858155] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b472d7ce-a3a7-4859-8fa3-f222ee058e66" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.858642] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b472d7ce-a3a7-4859-8fa3-f222ee058e66" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.858642] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b472d7ce-a3a7-4859-8fa3-f222ee058e66',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 769.861585] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-b472d7ce-a3a7-4859-8fa3-f222ee058e66 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.866250] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b472d7ce-a3a7-4859-8fa3-f222ee058e66" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.866250] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b472d7ce-a3a7-4859-8fa3-f222ee058e66" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.866250] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b472d7ce-a3a7-4859-8fa3-f222ee058e66" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.866250] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.866250] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.866250] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.866250] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.866250] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.866250] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b472d7ce-a3a7-4859-8fa3-f222ee058e66',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 769.866985] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock port-771825c6-04b2-4e7a-998a-440bd6b13844 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.867141] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-771825c6-04b2-4e7a-998a-440bd6b13844" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.867214] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-771825c6-04b2-4e7a-998a-440bd6b13844" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.867989] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-771825c6-04b2-4e7a-998a-440bd6b13844" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.867989] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('771825c6-04b2-4e7a-998a-440bd6b13844',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 769.990551] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.990551] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.990551] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.990551] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.990551] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.990551] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.990551] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.990551] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.990551] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.990551] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.990551] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 701c8f75-0059-44a8-ab17-fcd4ee6f9c0e already deleted. [ 769.990551] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-701c8f75-0059-44a8-ab17-fcd4ee6f9c0e" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.111356] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 02bc73c2-9e0b-428d-970f-e6d992b61407 [ 770.111753] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.111753] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.111895] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.112040] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.112135] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.112232] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:02bc73c2-9e0b-428d-970f-e6d992b61407 already deleted. [ 770.112309] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-02bc73c2-9e0b-428d-970f-e6d992b61407" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.122204] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock network-221 taken with stack trace [, , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.122469] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "network-221" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.122709] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "network-221" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.123184] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "network-221" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.123592] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.123794] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.123967] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.124314] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.125043] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.125043] env[69980]: DEBUG dogpile.cache.region [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] No value present for key: 'zone-id' {{(pid=69980) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 770.125043] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] NeedRegenerationException {{(pid=69980) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 770.125329] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] no value, waiting for create lock {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 770.125508] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] value creation lock acquired {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 770.125581] env[69980]: DEBUG dogpile.cache.region [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] No value present for key: 'zone-id' {{(pid=69980) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 770.125733] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Calling creation function for not-yet-present value {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 770.125910] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 770.145299] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 770.145477] env[69980]: DEBUG dogpile.cache.region [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=69980) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 770.145689] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Released creation lock {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 770.147721] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "network-221" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.147721] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock port-1cf9f6fd-05a7-4eb4-81b1-a0cc2abdb3e2 taken with stack trace [, , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.147721] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "port-1cf9f6fd-05a7-4eb4-81b1-a0cc2abdb3e2" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.147721] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "port-1cf9f6fd-05a7-4eb4-81b1-a0cc2abdb3e2" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.147721] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "port-1cf9f6fd-05a7-4eb4-81b1-a0cc2abdb3e2" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.147721] env[69980]: DEBUG networking_nsxv3.api.rpc [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1cf9f6fd-05a7-4eb4-81b1-a0cc2abdb3e2',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 770.363146] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-b472d7ce-a3a7-4859-8fa3-f222ee058e66 taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.363146] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b472d7ce-a3a7-4859-8fa3-f222ee058e66" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.371300] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b472d7ce-a3a7-4859-8fa3-f222ee058e66',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 770.371543] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 771825c6-04b2-4e7a-998a-440bd6b13844 with status ACTIVE [ 770.372159] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.372159] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.372159] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.372159] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.372394] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.372394] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.372515] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.372555] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.372706] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.372798] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.372993] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.373171] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.373171] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.373303] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.373379] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.373471] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 771825c6-04b2-4e7a-998a-440bd6b13844 is going to be updated. [ 770.403511] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.404057] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.404057] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.404057] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.404057] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.404247] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-771825c6-04b2-4e7a-998a-440bd6b13844" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.652529] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.652859] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.652897] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.653177] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.654326] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.654326] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Segment Port 1cf9f6fd-05a7-4eb4-81b1-a0cc2abdb3e2 not found, creating... [ 770.654326] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.654326] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.654326] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.654326] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.654918] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.654918] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.654918] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.654918] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.659357] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.661035] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.661035] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Resource: SegmentPort with ID: 1cf9f6fd-05a7-4eb4-81b1-a0cc2abdb3e2 is going to be created. [ 770.681818] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.681818] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.681818] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.681818] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.681818] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.681818] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "port-1cf9f6fd-05a7-4eb4-81b1-a0cc2abdb3e2" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.882576] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b472d7ce-a3a7-4859-8fa3-f222ee058e66',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 771.387555] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.387724] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.387812] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.388043] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.388144] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.388243] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b472d7ce-a3a7-4859-8fa3-f222ee058e66 is going to be created. [ 771.424251] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.424461] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.424542] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.424776] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.424952] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.436162] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b472d7ce-a3a7-4859-8fa3-f222ee058e66 in Status: UNINITIALIZED for 2s [ 771.927082] env[69980]: INFO networking_nsxv3.common.synchronization [req-0e6c9b51-6d33-4255-a2cb-92c189d6cd56 req-0c34933b-fbd1-4ef7-a761-d287749721e7 service nova] Enqueued Resource ID: 701c8f75-0059-44a8-ab17-fcd4ee6f9c0e with Priority: HIGHEST for action security_group_rules [ 771.928230] env[69980]: INFO networking_nsxv3.common.synchronization [req-0e6c9b51-6d33-4255-a2cb-92c189d6cd56 req-0c34933b-fbd1-4ef7-a761-d287749721e7 service nova] Enqueued Resource ID: 701c8f75-0059-44a8-ab17-fcd4ee6f9c0e with Priority: HIGHEST for action security_group_members [ 771.928539] env[69980]: INFO networking_nsxv3.common.synchronization [req-0e6c9b51-6d33-4255-a2cb-92c189d6cd56 req-0c34933b-fbd1-4ef7-a761-d287749721e7 service nova] Enqueued Resource ID: 1cf9f6fd-05a7-4eb4-81b1-a0cc2abdb3e2 with Priority: HIGHEST for action port [ 771.929678] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 701c8f75-0059-44a8-ab17-fcd4ee6f9c0e with Priority: HIGHEST for action security_group_rules [ 771.930519] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 701c8f75-0059-44a8-ab17-fcd4ee6f9c0e with Priority: HIGHEST for action security_group_members [ 771.931537] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1cf9f6fd-05a7-4eb4-81b1-a0cc2abdb3e2 with Priority: HIGHEST for action port [ 771.931537] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock rules-701c8f75-0059-44a8-ab17-fcd4ee6f9c0e taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.931537] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-701c8f75-0059-44a8-ab17-fcd4ee6f9c0e" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.931537] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-701c8f75-0059-44a8-ab17-fcd4ee6f9c0e" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.931980] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-701c8f75-0059-44a8-ab17-fcd4ee6f9c0e" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.932348] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('701c8f75-0059-44a8-ab17-fcd4ee6f9c0e',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 771.933596] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-701c8f75-0059-44a8-ab17-fcd4ee6f9c0e taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.933596] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-701c8f75-0059-44a8-ab17-fcd4ee6f9c0e" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.934027] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-701c8f75-0059-44a8-ab17-fcd4ee6f9c0e" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.934027] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-701c8f75-0059-44a8-ab17-fcd4ee6f9c0e" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.934095] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.934168] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.934277] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.934519] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.934619] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.934748] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('701c8f75-0059-44a8-ab17-fcd4ee6f9c0e',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 771.935835] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock port-1cf9f6fd-05a7-4eb4-81b1-a0cc2abdb3e2 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.936487] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1cf9f6fd-05a7-4eb4-81b1-a0cc2abdb3e2" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.936602] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1cf9f6fd-05a7-4eb4-81b1-a0cc2abdb3e2" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.936909] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1cf9f6fd-05a7-4eb4-81b1-a0cc2abdb3e2" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.937089] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1cf9f6fd-05a7-4eb4-81b1-a0cc2abdb3e2',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 772.026913] env[69980]: INFO networking_nsxv3.common.synchronization [None req-053e7ada-9452-45eb-9b51-1e07044c3c47 None None] Enqueued Resource ID: 9c4178c1-29be-4b65-bd38-d9dcaba1f6a5 with Priority: HIGHEST for action port [ 772.027081] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9c4178c1-29be-4b65-bd38-d9dcaba1f6a5 with Priority: HIGHEST for action port [ 772.027605] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock port-9c4178c1-29be-4b65-bd38-d9dcaba1f6a5 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.027605] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9c4178c1-29be-4b65-bd38-d9dcaba1f6a5" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.027605] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9c4178c1-29be-4b65-bd38-d9dcaba1f6a5" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.027863] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9c4178c1-29be-4b65-bd38-d9dcaba1f6a5" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.027944] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9c4178c1-29be-4b65-bd38-d9dcaba1f6a5',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 772.442150] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-701c8f75-0059-44a8-ab17-fcd4ee6f9c0e taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.442243] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-701c8f75-0059-44a8-ab17-fcd4ee6f9c0e" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.442431] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('701c8f75-0059-44a8-ab17-fcd4ee6f9c0e',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 772.443729] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 1cf9f6fd-05a7-4eb4-81b1-a0cc2abdb3e2 with status ACTIVE [ 772.443924] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.444039] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.444090] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.444298] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.444392] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.444741] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.444885] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.444967] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.445515] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.445616] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.445826] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.445935] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.446034] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.446323] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.446411] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.446592] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 1cf9f6fd-05a7-4eb4-81b1-a0cc2abdb3e2 is going to be updated. [ 772.470838] env[69980]: INFO networking_nsxv3.common.synchronization [None req-2964de93-49b3-4d3c-8526-9c992873668e None None] Enqueued Resource ID: c1449c00-1904-4ac2-b0c9-2a6c2cc4f39b with Priority: HIGHEST for action port [ 772.472029] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.472169] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.472221] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.472486] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.472671] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.472860] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1cf9f6fd-05a7-4eb4-81b1-a0cc2abdb3e2" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.473409] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c1449c00-1904-4ac2-b0c9-2a6c2cc4f39b with Priority: HIGHEST for action port [ 772.473752] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock port-c1449c00-1904-4ac2-b0c9-2a6c2cc4f39b taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.473873] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c1449c00-1904-4ac2-b0c9-2a6c2cc4f39b" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.473955] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c1449c00-1904-4ac2-b0c9-2a6c2cc4f39b" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.474204] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c1449c00-1904-4ac2-b0c9-2a6c2cc4f39b" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.474296] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c1449c00-1904-4ac2-b0c9-2a6c2cc4f39b',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 772.535282] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 9c4178c1-29be-4b65-bd38-d9dcaba1f6a5 [ 772.535547] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.535659] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.535728] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.535966] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.536091] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.536195] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:9c4178c1-29be-4b65-bd38-d9dcaba1f6a5 already deleted. [ 772.536291] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9c4178c1-29be-4b65-bd38-d9dcaba1f6a5" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.949949] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('701c8f75-0059-44a8-ab17-fcd4ee6f9c0e',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 772.979025] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port c1449c00-1904-4ac2-b0c9-2a6c2cc4f39b [ 772.979025] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.979025] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.979025] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.979025] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.979025] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.979025] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:c1449c00-1904-4ac2-b0c9-2a6c2cc4f39b already deleted. [ 772.979025] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c1449c00-1904-4ac2-b0c9-2a6c2cc4f39b" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.316033] env[69980]: INFO networking_nsxv3.common.synchronization [req-d64daad2-97f9-48d0-af4f-c7e8d3f913cc req-40e2c399-4ab5-4fc0-9b99-5a8da3886742 tempest-ServersAdminNegativeTestJSON-1599780358 tempest-ServersAdminNegativeTestJSON-1599780358-project-member] Enqueued Resource ID: 2961e549-f7d2-46b0-a1f4-9365d96bb58a with Priority: HIGHEST for action security_group_members [ 773.316545] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2961e549-f7d2-46b0-a1f4-9365d96bb58a with Priority: HIGHEST for action security_group_members [ 773.316947] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-2961e549-f7d2-46b0-a1f4-9365d96bb58a taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.317089] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2961e549-f7d2-46b0-a1f4-9365d96bb58a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.317153] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2961e549-f7d2-46b0-a1f4-9365d96bb58a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.317736] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2961e549-f7d2-46b0-a1f4-9365d96bb58a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.317925] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.318051] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.318117] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.318383] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.318419] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.318496] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2961e549-f7d2-46b0-a1f4-9365d96bb58a',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 773.451026] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b472d7ce-a3a7-4859-8fa3-f222ee058e66 in Status: SUCCESS [ 773.451026] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b472d7ce-a3a7-4859-8fa3-f222ee058e66" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.451026] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b472d7ce-a3a7-4859-8fa3-f222ee058e66" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.451026] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b472d7ce-a3a7-4859-8fa3-f222ee058e66" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.451026] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.451026] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.451026] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.451026] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.451026] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.451026] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b472d7ce-a3a7-4859-8fa3-f222ee058e66" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.451026] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b472d7ce-a3a7-4859-8fa3-f222ee058e66',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 773.454430] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.454773] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.455093] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.455305] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.457137] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.457137] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 701c8f75-0059-44a8-ab17-fcd4ee6f9c0e is going to be created. [ 773.487310] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.488012] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.488012] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.489892] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.489892] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.499788] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 701c8f75-0059-44a8-ab17-fcd4ee6f9c0e in Status: UNINITIALIZED for 2s [ 773.825807] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.825990] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.826472] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.826472] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.826472] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.826634] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.826707] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.826754] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.827211] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.827211] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.827211] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2961e549-f7d2-46b0-a1f4-9365d96bb58a already deleted. [ 773.827211] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2961e549-f7d2-46b0-a1f4-9365d96bb58a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.946887] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock network-557 taken with stack trace [, , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.947186] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "network-557" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.947384] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "network-557" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.948124] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "network-557" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.948519] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.948822] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.950310] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.950310] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.951280] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.951280] env[69980]: DEBUG dogpile.cache.region [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] No value present for key: 'zone-id' {{(pid=69980) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 773.951280] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] NeedRegenerationException {{(pid=69980) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 773.951280] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] no value, waiting for create lock {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 773.951280] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] value creation lock acquired {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 773.951280] env[69980]: DEBUG dogpile.cache.region [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] No value present for key: 'zone-id' {{(pid=69980) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 773.952263] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Calling creation function for not-yet-present value {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 773.952263] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 773.953506] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b472d7ce-a3a7-4859-8fa3-f222ee058e66',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 773.987861] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 773.988166] env[69980]: DEBUG dogpile.cache.region [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Cache value generated in 0.037 seconds for key(s): 'zone-id' {{(pid=69980) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 773.988251] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Released creation lock {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 773.988440] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "network-557" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.988817] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock port-491a4071-9fc2-4123-8afd-088362133d73 taken with stack trace [, , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.989057] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "port-491a4071-9fc2-4123-8afd-088362133d73" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.989239] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "port-491a4071-9fc2-4123-8afd-088362133d73" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.989607] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "port-491a4071-9fc2-4123-8afd-088362133d73" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.989801] env[69980]: DEBUG networking_nsxv3.api.rpc [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('491a4071-9fc2-4123-8afd-088362133d73',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 773.995517] env[69980]: INFO networking_nsxv3.common.synchronization [None req-b962b2de-b3eb-4cdc-b58a-a69c728034c0 None None] Enqueued Resource ID: 12e252a1-4b42-4300-8654-87a12cdd574c with Priority: HIGHEST for action port [ 773.997308] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 12e252a1-4b42-4300-8654-87a12cdd574c with Priority: HIGHEST for action port [ 773.997544] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock port-12e252a1-4b42-4300-8654-87a12cdd574c taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.997843] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-12e252a1-4b42-4300-8654-87a12cdd574c" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.997843] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-12e252a1-4b42-4300-8654-87a12cdd574c" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.998027] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-12e252a1-4b42-4300-8654-87a12cdd574c" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.998938] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('12e252a1-4b42-4300-8654-87a12cdd574c',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 774.457153] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b472d7ce-a3a7-4859-8fa3-f222ee058e66: rpc.has_security_group_logging(os_id): False [ 774.475028] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.475028] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.475028] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.475028] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.475028] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.475028] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.475028] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.475028] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.475028] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.475028] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.475028] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b472d7ce-a3a7-4859-8fa3-f222ee058e66 is going to be created. [ 774.498131] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.498131] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.498131] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.498131] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.498131] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.498131] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Segment Port 491a4071-9fc2-4123-8afd-088362133d73 not found, creating... [ 774.498131] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.498131] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.498131] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.498131] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.498131] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.498606] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.498606] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.498606] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.498606] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.498606] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.498974] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Resource: SegmentPort with ID: 491a4071-9fc2-4123-8afd-088362133d73 is going to be created. [ 774.501588] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 12e252a1-4b42-4300-8654-87a12cdd574c [ 774.501588] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.501588] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.501588] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.501588] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.501588] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.501588] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:12e252a1-4b42-4300-8654-87a12cdd574c already deleted. [ 774.501588] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-12e252a1-4b42-4300-8654-87a12cdd574c" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.519555] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.520626] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.520775] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.521127] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.521408] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.521682] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "port-491a4071-9fc2-4123-8afd-088362133d73" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.534306] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.534441] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.534441] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.535805] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.535805] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.549305] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b472d7ce-a3a7-4859-8fa3-f222ee058e66 in Status: IN_PROGRESS for 2s [ 775.512412] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 701c8f75-0059-44a8-ab17-fcd4ee6f9c0e in Status: SUCCESS [ 775.513860] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-701c8f75-0059-44a8-ab17-fcd4ee6f9c0e" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.513860] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-701c8f75-0059-44a8-ab17-fcd4ee6f9c0e" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.513860] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-701c8f75-0059-44a8-ab17-fcd4ee6f9c0e" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.513860] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.513860] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.513860] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.514245] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.515225] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.517475] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-701c8f75-0059-44a8-ab17-fcd4ee6f9c0e" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.517475] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('701c8f75-0059-44a8-ab17-fcd4ee6f9c0e',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 775.763223] env[69980]: INFO networking_nsxv3.common.synchronization [req-d64daad2-97f9-48d0-af4f-c7e8d3f913cc req-8cacf8b0-d677-4181-a2d3-040448cc26f8 service nova] Enqueued Resource ID: 2961e549-f7d2-46b0-a1f4-9365d96bb58a with Priority: HIGHEST for action security_group_rules [ 775.763425] env[69980]: INFO networking_nsxv3.common.synchronization [req-d64daad2-97f9-48d0-af4f-c7e8d3f913cc req-8cacf8b0-d677-4181-a2d3-040448cc26f8 service nova] Enqueued Resource ID: 2961e549-f7d2-46b0-a1f4-9365d96bb58a with Priority: HIGHEST for action security_group_members [ 775.763528] env[69980]: INFO networking_nsxv3.common.synchronization [req-d64daad2-97f9-48d0-af4f-c7e8d3f913cc req-8cacf8b0-d677-4181-a2d3-040448cc26f8 service nova] Enqueued Resource ID: 491a4071-9fc2-4123-8afd-088362133d73 with Priority: HIGHEST for action port [ 775.763861] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2961e549-f7d2-46b0-a1f4-9365d96bb58a with Priority: HIGHEST for action security_group_rules [ 775.763967] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2961e549-f7d2-46b0-a1f4-9365d96bb58a with Priority: HIGHEST for action security_group_members [ 775.764386] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 491a4071-9fc2-4123-8afd-088362133d73 with Priority: HIGHEST for action port [ 775.765378] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2961e549-f7d2-46b0-a1f4-9365d96bb58a taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.765517] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2961e549-f7d2-46b0-a1f4-9365d96bb58a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.765589] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2961e549-f7d2-46b0-a1f4-9365d96bb58a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.765852] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2961e549-f7d2-46b0-a1f4-9365d96bb58a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.765940] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2961e549-f7d2-46b0-a1f4-9365d96bb58a',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 775.769557] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-2961e549-f7d2-46b0-a1f4-9365d96bb58a taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.769557] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2961e549-f7d2-46b0-a1f4-9365d96bb58a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.769557] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2961e549-f7d2-46b0-a1f4-9365d96bb58a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.770873] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2961e549-f7d2-46b0-a1f4-9365d96bb58a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.772313] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.772313] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.772313] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.772313] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.772313] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.772313] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2961e549-f7d2-46b0-a1f4-9365d96bb58a',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 775.773758] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock port-491a4071-9fc2-4123-8afd-088362133d73 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.773899] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-491a4071-9fc2-4123-8afd-088362133d73" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.773979] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-491a4071-9fc2-4123-8afd-088362133d73" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.776809] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-491a4071-9fc2-4123-8afd-088362133d73" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.776809] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('491a4071-9fc2-4123-8afd-088362133d73',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 776.021247] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('701c8f75-0059-44a8-ab17-fcd4ee6f9c0e',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 776.270451] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-2961e549-f7d2-46b0-a1f4-9365d96bb58a taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.270617] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2961e549-f7d2-46b0-a1f4-9365d96bb58a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.279717] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2961e549-f7d2-46b0-a1f4-9365d96bb58a',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 776.280645] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 491a4071-9fc2-4123-8afd-088362133d73 with status ACTIVE [ 776.281282] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.281650] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.282362] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.282362] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.282362] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.282620] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.282620] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.285329] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.287947] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.287947] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.287947] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.287947] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.287947] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.287947] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.287947] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.287947] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 491a4071-9fc2-4123-8afd-088362133d73 is going to be updated. [ 776.308043] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.308239] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.308311] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.308515] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.308683] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.308844] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-491a4071-9fc2-4123-8afd-088362133d73" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.523420] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 701c8f75-0059-44a8-ab17-fcd4ee6f9c0e: rpc.has_security_group_logging(os_id): False [ 776.544304] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.544304] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.544442] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.544563] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.544652] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.544938] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.545044] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.545102] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.545304] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.545385] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.546657] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 701c8f75-0059-44a8-ab17-fcd4ee6f9c0e is going to be created. [ 776.563164] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b472d7ce-a3a7-4859-8fa3-f222ee058e66 in Status: SUCCESS [ 776.563164] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b472d7ce-a3a7-4859-8fa3-f222ee058e66" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.611018] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.611240] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.611240] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.611410] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.611707] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.625963] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 701c8f75-0059-44a8-ab17-fcd4ee6f9c0e in Status: IN_PROGRESS for 2s [ 776.681967] env[69980]: INFO networking_nsxv3.common.synchronization [req-cf50f52a-dd84-48c6-b7ae-2be25655a9e9 req-aaf0d5d1-4c39-4f43-ad55-da4a5550683a tempest-ServersWithSpecificFlavorTestJSON-977701913 tempest-ServersWithSpecificFlavorTestJSON-977701913-project-member] Enqueued Resource ID: 3b94a139-70f4-4b1b-82e2-803c78f509bf with Priority: HIGHEST for action security_group_members [ 776.682742] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3b94a139-70f4-4b1b-82e2-803c78f509bf with Priority: HIGHEST for action security_group_members [ 776.683222] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-3b94a139-70f4-4b1b-82e2-803c78f509bf taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.684710] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3b94a139-70f4-4b1b-82e2-803c78f509bf" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.684710] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3b94a139-70f4-4b1b-82e2-803c78f509bf" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.684710] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3b94a139-70f4-4b1b-82e2-803c78f509bf" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.684710] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.684710] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.684710] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.684710] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.684710] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.685015] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3b94a139-70f4-4b1b-82e2-803c78f509bf',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 776.785523] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2961e549-f7d2-46b0-a1f4-9365d96bb58a',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 776.855687] env[69980]: INFO networking_nsxv3.common.synchronization [None req-0c92377d-6b71-4eeb-a549-ccd5c5aec7e7 None None] Enqueued Resource ID: 7c8547e0-9fdf-4b0a-9909-aa6dbb894236 with Priority: HIGHEST for action port [ 776.856303] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7c8547e0-9fdf-4b0a-9909-aa6dbb894236 with Priority: HIGHEST for action port [ 776.856648] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock port-7c8547e0-9fdf-4b0a-9909-aa6dbb894236 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.856797] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7c8547e0-9fdf-4b0a-9909-aa6dbb894236" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.856878] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7c8547e0-9fdf-4b0a-9909-aa6dbb894236" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.857427] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7c8547e0-9fdf-4b0a-9909-aa6dbb894236" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.857833] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7c8547e0-9fdf-4b0a-9909-aa6dbb894236',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 776.963683] env[69980]: INFO networking_nsxv3.common.synchronization [req-1c49502a-daab-4ca1-bc5c-fb0e060c967f req-30125459-eeab-4289-9b13-cc0a78a0365a tempest-ServerDiagnosticsTest-1264243932 tempest-ServerDiagnosticsTest-1264243932-project-member] Enqueued Resource ID: 6719a83d-3363-4339-a277-6e1ec27ec7bc with Priority: HIGHEST for action security_group_members [ 776.963683] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6719a83d-3363-4339-a277-6e1ec27ec7bc with Priority: HIGHEST for action security_group_members [ 776.963683] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-6719a83d-3363-4339-a277-6e1ec27ec7bc taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.963683] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6719a83d-3363-4339-a277-6e1ec27ec7bc" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.968523] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6719a83d-3363-4339-a277-6e1ec27ec7bc" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.968523] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6719a83d-3363-4339-a277-6e1ec27ec7bc" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.968523] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.968523] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.968523] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.968523] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.968523] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.968523] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6719a83d-3363-4339-a277-6e1ec27ec7bc',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 777.189187] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.189187] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.189187] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.189187] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.189187] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.189187] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.189187] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.189187] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.189187] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.189187] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.189187] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3b94a139-70f4-4b1b-82e2-803c78f509bf already deleted. [ 777.189187] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3b94a139-70f4-4b1b-82e2-803c78f509bf" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.297560] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.297560] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.297560] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.297560] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.297560] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.297560] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2961e549-f7d2-46b0-a1f4-9365d96bb58a is going to be created. [ 777.319051] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.319051] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.319051] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.319051] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.319051] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.328202] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2961e549-f7d2-46b0-a1f4-9365d96bb58a in Status: UNINITIALIZED for 2s [ 777.361385] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 7c8547e0-9fdf-4b0a-9909-aa6dbb894236 [ 777.361385] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.361385] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.361385] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.361385] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.361385] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.361385] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:7c8547e0-9fdf-4b0a-9909-aa6dbb894236 already deleted. [ 777.361385] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7c8547e0-9fdf-4b0a-9909-aa6dbb894236" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.474913] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.475115] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.475182] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.475409] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.475508] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.475709] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.475811] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.475875] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.476065] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.476149] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.476241] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6719a83d-3363-4339-a277-6e1ec27ec7bc is going to be updated. [ 777.505020] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.505020] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.505020] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.505020] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.505020] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.516263] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6719a83d-3363-4339-a277-6e1ec27ec7bc in Status: IN_PROGRESS for 2s [ 777.922415] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock network-994 taken with stack trace [, , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.922884] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "network-994" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.922884] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "network-994" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.923325] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "network-994" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.923861] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.923991] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.924223] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.924616] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.924882] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.925225] env[69980]: DEBUG dogpile.cache.region [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] No value present for key: 'zone-id' {{(pid=69980) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 777.925225] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] NeedRegenerationException {{(pid=69980) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 777.925421] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] no value, waiting for create lock {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 777.925421] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] value creation lock acquired {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 777.927999] env[69980]: DEBUG dogpile.cache.region [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] No value present for key: 'zone-id' {{(pid=69980) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 777.927999] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Calling creation function for not-yet-present value {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 777.927999] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 777.948820] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 777.949104] env[69980]: DEBUG dogpile.cache.region [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=69980) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 777.949279] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Released creation lock {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 777.949484] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "network-994" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.949831] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock port-80f96566-f40b-430d-83a1-4bc36c04e27e taken with stack trace [, , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.950051] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "port-80f96566-f40b-430d-83a1-4bc36c04e27e" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.950182] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "port-80f96566-f40b-430d-83a1-4bc36c04e27e" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.950532] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "port-80f96566-f40b-430d-83a1-4bc36c04e27e" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.950695] env[69980]: DEBUG networking_nsxv3.api.rpc [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('80f96566-f40b-430d-83a1-4bc36c04e27e',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 778.453401] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.453677] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.453852] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.454213] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.454371] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.454526] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Segment Port 80f96566-f40b-430d-83a1-4bc36c04e27e not found, creating... [ 778.454794] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.454950] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.455082] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.455308] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.455468] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.456404] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.456655] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.456789] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.457054] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.457165] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.457307] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Resource: SegmentPort with ID: 80f96566-f40b-430d-83a1-4bc36c04e27e is going to be created. [ 778.481794] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.481794] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.481794] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.481794] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.481794] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.481794] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "port-80f96566-f40b-430d-83a1-4bc36c04e27e" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.638741] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 701c8f75-0059-44a8-ab17-fcd4ee6f9c0e in Status: SUCCESS [ 778.638847] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-701c8f75-0059-44a8-ab17-fcd4ee6f9c0e" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.769617] env[69980]: INFO networking_nsxv3.common.synchronization [req-389cad0c-0a40-4e1e-9dba-f5e51f5909ff req-5fbdcc00-b50d-4209-afe8-86571b5057d9 tempest-ServerMetadataTestJSON-614638658 tempest-ServerMetadataTestJSON-614638658-project-member] Enqueued Resource ID: 48dd2a84-68ac-43c8-a7e2-4cb28bb82546 with Priority: HIGHEST for action security_group_members [ 778.770130] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 48dd2a84-68ac-43c8-a7e2-4cb28bb82546 with Priority: HIGHEST for action security_group_members [ 778.771413] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-48dd2a84-68ac-43c8-a7e2-4cb28bb82546 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.771413] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-48dd2a84-68ac-43c8-a7e2-4cb28bb82546" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.771413] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-48dd2a84-68ac-43c8-a7e2-4cb28bb82546" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.771652] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-48dd2a84-68ac-43c8-a7e2-4cb28bb82546" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.774583] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.774583] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.774583] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.774583] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.774583] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.774583] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('48dd2a84-68ac-43c8-a7e2-4cb28bb82546',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 778.840442] env[69980]: INFO networking_nsxv3.common.synchronization [None req-512ae2d2-0e0a-46bf-9945-8eb83d711b30 None None] Enqueued Resource ID: b1b39027-d1be-469b-bd51-0de4b02a2421 with Priority: HIGHEST for action port [ 778.840882] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b1b39027-d1be-469b-bd51-0de4b02a2421 with Priority: HIGHEST for action port [ 778.840882] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock port-b1b39027-d1be-469b-bd51-0de4b02a2421 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.841050] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b1b39027-d1be-469b-bd51-0de4b02a2421" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.847192] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b1b39027-d1be-469b-bd51-0de4b02a2421" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.847192] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b1b39027-d1be-469b-bd51-0de4b02a2421" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.847192] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b1b39027-d1be-469b-bd51-0de4b02a2421',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 779.275657] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.275657] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.275657] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.276161] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.276161] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.276328] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.276434] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.276497] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.276659] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.276733] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.276814] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 48dd2a84-68ac-43c8-a7e2-4cb28bb82546 already deleted. [ 779.276888] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-48dd2a84-68ac-43c8-a7e2-4cb28bb82546" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.339012] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2961e549-f7d2-46b0-a1f4-9365d96bb58a in Status: SUCCESS [ 779.339012] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2961e549-f7d2-46b0-a1f4-9365d96bb58a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.339012] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2961e549-f7d2-46b0-a1f4-9365d96bb58a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.339012] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2961e549-f7d2-46b0-a1f4-9365d96bb58a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.339012] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.339012] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.339012] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.344875] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.344875] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.344875] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2961e549-f7d2-46b0-a1f4-9365d96bb58a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.344875] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('2961e549-f7d2-46b0-a1f4-9365d96bb58a',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 779.348039] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b1b39027-d1be-469b-bd51-0de4b02a2421 [ 779.348039] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.348745] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.349950] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.349950] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.349950] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.349950] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b1b39027-d1be-469b-bd51-0de4b02a2421 already deleted. [ 779.349950] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b1b39027-d1be-469b-bd51-0de4b02a2421" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.530779] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6719a83d-3363-4339-a277-6e1ec27ec7bc in Status: SUCCESS [ 779.530779] env[69980]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6719a83d-3363-4339-a277-6e1ec27ec7bc deletion is rescheduled due to dependency. [ 779.530779] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6719a83d-3363-4339-a277-6e1ec27ec7bc" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.704020] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock network-836 taken with stack trace [, , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.704020] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "network-836" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.704020] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "network-836" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.704020] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "network-836" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.704723] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.705797] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.705797] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.705797] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.706091] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.706590] env[69980]: DEBUG dogpile.cache.region [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] No value present for key: 'zone-id' {{(pid=69980) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 779.709018] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] NeedRegenerationException {{(pid=69980) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 779.709018] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] no value, waiting for create lock {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 779.709018] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] value creation lock acquired {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 779.709018] env[69980]: DEBUG dogpile.cache.region [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] No value present for key: 'zone-id' {{(pid=69980) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 779.709018] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Calling creation function for not-yet-present value {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 779.709018] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 779.728596] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 779.728596] env[69980]: DEBUG dogpile.cache.region [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=69980) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 779.728596] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Released creation lock {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 779.728596] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "network-836" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.728596] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock port-34793d30-d1b3-47f7-9573-50f4bf28ab9b taken with stack trace [, , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.728596] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "port-34793d30-d1b3-47f7-9573-50f4bf28ab9b" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.728596] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "port-34793d30-d1b3-47f7-9573-50f4bf28ab9b" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.728596] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "port-34793d30-d1b3-47f7-9573-50f4bf28ab9b" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.730257] env[69980]: DEBUG networking_nsxv3.api.rpc [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('34793d30-d1b3-47f7-9573-50f4bf28ab9b',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 779.850024] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-2961e549-f7d2-46b0-a1f4-9365d96bb58a taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.850024] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2961e549-f7d2-46b0-a1f4-9365d96bb58a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.850024] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2961e549-f7d2-46b0-a1f4-9365d96bb58a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.850024] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2961e549-f7d2-46b0-a1f4-9365d96bb58a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.850024] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.850024] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.850024] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.850024] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.850024] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.850024] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2961e549-f7d2-46b0-a1f4-9365d96bb58a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.850024] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-2961e549-f7d2-46b0-a1f4-9365d96bb58a taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.850024] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2961e549-f7d2-46b0-a1f4-9365d96bb58a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.850024] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2961e549-f7d2-46b0-a1f4-9365d96bb58a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.850024] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2961e549-f7d2-46b0-a1f4-9365d96bb58a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.850024] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.850024] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.851242] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.851242] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.851242] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.851242] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2961e549-f7d2-46b0-a1f4-9365d96bb58a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.851242] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('2961e549-f7d2-46b0-a1f4-9365d96bb58a',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 779.861987] env[69980]: INFO networking_nsxv3.common.synchronization [req-cf50f52a-dd84-48c6-b7ae-2be25655a9e9 req-681b0c11-8441-41a4-8a09-e72aa6b90709 service nova] Enqueued Resource ID: 3b94a139-70f4-4b1b-82e2-803c78f509bf with Priority: HIGHEST for action security_group_rules [ 779.861987] env[69980]: INFO networking_nsxv3.common.synchronization [req-cf50f52a-dd84-48c6-b7ae-2be25655a9e9 req-681b0c11-8441-41a4-8a09-e72aa6b90709 service nova] Enqueued Resource ID: 3b94a139-70f4-4b1b-82e2-803c78f509bf with Priority: HIGHEST for action security_group_members [ 779.861987] env[69980]: INFO networking_nsxv3.common.synchronization [req-cf50f52a-dd84-48c6-b7ae-2be25655a9e9 req-681b0c11-8441-41a4-8a09-e72aa6b90709 service nova] Enqueued Resource ID: 80f96566-f40b-430d-83a1-4bc36c04e27e with Priority: HIGHEST for action port [ 779.862951] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3b94a139-70f4-4b1b-82e2-803c78f509bf with Priority: HIGHEST for action security_group_rules [ 779.863349] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3b94a139-70f4-4b1b-82e2-803c78f509bf with Priority: HIGHEST for action security_group_members [ 779.866078] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 80f96566-f40b-430d-83a1-4bc36c04e27e with Priority: HIGHEST for action port [ 779.866078] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3b94a139-70f4-4b1b-82e2-803c78f509bf taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.866078] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3b94a139-70f4-4b1b-82e2-803c78f509bf" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.866078] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3b94a139-70f4-4b1b-82e2-803c78f509bf" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.866724] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3b94a139-70f4-4b1b-82e2-803c78f509bf" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.868017] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3b94a139-70f4-4b1b-82e2-803c78f509bf',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 779.868017] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-3b94a139-70f4-4b1b-82e2-803c78f509bf taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.868347] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3b94a139-70f4-4b1b-82e2-803c78f509bf" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.868699] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3b94a139-70f4-4b1b-82e2-803c78f509bf" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.869427] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3b94a139-70f4-4b1b-82e2-803c78f509bf" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.869427] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.869427] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.869736] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.872031] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.872031] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.872031] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3b94a139-70f4-4b1b-82e2-803c78f509bf',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 779.872031] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock port-80f96566-f40b-430d-83a1-4bc36c04e27e taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.872031] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-80f96566-f40b-430d-83a1-4bc36c04e27e" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.872031] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-80f96566-f40b-430d-83a1-4bc36c04e27e" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.872490] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-80f96566-f40b-430d-83a1-4bc36c04e27e" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.872618] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('80f96566-f40b-430d-83a1-4bc36c04e27e',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 780.239593] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.239593] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.239593] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.239593] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.239593] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.239593] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Segment Port 34793d30-d1b3-47f7-9573-50f4bf28ab9b not found, creating... [ 780.239593] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.239593] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.239593] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.239593] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.239593] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.240709] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.241571] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.242241] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.242612] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.242729] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.242925] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Resource: SegmentPort with ID: 34793d30-d1b3-47f7-9573-50f4bf28ab9b is going to be created. [ 780.285543] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.285543] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.285543] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.286104] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.286104] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.289933] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "port-34793d30-d1b3-47f7-9573-50f4bf28ab9b" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.354398] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 2961e549-f7d2-46b0-a1f4-9365d96bb58a: rpc.has_security_group_logging(os_id): False [ 780.374660] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.374951] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.374951] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.376176] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.376176] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.376176] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.376176] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.376176] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.376176] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.376176] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.377370] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.377370] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.377370] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.377370] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.377370] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.377370] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.378088] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.378088] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.378088] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.378088] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.378088] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2961e549-f7d2-46b0-a1f4-9365d96bb58a is going to be created. [ 780.382419] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3b94a139-70f4-4b1b-82e2-803c78f509bf',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 780.382419] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-3b94a139-70f4-4b1b-82e2-803c78f509bf taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.382419] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3b94a139-70f4-4b1b-82e2-803c78f509bf" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.382419] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 80f96566-f40b-430d-83a1-4bc36c04e27e with status ACTIVE [ 780.382419] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.382419] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.382419] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.382419] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.382419] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.382419] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.382419] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.382419] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.382419] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.382419] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.383197] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.383197] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.383197] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.383197] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.383197] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.383360] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 80f96566-f40b-430d-83a1-4bc36c04e27e is going to be updated. [ 780.436343] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.436343] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.436343] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.436343] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.436343] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.436343] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-80f96566-f40b-430d-83a1-4bc36c04e27e" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.515335] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.515335] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.515531] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.516452] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.516760] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.530469] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2961e549-f7d2-46b0-a1f4-9365d96bb58a in Status: IN_PROGRESS for 2s [ 780.885766] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3b94a139-70f4-4b1b-82e2-803c78f509bf',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 780.945318] env[69980]: INFO networking_nsxv3.common.synchronization [None req-15226f44-358d-4ba7-aa78-d227113143e0 None None] Enqueued Resource ID: 9a400993-cdc0-4efd-8f51-e73b292fc5ea with Priority: HIGHEST for action port [ 780.945318] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9a400993-cdc0-4efd-8f51-e73b292fc5ea with Priority: HIGHEST for action port [ 780.946287] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock port-9a400993-cdc0-4efd-8f51-e73b292fc5ea taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.947310] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9a400993-cdc0-4efd-8f51-e73b292fc5ea" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.947310] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9a400993-cdc0-4efd-8f51-e73b292fc5ea" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.947930] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9a400993-cdc0-4efd-8f51-e73b292fc5ea" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.947930] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9a400993-cdc0-4efd-8f51-e73b292fc5ea',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 781.058931] env[69980]: INFO networking_nsxv3.common.synchronization [req-93417249-28be-4db1-8e03-070ad431a7c8 req-753cbb9e-48ef-46d2-a08b-3ebc970e3f5c tempest-ImagesTestJSON-600722714 tempest-ImagesTestJSON-600722714-project-member] Enqueued Resource ID: 80e3ea48-91a5-4863-b1c2-f3e887204e39 with Priority: HIGHEST for action security_group_members [ 781.059760] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 80e3ea48-91a5-4863-b1c2-f3e887204e39 with Priority: HIGHEST for action security_group_members [ 781.062314] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-80e3ea48-91a5-4863-b1c2-f3e887204e39 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.062532] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-80e3ea48-91a5-4863-b1c2-f3e887204e39" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.062632] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-80e3ea48-91a5-4863-b1c2-f3e887204e39" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.063027] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-80e3ea48-91a5-4863-b1c2-f3e887204e39" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.063288] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.063437] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.063896] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.063896] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.063896] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.064090] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('80e3ea48-91a5-4863-b1c2-f3e887204e39',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 781.392036] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.392368] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.392368] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.393284] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.393284] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.393284] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3b94a139-70f4-4b1b-82e2-803c78f509bf is going to be created. [ 781.416052] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.416385] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.416385] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.416577] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.416691] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.426607] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3b94a139-70f4-4b1b-82e2-803c78f509bf in Status: UNINITIALIZED for 2s [ 781.455179] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 9a400993-cdc0-4efd-8f51-e73b292fc5ea [ 781.455179] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.455291] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.455391] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.455601] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.455700] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.455793] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:9a400993-cdc0-4efd-8f51-e73b292fc5ea already deleted. [ 781.455878] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9a400993-cdc0-4efd-8f51-e73b292fc5ea" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.477190] env[69980]: INFO networking_nsxv3.common.synchronization [req-389cad0c-0a40-4e1e-9dba-f5e51f5909ff req-cffe7a04-a333-4565-ba61-31fc2e100137 service nova] Enqueued Resource ID: 48dd2a84-68ac-43c8-a7e2-4cb28bb82546 with Priority: HIGHEST for action security_group_rules [ 781.477190] env[69980]: INFO networking_nsxv3.common.synchronization [req-389cad0c-0a40-4e1e-9dba-f5e51f5909ff req-cffe7a04-a333-4565-ba61-31fc2e100137 service nova] Enqueued Resource ID: 48dd2a84-68ac-43c8-a7e2-4cb28bb82546 with Priority: HIGHEST for action security_group_members [ 781.477190] env[69980]: INFO networking_nsxv3.common.synchronization [req-389cad0c-0a40-4e1e-9dba-f5e51f5909ff req-cffe7a04-a333-4565-ba61-31fc2e100137 service nova] Enqueued Resource ID: 34793d30-d1b3-47f7-9573-50f4bf28ab9b with Priority: HIGHEST for action port [ 781.477190] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 48dd2a84-68ac-43c8-a7e2-4cb28bb82546 with Priority: HIGHEST for action security_group_rules [ 781.477190] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 48dd2a84-68ac-43c8-a7e2-4cb28bb82546 with Priority: HIGHEST for action security_group_members [ 781.477190] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 34793d30-d1b3-47f7-9573-50f4bf28ab9b with Priority: HIGHEST for action port [ 781.477190] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock rules-48dd2a84-68ac-43c8-a7e2-4cb28bb82546 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.478320] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-48dd2a84-68ac-43c8-a7e2-4cb28bb82546" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.478320] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-48dd2a84-68ac-43c8-a7e2-4cb28bb82546" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.482081] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-48dd2a84-68ac-43c8-a7e2-4cb28bb82546" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.482081] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('48dd2a84-68ac-43c8-a7e2-4cb28bb82546',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 781.482081] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-48dd2a84-68ac-43c8-a7e2-4cb28bb82546 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.482081] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-48dd2a84-68ac-43c8-a7e2-4cb28bb82546" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.482081] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-48dd2a84-68ac-43c8-a7e2-4cb28bb82546" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.482081] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-48dd2a84-68ac-43c8-a7e2-4cb28bb82546" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.482081] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.482081] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.482081] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.482081] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.482081] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.482081] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('48dd2a84-68ac-43c8-a7e2-4cb28bb82546',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 781.483117] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock port-34793d30-d1b3-47f7-9573-50f4bf28ab9b taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.483555] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-34793d30-d1b3-47f7-9573-50f4bf28ab9b" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.483843] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-34793d30-d1b3-47f7-9573-50f4bf28ab9b" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.484170] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-34793d30-d1b3-47f7-9573-50f4bf28ab9b" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.484722] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('34793d30-d1b3-47f7-9573-50f4bf28ab9b',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 781.571879] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.573071] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.573071] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.573071] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.573071] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.573071] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.573071] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.573071] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.573071] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.573071] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.573936] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 80e3ea48-91a5-4863-b1c2-f3e887204e39 is going to be updated. [ 781.600456] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.600456] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.600456] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.600456] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.600456] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.606631] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 80e3ea48-91a5-4863-b1c2-f3e887204e39 in Status: IN_PROGRESS for 2s [ 781.986955] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('48dd2a84-68ac-43c8-a7e2-4cb28bb82546',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 781.989096] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-48dd2a84-68ac-43c8-a7e2-4cb28bb82546 taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.991081] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-48dd2a84-68ac-43c8-a7e2-4cb28bb82546" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.991923] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 34793d30-d1b3-47f7-9573-50f4bf28ab9b with status ACTIVE [ 781.995124] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.995124] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.995124] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.995124] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.997025] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.997025] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.997025] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.997025] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.997025] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.997025] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.997025] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.997025] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.997025] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.997025] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.997025] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.997025] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 34793d30-d1b3-47f7-9573-50f4bf28ab9b is going to be updated. [ 782.016370] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.016564] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.016610] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.016836] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.017033] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.017217] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-34793d30-d1b3-47f7-9573-50f4bf28ab9b" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.493750] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('48dd2a84-68ac-43c8-a7e2-4cb28bb82546',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 782.542488] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2961e549-f7d2-46b0-a1f4-9365d96bb58a in Status: SUCCESS [ 782.542488] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2961e549-f7d2-46b0-a1f4-9365d96bb58a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.998859] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.998859] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.998859] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.998859] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.998859] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.001028] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 48dd2a84-68ac-43c8-a7e2-4cb28bb82546 is going to be created. [ 783.027486] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.027486] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.027486] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.027486] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.027486] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.034129] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 48dd2a84-68ac-43c8-a7e2-4cb28bb82546 in Status: UNINITIALIZED for 2s [ 783.436558] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3b94a139-70f4-4b1b-82e2-803c78f509bf in Status: SUCCESS [ 783.438305] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3b94a139-70f4-4b1b-82e2-803c78f509bf" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.438937] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3b94a139-70f4-4b1b-82e2-803c78f509bf" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.438937] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3b94a139-70f4-4b1b-82e2-803c78f509bf" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.439073] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.439203] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.439272] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.439464] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.439576] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.439662] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3b94a139-70f4-4b1b-82e2-803c78f509bf" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.439764] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('3b94a139-70f4-4b1b-82e2-803c78f509bf',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 783.619664] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 80e3ea48-91a5-4863-b1c2-f3e887204e39 in Status: SUCCESS [ 783.619664] env[69980]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 80e3ea48-91a5-4863-b1c2-f3e887204e39 deletion is rescheduled due to dependency. [ 783.619664] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-80e3ea48-91a5-4863-b1c2-f3e887204e39" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.941878] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('3b94a139-70f4-4b1b-82e2-803c78f509bf',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 784.443985] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 3b94a139-70f4-4b1b-82e2-803c78f509bf: rpc.has_security_group_logging(os_id): False [ 784.464031] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.464273] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.464273] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.464559] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.464690] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.464971] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.465147] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.465234] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.465434] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.465545] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.465658] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3b94a139-70f4-4b1b-82e2-803c78f509bf is going to be created. [ 784.534697] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.534927] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.535062] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.535272] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.535498] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.545269] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3b94a139-70f4-4b1b-82e2-803c78f509bf in Status: IN_PROGRESS for 2s [ 785.043977] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 48dd2a84-68ac-43c8-a7e2-4cb28bb82546 in Status: SUCCESS [ 785.044305] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-48dd2a84-68ac-43c8-a7e2-4cb28bb82546" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.044549] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-48dd2a84-68ac-43c8-a7e2-4cb28bb82546" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.044682] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-48dd2a84-68ac-43c8-a7e2-4cb28bb82546" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.045833] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.045972] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.046045] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.047239] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.047343] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.047451] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-48dd2a84-68ac-43c8-a7e2-4cb28bb82546" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.047548] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('48dd2a84-68ac-43c8-a7e2-4cb28bb82546',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 785.552559] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-48dd2a84-68ac-43c8-a7e2-4cb28bb82546 taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.552736] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-48dd2a84-68ac-43c8-a7e2-4cb28bb82546" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.552836] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-48dd2a84-68ac-43c8-a7e2-4cb28bb82546" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.553086] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-48dd2a84-68ac-43c8-a7e2-4cb28bb82546" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.553312] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.553424] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.553490] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.553649] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.553737] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.553858] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-48dd2a84-68ac-43c8-a7e2-4cb28bb82546" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.554043] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-48dd2a84-68ac-43c8-a7e2-4cb28bb82546 taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.554152] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-48dd2a84-68ac-43c8-a7e2-4cb28bb82546" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.554214] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-48dd2a84-68ac-43c8-a7e2-4cb28bb82546" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.554390] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-48dd2a84-68ac-43c8-a7e2-4cb28bb82546" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.554537] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.554654] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.554717] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.554986] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.554986] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.555060] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-48dd2a84-68ac-43c8-a7e2-4cb28bb82546" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.555896] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('48dd2a84-68ac-43c8-a7e2-4cb28bb82546',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 786.063210] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 48dd2a84-68ac-43c8-a7e2-4cb28bb82546: rpc.has_security_group_logging(os_id): False [ 786.079895] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.080501] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.080845] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.081262] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.081510] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.081863] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.083287] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.083287] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.083287] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.083287] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.084616] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.084616] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.084909] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.085615] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.085615] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.085822] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.086071] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.086423] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.086715] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.088170] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.088170] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 48dd2a84-68ac-43c8-a7e2-4cb28bb82546 is going to be created. [ 786.143582] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.143582] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.143582] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.143582] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.143582] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.153583] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 48dd2a84-68ac-43c8-a7e2-4cb28bb82546 in Status: IN_PROGRESS for 2s [ 786.477403] env[69980]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 786.477403] env[69980]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=2 [ 786.559418] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3b94a139-70f4-4b1b-82e2-803c78f509bf in Status: SUCCESS [ 786.559418] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3b94a139-70f4-4b1b-82e2-803c78f509bf" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.767119] env[69980]: INFO networking_nsxv3.common.synchronization [req-104a47f4-f7dd-40dc-a4a3-ff77bf87ea9c req-707b3888-2b81-4431-a70e-de843caaadc8 tempest-ListImageFiltersTestJSON-1575668155 tempest-ListImageFiltersTestJSON-1575668155-project-member] Enqueued Resource ID: 241bcad9-5919-4c26-b0b9-beb6a98733bd with Priority: HIGHEST for action security_group_members [ 787.767667] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 241bcad9-5919-4c26-b0b9-beb6a98733bd with Priority: HIGHEST for action security_group_members [ 787.767976] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-241bcad9-5919-4c26-b0b9-beb6a98733bd taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.768113] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-241bcad9-5919-4c26-b0b9-beb6a98733bd" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.768181] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-241bcad9-5919-4c26-b0b9-beb6a98733bd" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.768435] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-241bcad9-5919-4c26-b0b9-beb6a98733bd" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.768602] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.768727] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.768787] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.768960] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.771154] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.771389] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('241bcad9-5919-4c26-b0b9-beb6a98733bd',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 788.165635] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 48dd2a84-68ac-43c8-a7e2-4cb28bb82546 in Status: SUCCESS [ 788.165824] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-48dd2a84-68ac-43c8-a7e2-4cb28bb82546" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.278388] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.278728] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.278728] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.279119] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.279119] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.279119] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.279542] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.279542] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.279542] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.279542] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.279662] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 241bcad9-5919-4c26-b0b9-beb6a98733bd already deleted. [ 788.279662] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-241bcad9-5919-4c26-b0b9-beb6a98733bd" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.469985] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock network-557 taken with stack trace [, , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.470198] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "network-557" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.470315] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "network-557" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.470632] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "network-557" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.470938] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.471124] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.471240] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.471461] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.471604] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.471810] env[69980]: DEBUG dogpile.cache.region [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] No value present for key: 'zone-id' {{(pid=69980) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 788.471919] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] NeedRegenerationException {{(pid=69980) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 788.472463] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] no value, waiting for create lock {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 788.472463] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] value creation lock acquired {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 788.472463] env[69980]: DEBUG dogpile.cache.region [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] No value present for key: 'zone-id' {{(pid=69980) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 788.472463] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Calling creation function for not-yet-present value {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 788.472674] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 788.475719] env[69980]: INFO networking_nsxv3.common.synchronization [req-e4039a6b-5ae0-428f-a532-6e2fa5d129d0 req-b678043e-b73f-4760-a528-0d0ae5788363 tempest-ServerDiskConfigTestJSON-214268531 tempest-ServerDiskConfigTestJSON-214268531-project-member] Enqueued Resource ID: 0dbf2bcd-0572-43ef-b18d-cc3cca7fcfd5 with Priority: HIGHEST for action security_group_members [ 788.476228] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0dbf2bcd-0572-43ef-b18d-cc3cca7fcfd5 with Priority: HIGHEST for action security_group_members [ 788.476721] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-0dbf2bcd-0572-43ef-b18d-cc3cca7fcfd5 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.476838] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0dbf2bcd-0572-43ef-b18d-cc3cca7fcfd5" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.476907] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0dbf2bcd-0572-43ef-b18d-cc3cca7fcfd5" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.477103] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0dbf2bcd-0572-43ef-b18d-cc3cca7fcfd5" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.477391] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.477710] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.477783] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.477939] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.478098] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.478148] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0dbf2bcd-0572-43ef-b18d-cc3cca7fcfd5',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 788.490645] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 788.490842] env[69980]: DEBUG dogpile.cache.region [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=69980) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 788.490985] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Released creation lock {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 788.491191] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "network-557" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.491497] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock port-f2197c91-39f0-4bc0-9df1-4eb83596f6c6 taken with stack trace [, , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.491677] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "port-f2197c91-39f0-4bc0-9df1-4eb83596f6c6" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.491780] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "port-f2197c91-39f0-4bc0-9df1-4eb83596f6c6" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.492172] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "port-f2197c91-39f0-4bc0-9df1-4eb83596f6c6" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.492348] env[69980]: DEBUG networking_nsxv3.api.rpc [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f2197c91-39f0-4bc0-9df1-4eb83596f6c6',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 788.816269] env[69980]: INFO networking_nsxv3.common.synchronization [None req-32db231f-390f-43ac-a098-d53f7d44b07d None None] Enqueued Resource ID: 2b5e9ae7-2ee0-49da-80cc-fcf59afeeea6 with Priority: HIGHEST for action port [ 788.817212] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2b5e9ae7-2ee0-49da-80cc-fcf59afeeea6 with Priority: HIGHEST for action port [ 788.818598] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock port-2b5e9ae7-2ee0-49da-80cc-fcf59afeeea6 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.818598] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2b5e9ae7-2ee0-49da-80cc-fcf59afeeea6" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.818598] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2b5e9ae7-2ee0-49da-80cc-fcf59afeeea6" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.818598] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2b5e9ae7-2ee0-49da-80cc-fcf59afeeea6" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.818598] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2b5e9ae7-2ee0-49da-80cc-fcf59afeeea6',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 788.982672] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.984013] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.984013] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.984509] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.984612] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.984825] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.984927] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.984990] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.985161] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.985235] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.985671] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0dbf2bcd-0572-43ef-b18d-cc3cca7fcfd5 is going to be updated. [ 788.995708] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.995991] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.996159] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.997637] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.997637] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.997637] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Segment Port f2197c91-39f0-4bc0-9df1-4eb83596f6c6 not found, creating... [ 788.997637] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.997637] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.997637] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.997637] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.998680] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.998680] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.998680] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.998680] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.998680] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.998874] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.998998] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Resource: SegmentPort with ID: f2197c91-39f0-4bc0-9df1-4eb83596f6c6 is going to be created. [ 789.013344] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.013344] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.013344] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.013344] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.013344] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.023035] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.023174] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.023332] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.023618] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.023862] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.024185] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "port-f2197c91-39f0-4bc0-9df1-4eb83596f6c6" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.025739] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0dbf2bcd-0572-43ef-b18d-cc3cca7fcfd5 in Status: IN_PROGRESS for 2s [ 789.323834] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 2b5e9ae7-2ee0-49da-80cc-fcf59afeeea6 [ 789.324138] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.324282] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.324341] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.324556] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.324642] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.324737] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:2b5e9ae7-2ee0-49da-80cc-fcf59afeeea6 already deleted. [ 789.324818] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2b5e9ae7-2ee0-49da-80cc-fcf59afeeea6" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.850644] env[69980]: INFO networking_nsxv3.common.synchronization [req-104a47f4-f7dd-40dc-a4a3-ff77bf87ea9c req-73ba27af-8c7f-47d1-8551-8ad22766f170 service nova] Enqueued Resource ID: 241bcad9-5919-4c26-b0b9-beb6a98733bd with Priority: HIGHEST for action security_group_rules [ 789.850894] env[69980]: INFO networking_nsxv3.common.synchronization [req-104a47f4-f7dd-40dc-a4a3-ff77bf87ea9c req-73ba27af-8c7f-47d1-8551-8ad22766f170 service nova] Enqueued Resource ID: 241bcad9-5919-4c26-b0b9-beb6a98733bd with Priority: HIGHEST for action security_group_members [ 789.851482] env[69980]: INFO networking_nsxv3.common.synchronization [req-104a47f4-f7dd-40dc-a4a3-ff77bf87ea9c req-73ba27af-8c7f-47d1-8551-8ad22766f170 service nova] Enqueued Resource ID: f2197c91-39f0-4bc0-9df1-4eb83596f6c6 with Priority: HIGHEST for action port [ 789.852071] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 241bcad9-5919-4c26-b0b9-beb6a98733bd with Priority: HIGHEST for action security_group_rules [ 789.853478] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 241bcad9-5919-4c26-b0b9-beb6a98733bd with Priority: HIGHEST for action security_group_members [ 789.853590] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f2197c91-39f0-4bc0-9df1-4eb83596f6c6 with Priority: HIGHEST for action port [ 789.853876] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock rules-241bcad9-5919-4c26-b0b9-beb6a98733bd taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.853996] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-241bcad9-5919-4c26-b0b9-beb6a98733bd" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.854139] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-241bcad9-5919-4c26-b0b9-beb6a98733bd" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.854340] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-241bcad9-5919-4c26-b0b9-beb6a98733bd" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.854736] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('241bcad9-5919-4c26-b0b9-beb6a98733bd',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 789.855378] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-241bcad9-5919-4c26-b0b9-beb6a98733bd taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.855516] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-241bcad9-5919-4c26-b0b9-beb6a98733bd" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.855996] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-241bcad9-5919-4c26-b0b9-beb6a98733bd" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.856244] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-241bcad9-5919-4c26-b0b9-beb6a98733bd" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.856430] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.856537] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.856599] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.856739] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.856843] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.856925] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('241bcad9-5919-4c26-b0b9-beb6a98733bd',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 789.857714] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock port-f2197c91-39f0-4bc0-9df1-4eb83596f6c6 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.857823] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f2197c91-39f0-4bc0-9df1-4eb83596f6c6" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.859304] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f2197c91-39f0-4bc0-9df1-4eb83596f6c6" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.859482] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f2197c91-39f0-4bc0-9df1-4eb83596f6c6" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.859586] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f2197c91-39f0-4bc0-9df1-4eb83596f6c6',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 790.361622] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('241bcad9-5919-4c26-b0b9-beb6a98733bd',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 790.366038] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-241bcad9-5919-4c26-b0b9-beb6a98733bd taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.366038] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-241bcad9-5919-4c26-b0b9-beb6a98733bd" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.366566] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f2197c91-39f0-4bc0-9df1-4eb83596f6c6 with status ACTIVE [ 790.366853] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.367229] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.367440] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.371267] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.371267] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.371267] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.371267] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.371267] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.372937] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.372937] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.373067] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.373555] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.373555] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.373658] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.373706] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.373952] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f2197c91-39f0-4bc0-9df1-4eb83596f6c6 is going to be updated. [ 790.414136] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.414215] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.414285] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.414514] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.414655] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.414816] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f2197c91-39f0-4bc0-9df1-4eb83596f6c6" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.801287] env[69980]: INFO networking_nsxv3.common.synchronization [None req-02f5c6dd-63b8-420a-bd35-d71b55eb339f None None] Enqueued Resource ID: b97935d3-b602-474e-842c-c52c16ad86d4 with Priority: HIGHEST for action port [ 790.801847] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b97935d3-b602-474e-842c-c52c16ad86d4 with Priority: HIGHEST for action port [ 790.802196] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock port-b97935d3-b602-474e-842c-c52c16ad86d4 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.802359] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b97935d3-b602-474e-842c-c52c16ad86d4" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.802440] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b97935d3-b602-474e-842c-c52c16ad86d4" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.802786] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b97935d3-b602-474e-842c-c52c16ad86d4" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.802858] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b97935d3-b602-474e-842c-c52c16ad86d4',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 790.869965] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('241bcad9-5919-4c26-b0b9-beb6a98733bd',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 791.008492] env[69980]: INFO networking_nsxv3.common.synchronization [None req-d1eff913-47ce-4461-92c5-745fb901d0d0 None None] Enqueued Resource ID: 268504d3-fc8c-424c-8327-f0b836718bf9 with Priority: HIGHEST for action port [ 791.009443] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 268504d3-fc8c-424c-8327-f0b836718bf9 with Priority: HIGHEST for action port [ 791.010142] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock port-268504d3-fc8c-424c-8327-f0b836718bf9 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.010142] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-268504d3-fc8c-424c-8327-f0b836718bf9" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.010142] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-268504d3-fc8c-424c-8327-f0b836718bf9" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.010410] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-268504d3-fc8c-424c-8327-f0b836718bf9" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.010410] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('268504d3-fc8c-424c-8327-f0b836718bf9',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 791.036910] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0dbf2bcd-0572-43ef-b18d-cc3cca7fcfd5 in Status: SUCCESS [ 791.037107] env[69980]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0dbf2bcd-0572-43ef-b18d-cc3cca7fcfd5 deletion is rescheduled due to dependency. [ 791.037216] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0dbf2bcd-0572-43ef-b18d-cc3cca7fcfd5" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.310191] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b97935d3-b602-474e-842c-c52c16ad86d4 [ 791.310191] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.310191] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.310191] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.310191] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.310191] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.310555] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b97935d3-b602-474e-842c-c52c16ad86d4 already deleted. [ 791.310555] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b97935d3-b602-474e-842c-c52c16ad86d4" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.373988] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.373988] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.373988] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.373988] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.373988] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.373988] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 241bcad9-5919-4c26-b0b9-beb6a98733bd is going to be created. [ 791.394301] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.394447] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.394681] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.394764] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.394867] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.406671] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 241bcad9-5919-4c26-b0b9-beb6a98733bd in Status: UNINITIALIZED for 2s [ 791.513992] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 268504d3-fc8c-424c-8327-f0b836718bf9 [ 791.514262] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.514409] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.514486] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.514679] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.514765] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.514865] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:268504d3-fc8c-424c-8327-f0b836718bf9 already deleted. [ 791.514949] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-268504d3-fc8c-424c-8327-f0b836718bf9" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.052057] env[69980]: INFO networking_nsxv3.common.synchronization [req-2888a97c-f3b7-48c4-b531-594beab90c2c req-46a44451-8148-4e76-b3f5-502220113871 tempest-ListImageFiltersTestJSON-1575668155 tempest-ListImageFiltersTestJSON-1575668155-project-member] Enqueued Resource ID: 241bcad9-5919-4c26-b0b9-beb6a98733bd with Priority: HIGHEST for action security_group_members [ 793.052546] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 241bcad9-5919-4c26-b0b9-beb6a98733bd with Priority: HIGHEST for action security_group_members [ 793.052886] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-241bcad9-5919-4c26-b0b9-beb6a98733bd taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.053198] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-241bcad9-5919-4c26-b0b9-beb6a98733bd" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.418415] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 241bcad9-5919-4c26-b0b9-beb6a98733bd in Status: SUCCESS [ 793.418415] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-241bcad9-5919-4c26-b0b9-beb6a98733bd" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.418415] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-241bcad9-5919-4c26-b0b9-beb6a98733bd" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.418415] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-241bcad9-5919-4c26-b0b9-beb6a98733bd" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.418415] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.418415] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.418415] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.418415] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.418415] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.418415] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-241bcad9-5919-4c26-b0b9-beb6a98733bd" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.418415] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('241bcad9-5919-4c26-b0b9-beb6a98733bd',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 793.419255] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-241bcad9-5919-4c26-b0b9-beb6a98733bd" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.419975] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-241bcad9-5919-4c26-b0b9-beb6a98733bd" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.420309] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.421790] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.421790] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.421790] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.421790] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.421790] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('241bcad9-5919-4c26-b0b9-beb6a98733bd',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 793.539874] env[69980]: INFO networking_nsxv3.common.synchronization [None req-2d6b5796-b213-43bc-97dc-c1d93a16d7a2 None None] Enqueued Resource ID: 1089faaf-19c1-4446-84c7-988069de004d with Priority: HIGHEST for action port [ 793.540650] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1089faaf-19c1-4446-84c7-988069de004d with Priority: HIGHEST for action port [ 793.541106] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock port-1089faaf-19c1-4446-84c7-988069de004d taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.541266] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1089faaf-19c1-4446-84c7-988069de004d" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.541266] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1089faaf-19c1-4446-84c7-988069de004d" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.541483] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1089faaf-19c1-4446-84c7-988069de004d" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.541550] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1089faaf-19c1-4446-84c7-988069de004d',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 793.805479] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock network-557 taken with stack trace [, , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.805693] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "network-557" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.805819] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "network-557" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.806149] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "network-557" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.806389] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.806552] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.806673] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.806940] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.807128] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.807382] env[69980]: DEBUG dogpile.cache.region [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] No value present for key: 'zone-id' {{(pid=69980) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 793.807456] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] NeedRegenerationException {{(pid=69980) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 793.807565] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] no value, waiting for create lock {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 793.807780] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] value creation lock acquired {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 793.807780] env[69980]: DEBUG dogpile.cache.region [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] No value present for key: 'zone-id' {{(pid=69980) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 793.807898] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Calling creation function for not-yet-present value {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 793.808012] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 793.825179] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 793.825350] env[69980]: DEBUG dogpile.cache.region [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Cache value generated in 0.017 seconds for key(s): 'zone-id' {{(pid=69980) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 793.825492] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Released creation lock {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 793.825665] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "network-557" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.825970] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock port-c2cc38fd-874d-46b0-9796-6b7ed9bc9dd1 taken with stack trace [, , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.826160] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "port-c2cc38fd-874d-46b0-9796-6b7ed9bc9dd1" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.826307] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "port-c2cc38fd-874d-46b0-9796-6b7ed9bc9dd1" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.826609] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "port-c2cc38fd-874d-46b0-9796-6b7ed9bc9dd1" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.826746] env[69980]: DEBUG networking_nsxv3.api.rpc [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c2cc38fd-874d-46b0-9796-6b7ed9bc9dd1',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 793.852009] env[69980]: INFO networking_nsxv3.common.synchronization [req-e706a4e4-cde8-436a-997b-06d99f608d60 req-f05d09cc-e0f7-4844-8ca6-fbc2338de06b tempest-ImagesOneServerTestJSON-1417450468 tempest-ImagesOneServerTestJSON-1417450468-project-member] Enqueued Resource ID: bf060907-afd6-4dc2-b6bb-9fd99f7f9dad with Priority: HIGHEST for action security_group_members [ 793.852222] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bf060907-afd6-4dc2-b6bb-9fd99f7f9dad with Priority: HIGHEST for action security_group_members [ 793.852524] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-bf060907-afd6-4dc2-b6bb-9fd99f7f9dad taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.852645] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bf060907-afd6-4dc2-b6bb-9fd99f7f9dad" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.852710] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bf060907-afd6-4dc2-b6bb-9fd99f7f9dad" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.853410] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bf060907-afd6-4dc2-b6bb-9fd99f7f9dad" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.853410] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.853410] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.853410] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.853691] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.854015] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.854015] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bf060907-afd6-4dc2-b6bb-9fd99f7f9dad',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 793.922893] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-241bcad9-5919-4c26-b0b9-beb6a98733bd taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.923286] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-241bcad9-5919-4c26-b0b9-beb6a98733bd" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.925616] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('241bcad9-5919-4c26-b0b9-beb6a98733bd',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 794.043750] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 1089faaf-19c1-4446-84c7-988069de004d [ 794.043909] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.044064] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.044129] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.044356] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.044486] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.044613] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:1089faaf-19c1-4446-84c7-988069de004d already deleted. [ 794.044708] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1089faaf-19c1-4446-84c7-988069de004d" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.331946] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.332424] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.332424] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.332572] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.332721] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.332909] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Segment Port c2cc38fd-874d-46b0-9796-6b7ed9bc9dd1 not found, creating... [ 794.333181] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.333340] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.333457] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.333680] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.333814] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.334107] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.334264] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.334397] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.334587] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.334716] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.334857] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Resource: SegmentPort with ID: c2cc38fd-874d-46b0-9796-6b7ed9bc9dd1 is going to be created. [ 794.355922] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.356117] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.356185] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.356371] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.356460] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.356654] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.356746] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.356816] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.357419] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.357419] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.357419] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bf060907-afd6-4dc2-b6bb-9fd99f7f9dad is going to be updated. [ 794.360905] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.361148] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.361338] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.361507] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.361725] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.361945] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "port-c2cc38fd-874d-46b0-9796-6b7ed9bc9dd1" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.382167] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.382372] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.382446] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.385626] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.385626] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.391073] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bf060907-afd6-4dc2-b6bb-9fd99f7f9dad in Status: IN_PROGRESS for 2s [ 794.428221] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('241bcad9-5919-4c26-b0b9-beb6a98733bd',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 794.935021] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.935259] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.935259] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.935399] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.935493] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.935604] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 241bcad9-5919-4c26-b0b9-beb6a98733bd is going to be updated. [ 794.968505] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.968745] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.969089] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.969141] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.969294] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.980471] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 241bcad9-5919-4c26-b0b9-beb6a98733bd in Status: IN_PROGRESS for 2s [ 795.132643] env[69980]: INFO networking_nsxv3.common.synchronization [req-2888a97c-f3b7-48c4-b531-594beab90c2c req-9c1333ad-fd93-4eab-9a59-002fb199f41a service nova] Enqueued Resource ID: 241bcad9-5919-4c26-b0b9-beb6a98733bd with Priority: HIGHEST for action security_group_rules [ 795.132945] env[69980]: INFO networking_nsxv3.common.synchronization [req-2888a97c-f3b7-48c4-b531-594beab90c2c req-9c1333ad-fd93-4eab-9a59-002fb199f41a service nova] Enqueued Resource ID: 241bcad9-5919-4c26-b0b9-beb6a98733bd with Priority: HIGHEST for action security_group_members [ 795.133364] env[69980]: INFO networking_nsxv3.common.synchronization [req-2888a97c-f3b7-48c4-b531-594beab90c2c req-9c1333ad-fd93-4eab-9a59-002fb199f41a service nova] Enqueued Resource ID: c2cc38fd-874d-46b0-9796-6b7ed9bc9dd1 with Priority: HIGHEST for action port [ 795.133760] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 241bcad9-5919-4c26-b0b9-beb6a98733bd with Priority: HIGHEST for action security_group_rules [ 795.133972] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 241bcad9-5919-4c26-b0b9-beb6a98733bd with Priority: HIGHEST for action security_group_members [ 795.134119] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c2cc38fd-874d-46b0-9796-6b7ed9bc9dd1 with Priority: HIGHEST for action port [ 795.134406] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock rules-241bcad9-5919-4c26-b0b9-beb6a98733bd taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.134560] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-241bcad9-5919-4c26-b0b9-beb6a98733bd" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.134706] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-241bcad9-5919-4c26-b0b9-beb6a98733bd taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.134780] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-241bcad9-5919-4c26-b0b9-beb6a98733bd" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.134947] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock port-c2cc38fd-874d-46b0-9796-6b7ed9bc9dd1 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.135056] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c2cc38fd-874d-46b0-9796-6b7ed9bc9dd1" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.135123] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c2cc38fd-874d-46b0-9796-6b7ed9bc9dd1" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.135314] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c2cc38fd-874d-46b0-9796-6b7ed9bc9dd1" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.135396] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c2cc38fd-874d-46b0-9796-6b7ed9bc9dd1',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 795.638678] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c2cc38fd-874d-46b0-9796-6b7ed9bc9dd1 with status ACTIVE [ 795.638956] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.639080] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.639145] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.639352] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.639439] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.639619] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.639717] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.639776] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.639924] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.639997] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.640185] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.640298] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.640357] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.640500] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.640572] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.640654] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c2cc38fd-874d-46b0-9796-6b7ed9bc9dd1 is going to be updated. [ 795.661631] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.661631] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.661631] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.661631] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.661631] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.662064] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c2cc38fd-874d-46b0-9796-6b7ed9bc9dd1" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.405022] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bf060907-afd6-4dc2-b6bb-9fd99f7f9dad in Status: SUCCESS [ 796.405022] env[69980]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bf060907-afd6-4dc2-b6bb-9fd99f7f9dad deletion is rescheduled due to dependency. [ 796.405022] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bf060907-afd6-4dc2-b6bb-9fd99f7f9dad" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.986909] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 241bcad9-5919-4c26-b0b9-beb6a98733bd in Status: SUCCESS [ 796.987206] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-241bcad9-5919-4c26-b0b9-beb6a98733bd" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.987389] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-241bcad9-5919-4c26-b0b9-beb6a98733bd" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.987597] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-241bcad9-5919-4c26-b0b9-beb6a98733bd" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.987803] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.987929] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.987996] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.988189] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.988275] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.988370] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-241bcad9-5919-4c26-b0b9-beb6a98733bd" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.988549] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-241bcad9-5919-4c26-b0b9-beb6a98733bd taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.988635] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-241bcad9-5919-4c26-b0b9-beb6a98733bd" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.988757] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-241bcad9-5919-4c26-b0b9-beb6a98733bd" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.988841] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-241bcad9-5919-4c26-b0b9-beb6a98733bd" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.988992] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.992728] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.992834] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.993061] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.993164] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.993238] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-241bcad9-5919-4c26-b0b9-beb6a98733bd" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.993330] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('241bcad9-5919-4c26-b0b9-beb6a98733bd',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 796.997648] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-241bcad9-5919-4c26-b0b9-beb6a98733bd" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.997846] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-241bcad9-5919-4c26-b0b9-beb6a98733bd" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.999950] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.999950] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.999950] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.999950] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.999950] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.999950] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('241bcad9-5919-4c26-b0b9-beb6a98733bd',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 797.500551] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 241bcad9-5919-4c26-b0b9-beb6a98733bd: rpc.has_security_group_logging(os_id): False [ 797.503328] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('241bcad9-5919-4c26-b0b9-beb6a98733bd',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 797.518461] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.518609] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.518675] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.519365] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.519365] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.519365] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.519365] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.519582] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.519616] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.519684] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.520145] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.520145] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.520288] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.520330] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.520468] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.520566] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.520657] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.520712] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.522456] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.522655] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.522811] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 241bcad9-5919-4c26-b0b9-beb6a98733bd is going to be created. [ 797.586077] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.586077] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.586077] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.586318] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.586484] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.596770] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 241bcad9-5919-4c26-b0b9-beb6a98733bd in Status: IN_PROGRESS for 2s [ 798.005820] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('241bcad9-5919-4c26-b0b9-beb6a98733bd',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 798.295369] env[69980]: INFO networking_nsxv3.common.synchronization [req-e83ffb46-640a-484a-8371-24fc490f7ea7 req-dc2d6018-c57f-4e13-a161-4417bca832e4 tempest-TenantUsagesTestJSON-627674300 tempest-TenantUsagesTestJSON-627674300-project-member] Enqueued Resource ID: 75895721-8b52-47a4-a352-95fd377b4204 with Priority: HIGHEST for action security_group_members [ 798.295880] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 75895721-8b52-47a4-a352-95fd377b4204 with Priority: HIGHEST for action security_group_members [ 798.296186] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-75895721-8b52-47a4-a352-95fd377b4204 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.296307] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-75895721-8b52-47a4-a352-95fd377b4204" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.296368] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-75895721-8b52-47a4-a352-95fd377b4204" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.296622] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-75895721-8b52-47a4-a352-95fd377b4204" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.296772] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.297065] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.297135] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.297296] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.297376] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.297465] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('75895721-8b52-47a4-a352-95fd377b4204',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 798.513556] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.513556] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.513556] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.513556] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.513556] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.513556] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 241bcad9-5919-4c26-b0b9-beb6a98733bd is going to be updated. [ 798.540452] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.540452] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.540452] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.540452] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.540636] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.549243] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 241bcad9-5919-4c26-b0b9-beb6a98733bd in Status: IN_PROGRESS for 2s [ 798.801555] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.802106] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.802106] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.802225] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.802352] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.802589] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.802706] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.802767] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.802994] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.803069] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.803168] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 75895721-8b52-47a4-a352-95fd377b4204 already deleted. [ 798.803256] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-75895721-8b52-47a4-a352-95fd377b4204" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.805303] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock network-557 taken with stack trace [, , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.805618] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "network-557" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.805836] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "network-557" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.806238] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "network-557" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.806639] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.806904] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.807139] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.807472] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.807760] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.808048] env[69980]: DEBUG dogpile.cache.region [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] No value present for key: 'zone-id' {{(pid=69980) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 798.808263] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] NeedRegenerationException {{(pid=69980) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 798.808472] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] no value, waiting for create lock {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 798.808701] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] value creation lock acquired {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 798.808933] env[69980]: DEBUG dogpile.cache.region [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] No value present for key: 'zone-id' {{(pid=69980) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 798.809178] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Calling creation function for not-yet-present value {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 798.809437] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 798.827925] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 798.828141] env[69980]: DEBUG dogpile.cache.region [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=69980) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 798.828296] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Released creation lock {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 798.828482] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "network-557" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.828854] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock port-44370ac6-14fc-4933-9bf2-a7f42b019ad6 taken with stack trace [, , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.829062] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "port-44370ac6-14fc-4933-9bf2-a7f42b019ad6" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.829238] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "port-44370ac6-14fc-4933-9bf2-a7f42b019ad6" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.829551] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "port-44370ac6-14fc-4933-9bf2-a7f42b019ad6" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.829708] env[69980]: DEBUG networking_nsxv3.api.rpc [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('44370ac6-14fc-4933-9bf2-a7f42b019ad6',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 799.333763] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.334443] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.334842] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.335448] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.341260] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.341260] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Segment Port 44370ac6-14fc-4933-9bf2-a7f42b019ad6 not found, creating... [ 799.341260] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.341260] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.341260] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.341260] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.341260] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.341260] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.341260] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.344605] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.344605] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.344605] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.344605] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Resource: SegmentPort with ID: 44370ac6-14fc-4933-9bf2-a7f42b019ad6 is going to be created. [ 799.366038] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.366038] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.366038] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.366038] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.366038] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.366038] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "port-44370ac6-14fc-4933-9bf2-a7f42b019ad6" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.544233] env[69980]: INFO networking_nsxv3.common.synchronization [None req-ac919868-8b55-439c-91a4-1af619ceedd0 None None] Enqueued Resource ID: df47df32-95ac-4326-9498-fa71327e3b95 with Priority: HIGHEST for action port [ 799.544233] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: df47df32-95ac-4326-9498-fa71327e3b95 with Priority: HIGHEST for action port [ 799.544233] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock port-df47df32-95ac-4326-9498-fa71327e3b95 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.544233] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-df47df32-95ac-4326-9498-fa71327e3b95" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.544233] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-df47df32-95ac-4326-9498-fa71327e3b95" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.544233] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-df47df32-95ac-4326-9498-fa71327e3b95" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.544233] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('df47df32-95ac-4326-9498-fa71327e3b95',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 799.610925] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 241bcad9-5919-4c26-b0b9-beb6a98733bd in Status: SUCCESS [ 799.610925] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-241bcad9-5919-4c26-b0b9-beb6a98733bd" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.610925] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-241bcad9-5919-4c26-b0b9-beb6a98733bd" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.610925] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-241bcad9-5919-4c26-b0b9-beb6a98733bd" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.610925] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('241bcad9-5919-4c26-b0b9-beb6a98733bd',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 800.051021] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port df47df32-95ac-4326-9498-fa71327e3b95 [ 800.051021] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.051021] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.051021] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.051021] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.051021] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.051021] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:df47df32-95ac-4326-9498-fa71327e3b95 already deleted. [ 800.051021] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-df47df32-95ac-4326-9498-fa71327e3b95" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.116454] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-241bcad9-5919-4c26-b0b9-beb6a98733bd taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.116454] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-241bcad9-5919-4c26-b0b9-beb6a98733bd" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.227554] env[69980]: INFO networking_nsxv3.common.synchronization [req-e83ffb46-640a-484a-8371-24fc490f7ea7 req-051cb795-3101-4fab-8805-6d25d54549c8 service nova] Enqueued Resource ID: 75895721-8b52-47a4-a352-95fd377b4204 with Priority: HIGHEST for action security_group_rules [ 800.227554] env[69980]: INFO networking_nsxv3.common.synchronization [req-e83ffb46-640a-484a-8371-24fc490f7ea7 req-051cb795-3101-4fab-8805-6d25d54549c8 service nova] Enqueued Resource ID: 75895721-8b52-47a4-a352-95fd377b4204 with Priority: HIGHEST for action security_group_members [ 800.227554] env[69980]: INFO networking_nsxv3.common.synchronization [req-e83ffb46-640a-484a-8371-24fc490f7ea7 req-051cb795-3101-4fab-8805-6d25d54549c8 service nova] Enqueued Resource ID: 44370ac6-14fc-4933-9bf2-a7f42b019ad6 with Priority: HIGHEST for action port [ 800.227740] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 75895721-8b52-47a4-a352-95fd377b4204 with Priority: HIGHEST for action security_group_rules [ 800.227868] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 75895721-8b52-47a4-a352-95fd377b4204 with Priority: HIGHEST for action security_group_members [ 800.228044] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 44370ac6-14fc-4933-9bf2-a7f42b019ad6 with Priority: HIGHEST for action port [ 800.228551] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock rules-75895721-8b52-47a4-a352-95fd377b4204 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.228826] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-75895721-8b52-47a4-a352-95fd377b4204" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.228826] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-75895721-8b52-47a4-a352-95fd377b4204" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.228988] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-75895721-8b52-47a4-a352-95fd377b4204" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.230730] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('75895721-8b52-47a4-a352-95fd377b4204',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 800.232103] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-75895721-8b52-47a4-a352-95fd377b4204 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.232459] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-75895721-8b52-47a4-a352-95fd377b4204" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.232459] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-75895721-8b52-47a4-a352-95fd377b4204" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.232716] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-75895721-8b52-47a4-a352-95fd377b4204" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.232977] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.232977] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.233447] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.233447] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.233447] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.233622] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('75895721-8b52-47a4-a352-95fd377b4204',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 800.235179] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock port-44370ac6-14fc-4933-9bf2-a7f42b019ad6 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.235179] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-44370ac6-14fc-4933-9bf2-a7f42b019ad6" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.235179] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-44370ac6-14fc-4933-9bf2-a7f42b019ad6" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.235438] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-44370ac6-14fc-4933-9bf2-a7f42b019ad6" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.235438] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('44370ac6-14fc-4933-9bf2-a7f42b019ad6',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 800.559454] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 241bcad9-5919-4c26-b0b9-beb6a98733bd in Status: SUCCESS [ 800.559770] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-241bcad9-5919-4c26-b0b9-beb6a98733bd" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.560289] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-241bcad9-5919-4c26-b0b9-beb6a98733bd" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.560471] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-241bcad9-5919-4c26-b0b9-beb6a98733bd" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.560684] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.560814] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.560884] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.561332] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.561463] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.561602] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-241bcad9-5919-4c26-b0b9-beb6a98733bd" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.561709] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('241bcad9-5919-4c26-b0b9-beb6a98733bd',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 800.663147] env[69980]: INFO networking_nsxv3.common.synchronization [req-9183dac8-af2d-47b2-9089-70861a71b10b req-72c7eb59-2ed2-4c26-b9f1-dffd44e4cc7f tempest-FloatingIPsAssociationTestJSON-592488877 tempest-FloatingIPsAssociationTestJSON-592488877-project-member] Enqueued Resource ID: 186800b9-4416-4ee9-97e6-a0aa4cad729b with Priority: HIGHEST for action security_group_members [ 800.663575] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 186800b9-4416-4ee9-97e6-a0aa4cad729b with Priority: HIGHEST for action security_group_members [ 800.663866] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-186800b9-4416-4ee9-97e6-a0aa4cad729b taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.663997] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-186800b9-4416-4ee9-97e6-a0aa4cad729b" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.664896] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-186800b9-4416-4ee9-97e6-a0aa4cad729b" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.664896] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-186800b9-4416-4ee9-97e6-a0aa4cad729b" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.664896] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.664896] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.664896] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.664896] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.665176] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.665176] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('186800b9-4416-4ee9-97e6-a0aa4cad729b',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 800.738309] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-75895721-8b52-47a4-a352-95fd377b4204 taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.738688] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-75895721-8b52-47a4-a352-95fd377b4204" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.740230] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('75895721-8b52-47a4-a352-95fd377b4204',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 800.746403] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 44370ac6-14fc-4933-9bf2-a7f42b019ad6 with status ACTIVE [ 800.746403] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.746403] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.746403] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.746403] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.746403] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.746403] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.746403] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.746403] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.746403] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.746403] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.746403] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.747079] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.747079] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.747079] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.747079] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.747079] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 44370ac6-14fc-4933-9bf2-a7f42b019ad6 is going to be updated. [ 800.766545] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.766699] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.766772] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.766993] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.767189] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.767364] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-44370ac6-14fc-4933-9bf2-a7f42b019ad6" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.064698] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-241bcad9-5919-4c26-b0b9-beb6a98733bd taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.065322] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-241bcad9-5919-4c26-b0b9-beb6a98733bd" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.065322] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-241bcad9-5919-4c26-b0b9-beb6a98733bd" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.065322] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-241bcad9-5919-4c26-b0b9-beb6a98733bd" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.065427] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.065480] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.065516] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.065642] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.065729] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.065818] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-241bcad9-5919-4c26-b0b9-beb6a98733bd" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.065961] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-241bcad9-5919-4c26-b0b9-beb6a98733bd taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.066084] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-241bcad9-5919-4c26-b0b9-beb6a98733bd" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.066148] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-241bcad9-5919-4c26-b0b9-beb6a98733bd" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.066289] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-241bcad9-5919-4c26-b0b9-beb6a98733bd" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.066429] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.066537] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.066575] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.066701] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.067271] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.067271] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-241bcad9-5919-4c26-b0b9-beb6a98733bd" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.067271] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('241bcad9-5919-4c26-b0b9-beb6a98733bd',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 801.167716] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('186800b9-4416-4ee9-97e6-a0aa4cad729b',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 801.248815] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('75895721-8b52-47a4-a352-95fd377b4204',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 801.346651] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock network-747 taken with stack trace [, , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.346861] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "network-747" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.347053] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "network-747" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.347257] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "network-747" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.347867] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.348071] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.348202] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.348598] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.348756] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.348968] env[69980]: DEBUG dogpile.cache.region [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] No value present for key: 'zone-id' {{(pid=69980) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 801.349109] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] NeedRegenerationException {{(pid=69980) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 801.349228] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] no value, waiting for create lock {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 801.349342] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] value creation lock acquired {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 801.349447] env[69980]: DEBUG dogpile.cache.region [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] No value present for key: 'zone-id' {{(pid=69980) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 801.349602] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Calling creation function for not-yet-present value {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 801.349888] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 801.366762] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 801.367023] env[69980]: DEBUG dogpile.cache.region [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Cache value generated in 0.017 seconds for key(s): 'zone-id' {{(pid=69980) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 801.367117] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Released creation lock {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 801.367254] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "network-747" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.367569] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock port-042a3bb6-109a-4aaa-a14f-04e7ee2ecfca taken with stack trace [, , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.367759] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "port-042a3bb6-109a-4aaa-a14f-04e7ee2ecfca" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.367878] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "port-042a3bb6-109a-4aaa-a14f-04e7ee2ecfca" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.368233] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "port-042a3bb6-109a-4aaa-a14f-04e7ee2ecfca" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.368373] env[69980]: DEBUG networking_nsxv3.api.rpc [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('042a3bb6-109a-4aaa-a14f-04e7ee2ecfca',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 801.570044] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 241bcad9-5919-4c26-b0b9-beb6a98733bd: rpc.has_security_group_logging(os_id): False [ 801.586684] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.586684] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.586684] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.586884] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.586959] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.587197] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.587347] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.587420] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.587585] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.587667] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.587851] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.587948] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.588025] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.588169] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.588246] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.588429] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.588524] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.588585] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.588722] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.588797] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.588883] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 241bcad9-5919-4c26-b0b9-beb6a98733bd is going to be updated. [ 801.654841] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.654841] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.654841] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.654841] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.654841] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.664289] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 241bcad9-5919-4c26-b0b9-beb6a98733bd in Status: IN_PROGRESS for 2s [ 801.669818] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('186800b9-4416-4ee9-97e6-a0aa4cad729b',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 801.755882] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.757671] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.757671] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.757671] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.757671] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.757671] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 75895721-8b52-47a4-a352-95fd377b4204 is going to be created. [ 801.782538] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.782719] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.782816] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.783139] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.783335] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.792758] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 75895721-8b52-47a4-a352-95fd377b4204 in Status: UNINITIALIZED for 2s [ 801.871902] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.872126] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.872258] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.872561] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.872704] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.872857] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Segment Port 042a3bb6-109a-4aaa-a14f-04e7ee2ecfca not found, creating... [ 801.873201] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.873695] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.873695] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.873776] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.873891] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.874237] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.874430] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.874544] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.874751] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.874885] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.875039] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Resource: SegmentPort with ID: 042a3bb6-109a-4aaa-a14f-04e7ee2ecfca is going to be created. [ 801.877797] env[69980]: INFO networking_nsxv3.common.synchronization [None req-b35eecb0-056f-4377-b0e5-98aadac58d01 None None] Enqueued Resource ID: 6c7eb28f-629d-454a-b6b4-094952a369f8 with Priority: HIGHEST for action port [ 801.878397] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6c7eb28f-629d-454a-b6b4-094952a369f8 with Priority: HIGHEST for action port [ 801.878935] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock port-6c7eb28f-629d-454a-b6b4-094952a369f8 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.879085] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6c7eb28f-629d-454a-b6b4-094952a369f8" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.879194] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6c7eb28f-629d-454a-b6b4-094952a369f8" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.879400] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6c7eb28f-629d-454a-b6b4-094952a369f8" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.879485] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6c7eb28f-629d-454a-b6b4-094952a369f8',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 801.899882] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.900223] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.900366] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.900661] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.900893] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.901140] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "port-042a3bb6-109a-4aaa-a14f-04e7ee2ecfca" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.102080] env[69980]: INFO networking_nsxv3.common.synchronization [req-85bf4532-c05b-429e-b7e5-5f395b41991f req-369c154f-79d1-4f46-9194-b98ba568a874 tempest-ListServerFiltersTestJSON-1624918227 tempest-ListServerFiltersTestJSON-1624918227-project-member] Enqueued Resource ID: 1340506f-247e-457d-b5d5-d9db4d9c0250 with Priority: HIGHEST for action security_group_members [ 802.102633] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1340506f-247e-457d-b5d5-d9db4d9c0250 with Priority: HIGHEST for action security_group_members [ 802.102981] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-1340506f-247e-457d-b5d5-d9db4d9c0250 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.103160] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1340506f-247e-457d-b5d5-d9db4d9c0250" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.103248] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1340506f-247e-457d-b5d5-d9db4d9c0250" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.103469] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1340506f-247e-457d-b5d5-d9db4d9c0250" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.103635] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.103782] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.103833] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.103945] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.110065] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.110065] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1340506f-247e-457d-b5d5-d9db4d9c0250',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 802.176743] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.176743] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.176743] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.176743] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.176743] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.176743] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 186800b9-4416-4ee9-97e6-a0aa4cad729b is going to be updated. [ 802.202465] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.202617] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.202684] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.202902] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.203101] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.211132] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 186800b9-4416-4ee9-97e6-a0aa4cad729b in Status: IN_PROGRESS for 2s [ 802.381723] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 6c7eb28f-629d-454a-b6b4-094952a369f8 [ 802.381959] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.382187] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.382409] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.382604] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.382732] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.382929] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:6c7eb28f-629d-454a-b6b4-094952a369f8 already deleted. [ 802.383107] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6c7eb28f-629d-454a-b6b4-094952a369f8" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.528217] env[69980]: INFO networking_nsxv3.common.synchronization [req-54835ff3-741a-4cf0-ae71-98ad29f420e8 req-f8597119-c7e9-4dac-8804-f5a2398ecea3 tempest-ServerMetadataTestJSON-614638658 tempest-ServerMetadataTestJSON-614638658-project-member] Enqueued Resource ID: 48dd2a84-68ac-43c8-a7e2-4cb28bb82546 with Priority: HIGHEST for action security_group_members [ 802.528702] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 48dd2a84-68ac-43c8-a7e2-4cb28bb82546 with Priority: HIGHEST for action security_group_members [ 802.529113] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-48dd2a84-68ac-43c8-a7e2-4cb28bb82546 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.529321] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-48dd2a84-68ac-43c8-a7e2-4cb28bb82546" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.529427] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-48dd2a84-68ac-43c8-a7e2-4cb28bb82546" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.529720] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-48dd2a84-68ac-43c8-a7e2-4cb28bb82546" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.529962] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.530132] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.530235] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.530465] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.530599] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.530748] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('48dd2a84-68ac-43c8-a7e2-4cb28bb82546',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 802.611325] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1340506f-247e-457d-b5d5-d9db4d9c0250',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 802.663842] env[69980]: INFO networking_nsxv3.common.synchronization [req-9183dac8-af2d-47b2-9089-70861a71b10b req-48a567a3-cbfa-4871-8bc8-2b038a784866 service nova] Enqueued Resource ID: 186800b9-4416-4ee9-97e6-a0aa4cad729b with Priority: HIGHEST for action security_group_rules [ 802.664073] env[69980]: INFO networking_nsxv3.common.synchronization [req-9183dac8-af2d-47b2-9089-70861a71b10b req-48a567a3-cbfa-4871-8bc8-2b038a784866 service nova] Enqueued Resource ID: 186800b9-4416-4ee9-97e6-a0aa4cad729b with Priority: HIGHEST for action security_group_members [ 802.664263] env[69980]: INFO networking_nsxv3.common.synchronization [req-9183dac8-af2d-47b2-9089-70861a71b10b req-48a567a3-cbfa-4871-8bc8-2b038a784866 service nova] Enqueued Resource ID: 042a3bb6-109a-4aaa-a14f-04e7ee2ecfca with Priority: HIGHEST for action port [ 802.664507] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 186800b9-4416-4ee9-97e6-a0aa4cad729b with Priority: HIGHEST for action security_group_rules [ 802.664640] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 186800b9-4416-4ee9-97e6-a0aa4cad729b with Priority: HIGHEST for action security_group_members [ 802.664738] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 042a3bb6-109a-4aaa-a14f-04e7ee2ecfca with Priority: HIGHEST for action port [ 802.665387] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock rules-186800b9-4416-4ee9-97e6-a0aa4cad729b taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.665494] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-186800b9-4416-4ee9-97e6-a0aa4cad729b" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.665539] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-186800b9-4416-4ee9-97e6-a0aa4cad729b" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.665726] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-186800b9-4416-4ee9-97e6-a0aa4cad729b" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.665809] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('186800b9-4416-4ee9-97e6-a0aa4cad729b',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 802.670262] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-186800b9-4416-4ee9-97e6-a0aa4cad729b taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.670262] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-186800b9-4416-4ee9-97e6-a0aa4cad729b" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.671164] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock port-042a3bb6-109a-4aaa-a14f-04e7ee2ecfca taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.671331] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-042a3bb6-109a-4aaa-a14f-04e7ee2ecfca" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.671375] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-042a3bb6-109a-4aaa-a14f-04e7ee2ecfca" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.671578] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-042a3bb6-109a-4aaa-a14f-04e7ee2ecfca" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.671634] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('042a3bb6-109a-4aaa-a14f-04e7ee2ecfca',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 803.036558] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.036740] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.036816] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.037044] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.037147] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.037343] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.037441] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.037505] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.037661] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.037738] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.037827] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 48dd2a84-68ac-43c8-a7e2-4cb28bb82546 is going to be updated. [ 803.081418] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.081647] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.081940] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.082277] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.082486] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.090844] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 48dd2a84-68ac-43c8-a7e2-4cb28bb82546 in Status: IN_PROGRESS for 2s [ 803.114329] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1340506f-247e-457d-b5d5-d9db4d9c0250',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 803.174285] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-186800b9-4416-4ee9-97e6-a0aa4cad729b taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.174285] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-186800b9-4416-4ee9-97e6-a0aa4cad729b" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.174285] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 042a3bb6-109a-4aaa-a14f-04e7ee2ecfca with status ACTIVE [ 803.176953] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.176953] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.176953] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.176953] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.176953] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.176953] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.176953] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.176953] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.176953] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.176953] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.176953] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.176953] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.176953] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.176953] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.176953] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.176953] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 042a3bb6-109a-4aaa-a14f-04e7ee2ecfca is going to be updated. [ 803.195428] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.195592] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.195670] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.195831] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.195967] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.196150] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-042a3bb6-109a-4aaa-a14f-04e7ee2ecfca" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.616295] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.616588] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.616588] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.616699] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.616792] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.616912] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1340506f-247e-457d-b5d5-d9db4d9c0250 is going to be updated. [ 803.653746] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.653990] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.653990] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.654184] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.654318] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.668970] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1340506f-247e-457d-b5d5-d9db4d9c0250 in Status: IN_PROGRESS for 2s [ 803.680469] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 241bcad9-5919-4c26-b0b9-beb6a98733bd in Status: SUCCESS [ 803.680779] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-241bcad9-5919-4c26-b0b9-beb6a98733bd" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.804876] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 75895721-8b52-47a4-a352-95fd377b4204 in Status: SUCCESS [ 803.804876] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-75895721-8b52-47a4-a352-95fd377b4204" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.804876] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-75895721-8b52-47a4-a352-95fd377b4204" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.804876] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-75895721-8b52-47a4-a352-95fd377b4204" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.805053] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.805127] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.805188] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.805337] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.805413] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.805496] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-75895721-8b52-47a4-a352-95fd377b4204" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.805583] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('75895721-8b52-47a4-a352-95fd377b4204',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 804.222025] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 186800b9-4416-4ee9-97e6-a0aa4cad729b in Status: SUCCESS [ 804.222025] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-186800b9-4416-4ee9-97e6-a0aa4cad729b" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.222025] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-186800b9-4416-4ee9-97e6-a0aa4cad729b" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.222025] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-186800b9-4416-4ee9-97e6-a0aa4cad729b" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.222025] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.222025] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.222025] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.222025] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.222371] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.222371] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('186800b9-4416-4ee9-97e6-a0aa4cad729b',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 804.310022] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-75895721-8b52-47a4-a352-95fd377b4204 taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.310022] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-75895721-8b52-47a4-a352-95fd377b4204" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.310022] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-75895721-8b52-47a4-a352-95fd377b4204" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.310022] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-75895721-8b52-47a4-a352-95fd377b4204" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.310022] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.310022] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.310022] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.310022] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.310022] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.310022] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-75895721-8b52-47a4-a352-95fd377b4204" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.310022] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-75895721-8b52-47a4-a352-95fd377b4204 taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.310022] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-75895721-8b52-47a4-a352-95fd377b4204" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.310022] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-75895721-8b52-47a4-a352-95fd377b4204" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.310022] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-75895721-8b52-47a4-a352-95fd377b4204" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.310022] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.310022] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.310745] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.310745] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.310745] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.310745] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-75895721-8b52-47a4-a352-95fd377b4204" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.310745] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('75895721-8b52-47a4-a352-95fd377b4204',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 804.724891] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('186800b9-4416-4ee9-97e6-a0aa4cad729b',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 804.813038] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 75895721-8b52-47a4-a352-95fd377b4204: rpc.has_security_group_logging(os_id): False [ 804.832139] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.832690] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.832690] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.832690] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.832817] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.833147] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.833201] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.833349] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.833604] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.833713] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.834191] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.838993] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.838993] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.838993] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.838993] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.839263] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.839316] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.841714] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.841714] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.841714] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.841714] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 75895721-8b52-47a4-a352-95fd377b4204 is going to be created. [ 804.934022] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.934022] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.934022] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.934022] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.934022] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.950996] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 75895721-8b52-47a4-a352-95fd377b4204 in Status: IN_PROGRESS for 2s [ 805.102223] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 48dd2a84-68ac-43c8-a7e2-4cb28bb82546 in Status: SUCCESS [ 805.102223] env[69980]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 48dd2a84-68ac-43c8-a7e2-4cb28bb82546 deletion is rescheduled due to dependency. [ 805.102223] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-48dd2a84-68ac-43c8-a7e2-4cb28bb82546" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.227363] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('186800b9-4416-4ee9-97e6-a0aa4cad729b',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 805.693316] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1340506f-247e-457d-b5d5-d9db4d9c0250 in Status: SUCCESS [ 805.693683] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1340506f-247e-457d-b5d5-d9db4d9c0250" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.741292] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.741292] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.741292] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.741292] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.741292] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.741292] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 186800b9-4416-4ee9-97e6-a0aa4cad729b is going to be updated. [ 805.764825] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.765116] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.765236] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.765669] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.765758] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.782783] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 186800b9-4416-4ee9-97e6-a0aa4cad729b in Status: IN_PROGRESS for 2s [ 806.528030] env[69980]: INFO networking_nsxv3.common.synchronization [req-b803d9eb-0328-4139-bcd4-b4ebfc9ac5e8 req-dd52c772-02c1-4f7d-b41e-6e787189a6be tempest-SecurityGroupsTestJSON-1482814430 tempest-SecurityGroupsTestJSON-1482814430-project-member] Enqueued Resource ID: e2390617-a1da-45a2-94eb-d162a19e2fae with Priority: HIGHEST for action security_group_members [ 806.528030] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e2390617-a1da-45a2-94eb-d162a19e2fae with Priority: HIGHEST for action security_group_members [ 806.528030] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-e2390617-a1da-45a2-94eb-d162a19e2fae taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.528030] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e2390617-a1da-45a2-94eb-d162a19e2fae" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.528030] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e2390617-a1da-45a2-94eb-d162a19e2fae" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.528445] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e2390617-a1da-45a2-94eb-d162a19e2fae" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.528738] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.528981] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.529165] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.529409] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.529576] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.529747] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e2390617-a1da-45a2-94eb-d162a19e2fae',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 806.966400] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 75895721-8b52-47a4-a352-95fd377b4204 in Status: SUCCESS [ 806.966400] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-75895721-8b52-47a4-a352-95fd377b4204" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.020746] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock network-154 taken with stack trace [, , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.020746] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "network-154" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.020746] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "network-154" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.021050] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "network-154" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.021158] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.021284] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.021400] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.021624] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.021766] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.023788] env[69980]: DEBUG dogpile.cache.region [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] No value present for key: 'zone-id' {{(pid=69980) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 807.023788] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] NeedRegenerationException {{(pid=69980) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 807.023788] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] no value, waiting for create lock {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 807.023788] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] value creation lock acquired {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 807.023788] env[69980]: DEBUG dogpile.cache.region [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] No value present for key: 'zone-id' {{(pid=69980) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 807.024046] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Calling creation function for not-yet-present value {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 807.024201] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 807.032103] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.032103] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.032103] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.032218] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.032326] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.032511] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.032651] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.032723] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.034522] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.034522] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.034522] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e2390617-a1da-45a2-94eb-d162a19e2fae already deleted. [ 807.034522] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e2390617-a1da-45a2-94eb-d162a19e2fae" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.041850] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 807.042027] env[69980]: DEBUG dogpile.cache.region [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=69980) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 807.042169] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Released creation lock {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 807.042341] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "network-154" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.042637] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock port-ddd15313-733b-4470-8916-4af93c716fed taken with stack trace [, , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.042800] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "port-ddd15313-733b-4470-8916-4af93c716fed" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.042916] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "port-ddd15313-733b-4470-8916-4af93c716fed" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.043270] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "port-ddd15313-733b-4470-8916-4af93c716fed" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.043401] env[69980]: DEBUG networking_nsxv3.api.rpc [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ddd15313-733b-4470-8916-4af93c716fed',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 807.547346] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.547584] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.547710] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.547991] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.548176] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.548340] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Segment Port ddd15313-733b-4470-8916-4af93c716fed not found, creating... [ 807.548607] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.548768] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.548884] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.549118] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.549257] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.549539] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.549693] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.549810] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.550028] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.550169] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.550308] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Resource: SegmentPort with ID: ddd15313-733b-4470-8916-4af93c716fed is going to be created. [ 807.570046] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.571055] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.571055] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.571055] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.571055] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.571055] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "port-ddd15313-733b-4470-8916-4af93c716fed" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.795199] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 186800b9-4416-4ee9-97e6-a0aa4cad729b in Status: SUCCESS [ 807.795457] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-186800b9-4416-4ee9-97e6-a0aa4cad729b" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.796028] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-186800b9-4416-4ee9-97e6-a0aa4cad729b" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.796028] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-186800b9-4416-4ee9-97e6-a0aa4cad729b" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.796140] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.796283] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.796373] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.796587] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.796700] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.796892] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-186800b9-4416-4ee9-97e6-a0aa4cad729b" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.796892] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('186800b9-4416-4ee9-97e6-a0aa4cad729b',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 808.299814] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-186800b9-4416-4ee9-97e6-a0aa4cad729b taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.300098] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-186800b9-4416-4ee9-97e6-a0aa4cad729b" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.300098] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-186800b9-4416-4ee9-97e6-a0aa4cad729b" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.300267] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-186800b9-4416-4ee9-97e6-a0aa4cad729b" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.300427] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.300659] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.300659] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.300745] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.302017] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.302017] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-186800b9-4416-4ee9-97e6-a0aa4cad729b" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.302017] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-186800b9-4416-4ee9-97e6-a0aa4cad729b taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.302017] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-186800b9-4416-4ee9-97e6-a0aa4cad729b" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.302017] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-186800b9-4416-4ee9-97e6-a0aa4cad729b" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.302017] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-186800b9-4416-4ee9-97e6-a0aa4cad729b" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.302017] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.302017] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.302017] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.302017] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.302017] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.302017] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-186800b9-4416-4ee9-97e6-a0aa4cad729b" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.302017] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('186800b9-4416-4ee9-97e6-a0aa4cad729b',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 808.383019] env[69980]: INFO networking_nsxv3.common.synchronization [req-b803d9eb-0328-4139-bcd4-b4ebfc9ac5e8 req-05b2776d-2eef-409d-9e3d-6c7f50165add service nova] Enqueued Resource ID: e2390617-a1da-45a2-94eb-d162a19e2fae with Priority: HIGHEST for action security_group_rules [ 808.383019] env[69980]: INFO networking_nsxv3.common.synchronization [req-b803d9eb-0328-4139-bcd4-b4ebfc9ac5e8 req-05b2776d-2eef-409d-9e3d-6c7f50165add service nova] Enqueued Resource ID: e2390617-a1da-45a2-94eb-d162a19e2fae with Priority: HIGHEST for action security_group_members [ 808.383019] env[69980]: INFO networking_nsxv3.common.synchronization [req-b803d9eb-0328-4139-bcd4-b4ebfc9ac5e8 req-05b2776d-2eef-409d-9e3d-6c7f50165add service nova] Enqueued Resource ID: ddd15313-733b-4470-8916-4af93c716fed with Priority: HIGHEST for action port [ 808.383019] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e2390617-a1da-45a2-94eb-d162a19e2fae with Priority: HIGHEST for action security_group_rules [ 808.383629] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e2390617-a1da-45a2-94eb-d162a19e2fae with Priority: HIGHEST for action security_group_members [ 808.383826] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ddd15313-733b-4470-8916-4af93c716fed with Priority: HIGHEST for action port [ 808.384110] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e2390617-a1da-45a2-94eb-d162a19e2fae taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.384865] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e2390617-a1da-45a2-94eb-d162a19e2fae" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.384948] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e2390617-a1da-45a2-94eb-d162a19e2fae" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.385253] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e2390617-a1da-45a2-94eb-d162a19e2fae" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.385347] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e2390617-a1da-45a2-94eb-d162a19e2fae',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 808.388624] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-e2390617-a1da-45a2-94eb-d162a19e2fae taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.388624] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e2390617-a1da-45a2-94eb-d162a19e2fae" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.388624] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e2390617-a1da-45a2-94eb-d162a19e2fae" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.388624] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e2390617-a1da-45a2-94eb-d162a19e2fae" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.388624] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.388624] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.388624] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.388624] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.388624] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.388624] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e2390617-a1da-45a2-94eb-d162a19e2fae',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 808.388624] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock port-ddd15313-733b-4470-8916-4af93c716fed taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.388624] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ddd15313-733b-4470-8916-4af93c716fed" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.388624] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ddd15313-733b-4470-8916-4af93c716fed" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.388624] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ddd15313-733b-4470-8916-4af93c716fed" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.390284] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ddd15313-733b-4470-8916-4af93c716fed',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 808.804454] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 186800b9-4416-4ee9-97e6-a0aa4cad729b: rpc.has_security_group_logging(os_id): False [ 808.822555] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.822727] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.822771] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.822982] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.823161] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.823378] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.823483] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.823548] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.824403] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.824403] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.824403] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.824403] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.824403] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.824403] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.824403] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.824626] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.824626] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.824626] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.824784] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.824825] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.824913] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 186800b9-4416-4ee9-97e6-a0aa4cad729b is going to be updated. [ 808.881135] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.881282] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.881346] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.881550] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.881692] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.891412] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-e2390617-a1da-45a2-94eb-d162a19e2fae taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.891607] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e2390617-a1da-45a2-94eb-d162a19e2fae" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.891841] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e2390617-a1da-45a2-94eb-d162a19e2fae',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 808.892752] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port ddd15313-733b-4470-8916-4af93c716fed with status ACTIVE [ 808.892861] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.892952] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.893075] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.893269] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.893379] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.893555] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.893662] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.893708] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.893863] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.893940] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.894174] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.894276] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.894340] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.894482] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.894557] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.894973] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: ddd15313-733b-4470-8916-4af93c716fed is going to be updated. [ 808.896212] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 186800b9-4416-4ee9-97e6-a0aa4cad729b in Status: IN_PROGRESS for 2s [ 808.917729] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.917874] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.917945] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.918171] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.918306] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.918466] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ddd15313-733b-4470-8916-4af93c716fed" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.397442] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e2390617-a1da-45a2-94eb-d162a19e2fae',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 809.900386] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.900663] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.900768] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.901057] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.901192] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.901312] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e2390617-a1da-45a2-94eb-d162a19e2fae is going to be created. [ 809.938819] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.938961] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.939057] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.939301] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.939465] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.949108] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e2390617-a1da-45a2-94eb-d162a19e2fae in Status: UNINITIALIZED for 2s [ 810.909396] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 186800b9-4416-4ee9-97e6-a0aa4cad729b in Status: SUCCESS [ 810.909649] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-186800b9-4416-4ee9-97e6-a0aa4cad729b" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.161868] env[69980]: INFO networking_nsxv3.common.synchronization [req-1c0eb512-9634-49f0-92e0-f571509c104a req-d21b35fc-3dea-42f2-9c54-738ea7d409e9 tempest-ServersV294TestFqdnHostnames-550580335 tempest-ServersV294TestFqdnHostnames-550580335-project-member] Enqueued Resource ID: 61b51096-066e-4c5d-b696-b9c061599dcc with Priority: HIGHEST for action security_group_members [ 811.161868] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 61b51096-066e-4c5d-b696-b9c061599dcc with Priority: HIGHEST for action security_group_members [ 811.161868] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-61b51096-066e-4c5d-b696-b9c061599dcc taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.164219] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-61b51096-066e-4c5d-b696-b9c061599dcc" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.164353] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-61b51096-066e-4c5d-b696-b9c061599dcc" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.164546] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-61b51096-066e-4c5d-b696-b9c061599dcc" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.165313] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.165722] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.166120] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.167080] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.167476] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.167731] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('61b51096-066e-4c5d-b696-b9c061599dcc',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 811.613378] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock network-779 taken with stack trace [, , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.613582] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "network-779" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.613720] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "network-779" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.614313] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "network-779" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.614371] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.614509] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.614627] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.614853] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.615956] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.615956] env[69980]: DEBUG dogpile.cache.region [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] No value present for key: 'zone-id' {{(pid=69980) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 811.615956] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] NeedRegenerationException {{(pid=69980) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 811.615956] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] no value, waiting for create lock {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 811.615956] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] value creation lock acquired {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 811.616334] env[69980]: DEBUG dogpile.cache.region [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] No value present for key: 'zone-id' {{(pid=69980) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 811.616334] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Calling creation function for not-yet-present value {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 811.616334] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 811.634630] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 811.634630] env[69980]: DEBUG dogpile.cache.region [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=69980) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 811.634630] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Released creation lock {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 811.634630] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "network-779" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.634945] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock port-7631bca9-e1e2-4249-a562-c0872005b8ed taken with stack trace [, , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.635131] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "port-7631bca9-e1e2-4249-a562-c0872005b8ed" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.635252] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "port-7631bca9-e1e2-4249-a562-c0872005b8ed" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.635556] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "port-7631bca9-e1e2-4249-a562-c0872005b8ed" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.635694] env[69980]: DEBUG networking_nsxv3.api.rpc [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7631bca9-e1e2-4249-a562-c0872005b8ed',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 811.674013] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.674013] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.674013] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.674013] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.674013] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.674013] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.674013] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.674013] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.674615] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.674615] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.674615] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 61b51096-066e-4c5d-b696-b9c061599dcc already deleted. [ 811.674615] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-61b51096-066e-4c5d-b696-b9c061599dcc" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.957920] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e2390617-a1da-45a2-94eb-d162a19e2fae in Status: SUCCESS [ 811.958277] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e2390617-a1da-45a2-94eb-d162a19e2fae" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.958719] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e2390617-a1da-45a2-94eb-d162a19e2fae" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.959160] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e2390617-a1da-45a2-94eb-d162a19e2fae" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.959452] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.959654] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.959756] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.960017] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.960192] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.960289] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e2390617-a1da-45a2-94eb-d162a19e2fae" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.960421] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e2390617-a1da-45a2-94eb-d162a19e2fae',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 812.138368] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.138727] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.138727] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.139044] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.139203] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.139364] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Segment Port 7631bca9-e1e2-4249-a562-c0872005b8ed not found, creating... [ 812.139669] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.139831] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.139948] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.140221] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.140374] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.140674] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.140857] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.141161] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.141273] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.141418] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.141578] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Resource: SegmentPort with ID: 7631bca9-e1e2-4249-a562-c0872005b8ed is going to be created. [ 812.161796] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.161961] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.162117] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.162417] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.162619] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.162851] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "port-7631bca9-e1e2-4249-a562-c0872005b8ed" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.463166] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-e2390617-a1da-45a2-94eb-d162a19e2fae taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.463340] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e2390617-a1da-45a2-94eb-d162a19e2fae" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.463340] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e2390617-a1da-45a2-94eb-d162a19e2fae" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.463584] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e2390617-a1da-45a2-94eb-d162a19e2fae" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.463695] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.463798] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.463847] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.464024] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.464138] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.464249] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e2390617-a1da-45a2-94eb-d162a19e2fae" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.464414] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-e2390617-a1da-45a2-94eb-d162a19e2fae taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.464513] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e2390617-a1da-45a2-94eb-d162a19e2fae" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.464576] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e2390617-a1da-45a2-94eb-d162a19e2fae" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.464725] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e2390617-a1da-45a2-94eb-d162a19e2fae" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.464860] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.464954] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.465026] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.465201] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.465228] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.465304] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e2390617-a1da-45a2-94eb-d162a19e2fae" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.465442] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e2390617-a1da-45a2-94eb-d162a19e2fae',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 812.763651] env[69980]: INFO networking_nsxv3.common.synchronization [req-81f2a291-a2e6-415e-92f8-ec6c0c55da88 req-c21307b9-3462-41db-97c1-f3c251d8f848 tempest-TenantUsagesTestJSON-627674300 tempest-TenantUsagesTestJSON-627674300-project-member] Enqueued Resource ID: 75895721-8b52-47a4-a352-95fd377b4204 with Priority: HIGHEST for action security_group_members [ 812.764366] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 75895721-8b52-47a4-a352-95fd377b4204 with Priority: HIGHEST for action security_group_members [ 812.764733] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-75895721-8b52-47a4-a352-95fd377b4204 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.764861] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-75895721-8b52-47a4-a352-95fd377b4204" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.764929] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-75895721-8b52-47a4-a352-95fd377b4204" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.765905] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-75895721-8b52-47a4-a352-95fd377b4204" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.766191] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.766349] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.766501] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.766769] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.766896] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.767034] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('75895721-8b52-47a4-a352-95fd377b4204',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 812.970398] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e2390617-a1da-45a2-94eb-d162a19e2fae: rpc.has_security_group_logging(os_id): False [ 812.974254] env[69980]: INFO networking_nsxv3.common.synchronization [req-1c0eb512-9634-49f0-92e0-f571509c104a req-375fd779-1c73-409d-b46d-82c519f6a472 service nova] Enqueued Resource ID: 61b51096-066e-4c5d-b696-b9c061599dcc with Priority: HIGHEST for action security_group_rules [ 812.975448] env[69980]: INFO networking_nsxv3.common.synchronization [req-1c0eb512-9634-49f0-92e0-f571509c104a req-375fd779-1c73-409d-b46d-82c519f6a472 service nova] Enqueued Resource ID: 61b51096-066e-4c5d-b696-b9c061599dcc with Priority: HIGHEST for action security_group_members [ 812.975448] env[69980]: INFO networking_nsxv3.common.synchronization [req-1c0eb512-9634-49f0-92e0-f571509c104a req-375fd779-1c73-409d-b46d-82c519f6a472 service nova] Enqueued Resource ID: 7631bca9-e1e2-4249-a562-c0872005b8ed with Priority: HIGHEST for action port [ 812.976802] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 61b51096-066e-4c5d-b696-b9c061599dcc with Priority: HIGHEST for action security_group_rules [ 812.976958] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 61b51096-066e-4c5d-b696-b9c061599dcc with Priority: HIGHEST for action security_group_members [ 812.977100] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7631bca9-e1e2-4249-a562-c0872005b8ed with Priority: HIGHEST for action port [ 812.977842] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock rules-61b51096-066e-4c5d-b696-b9c061599dcc taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.977990] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-61b51096-066e-4c5d-b696-b9c061599dcc" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.978087] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-61b51096-066e-4c5d-b696-b9c061599dcc" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.978328] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-61b51096-066e-4c5d-b696-b9c061599dcc" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.978423] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('61b51096-066e-4c5d-b696-b9c061599dcc',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 812.979728] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-61b51096-066e-4c5d-b696-b9c061599dcc taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.979867] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-61b51096-066e-4c5d-b696-b9c061599dcc" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.979919] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-61b51096-066e-4c5d-b696-b9c061599dcc" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.980137] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-61b51096-066e-4c5d-b696-b9c061599dcc" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.980292] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.980474] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.980474] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.982952] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.982952] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.983077] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('61b51096-066e-4c5d-b696-b9c061599dcc',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 812.985625] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock port-7631bca9-e1e2-4249-a562-c0872005b8ed taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.986739] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7631bca9-e1e2-4249-a562-c0872005b8ed" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.986881] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7631bca9-e1e2-4249-a562-c0872005b8ed" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.987265] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7631bca9-e1e2-4249-a562-c0872005b8ed" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.987421] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7631bca9-e1e2-4249-a562-c0872005b8ed',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 813.004279] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.004279] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.004279] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.004279] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.004279] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.004279] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.004279] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.004279] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.004279] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.004279] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.004279] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.004279] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.004279] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.004279] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.004279] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.004876] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.005303] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.005522] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.005764] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.005928] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.006128] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e2390617-a1da-45a2-94eb-d162a19e2fae is going to be created. [ 813.066664] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.066664] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.066664] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.066779] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.068208] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.077171] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e2390617-a1da-45a2-94eb-d162a19e2fae in Status: IN_PROGRESS for 2s [ 813.271786] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.271948] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.272062] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.272253] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.272349] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.272550] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.272649] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.272867] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.272867] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.273018] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.273018] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 75895721-8b52-47a4-a352-95fd377b4204 is going to be updated. [ 813.308447] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.308583] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.308624] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.308820] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.308956] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.319024] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 75895721-8b52-47a4-a352-95fd377b4204 in Status: IN_PROGRESS for 2s [ 813.486140] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('61b51096-066e-4c5d-b696-b9c061599dcc',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 813.491264] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-61b51096-066e-4c5d-b696-b9c061599dcc taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.491264] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-61b51096-066e-4c5d-b696-b9c061599dcc" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.491264] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 7631bca9-e1e2-4249-a562-c0872005b8ed with status ACTIVE [ 813.491264] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.491264] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.491264] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.491264] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.491264] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.491264] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.491264] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.491264] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.491264] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.491264] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.491945] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.491945] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.491945] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.491945] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.491945] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.491945] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 7631bca9-e1e2-4249-a562-c0872005b8ed is going to be updated. [ 813.511220] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.511393] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.511450] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.511626] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.511780] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.511996] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7631bca9-e1e2-4249-a562-c0872005b8ed" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.990687] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('61b51096-066e-4c5d-b696-b9c061599dcc',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 814.492524] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.493729] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.493904] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.494518] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.494694] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.494888] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 61b51096-066e-4c5d-b696-b9c061599dcc is going to be created. [ 814.522022] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.522022] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.522022] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.522022] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.522022] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.530519] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 61b51096-066e-4c5d-b696-b9c061599dcc in Status: UNINITIALIZED for 2s [ 814.680446] env[69980]: INFO networking_nsxv3.common.synchronization [req-b6339838-1c7d-442a-8df9-78bbff6c3a5d req-e38235d0-1b2b-4e00-8be5-5d53f8a24bdf tempest-ServersTestManualDisk-1921842284 tempest-ServersTestManualDisk-1921842284-project-member] Enqueued Resource ID: b472d7ce-a3a7-4859-8fa3-f222ee058e66 with Priority: HIGHEST for action security_group_members [ 814.680976] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b472d7ce-a3a7-4859-8fa3-f222ee058e66 with Priority: HIGHEST for action security_group_members [ 814.681293] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-b472d7ce-a3a7-4859-8fa3-f222ee058e66 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.681425] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b472d7ce-a3a7-4859-8fa3-f222ee058e66" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.681679] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b472d7ce-a3a7-4859-8fa3-f222ee058e66" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.681859] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b472d7ce-a3a7-4859-8fa3-f222ee058e66" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.681859] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.681995] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.681995] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.682375] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.682501] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.682609] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b472d7ce-a3a7-4859-8fa3-f222ee058e66',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 815.090826] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e2390617-a1da-45a2-94eb-d162a19e2fae in Status: SUCCESS [ 815.091209] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e2390617-a1da-45a2-94eb-d162a19e2fae" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.145697] env[69980]: INFO networking_nsxv3.common.synchronization [req-c4c5a1f9-1a2f-4c2c-b33f-abdd0ba70218 req-a8e8c6fd-3302-4f44-b122-c8e0e683d86b tempest-ImagesOneServerNegativeTestJSON-332667785 tempest-ImagesOneServerNegativeTestJSON-332667785-project-member] Enqueued Resource ID: d53aff15-d6ed-495c-9f29-fdc03bd13622 with Priority: HIGHEST for action security_group_members [ 815.147052] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d53aff15-d6ed-495c-9f29-fdc03bd13622 with Priority: HIGHEST for action security_group_members [ 815.147052] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-d53aff15-d6ed-495c-9f29-fdc03bd13622 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.147570] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d53aff15-d6ed-495c-9f29-fdc03bd13622" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.147841] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d53aff15-d6ed-495c-9f29-fdc03bd13622" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.149100] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d53aff15-d6ed-495c-9f29-fdc03bd13622" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.150589] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.150782] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.150924] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.151139] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.151521] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.151521] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d53aff15-d6ed-495c-9f29-fdc03bd13622',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 815.191301] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.191479] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.191540] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.191740] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.191837] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.192031] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.192226] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.192289] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.192444] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.192523] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.192613] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b472d7ce-a3a7-4859-8fa3-f222ee058e66 is going to be updated. [ 815.221502] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.221664] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.221724] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.221913] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.222189] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.230476] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b472d7ce-a3a7-4859-8fa3-f222ee058e66 in Status: IN_PROGRESS for 2s [ 815.327421] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 75895721-8b52-47a4-a352-95fd377b4204 in Status: SUCCESS [ 815.327606] env[69980]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 75895721-8b52-47a4-a352-95fd377b4204 deletion is rescheduled due to dependency. [ 815.327727] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-75895721-8b52-47a4-a352-95fd377b4204" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.657147] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.657147] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.657147] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.657147] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.657147] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.657147] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.657147] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.657147] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.657147] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.657147] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.657147] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d53aff15-d6ed-495c-9f29-fdc03bd13622 already deleted. [ 815.657147] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d53aff15-d6ed-495c-9f29-fdc03bd13622" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.730670] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock network-926 taken with stack trace [, , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.730858] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "network-926" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.730992] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "network-926" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.731374] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "network-926" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.731647] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.731985] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.731985] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.734027] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.734027] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.734027] env[69980]: DEBUG dogpile.cache.region [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] No value present for key: 'zone-id' {{(pid=69980) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 815.734027] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] NeedRegenerationException {{(pid=69980) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 815.734027] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] no value, waiting for create lock {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 815.734027] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] value creation lock acquired {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 815.734027] env[69980]: DEBUG dogpile.cache.region [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] No value present for key: 'zone-id' {{(pid=69980) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 815.734027] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Calling creation function for not-yet-present value {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 815.734298] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 815.767157] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 815.767392] env[69980]: DEBUG dogpile.cache.region [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Cache value generated in 0.033 seconds for key(s): 'zone-id' {{(pid=69980) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 815.767561] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Released creation lock {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 815.767782] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "network-926" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.768182] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock port-a8bd563c-8ecc-4c8a-bb72-ba832a6b3e79 taken with stack trace [, , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.768315] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "port-a8bd563c-8ecc-4c8a-bb72-ba832a6b3e79" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.768439] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "port-a8bd563c-8ecc-4c8a-bb72-ba832a6b3e79" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.769089] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "port-a8bd563c-8ecc-4c8a-bb72-ba832a6b3e79" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.769165] env[69980]: DEBUG networking_nsxv3.api.rpc [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a8bd563c-8ecc-4c8a-bb72-ba832a6b3e79',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 816.278017] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.278017] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.278017] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.278017] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.278017] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.278017] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Segment Port a8bd563c-8ecc-4c8a-bb72-ba832a6b3e79 not found, creating... [ 816.278017] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.278017] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.278017] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.278017] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.278017] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.278631] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.278631] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.278631] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.278631] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.278631] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.278770] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Resource: SegmentPort with ID: a8bd563c-8ecc-4c8a-bb72-ba832a6b3e79 is going to be created. [ 816.298193] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.298442] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.298602] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.298912] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.299186] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.299465] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "port-a8bd563c-8ecc-4c8a-bb72-ba832a6b3e79" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.539740] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 61b51096-066e-4c5d-b696-b9c061599dcc in Status: SUCCESS [ 816.540089] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-61b51096-066e-4c5d-b696-b9c061599dcc" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.540316] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-61b51096-066e-4c5d-b696-b9c061599dcc" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.540538] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-61b51096-066e-4c5d-b696-b9c061599dcc" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.540779] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.540902] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.540968] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.541163] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.541243] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.541331] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-61b51096-066e-4c5d-b696-b9c061599dcc" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.541424] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('61b51096-066e-4c5d-b696-b9c061599dcc',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 817.044101] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('61b51096-066e-4c5d-b696-b9c061599dcc',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 817.099486] env[69980]: INFO networking_nsxv3.common.synchronization [req-c4c5a1f9-1a2f-4c2c-b33f-abdd0ba70218 req-63874b10-fea6-49fc-9f5c-43854d4ab1d0 service nova] Enqueued Resource ID: d53aff15-d6ed-495c-9f29-fdc03bd13622 with Priority: HIGHEST for action security_group_rules [ 817.099486] env[69980]: INFO networking_nsxv3.common.synchronization [req-c4c5a1f9-1a2f-4c2c-b33f-abdd0ba70218 req-63874b10-fea6-49fc-9f5c-43854d4ab1d0 service nova] Enqueued Resource ID: d53aff15-d6ed-495c-9f29-fdc03bd13622 with Priority: HIGHEST for action security_group_members [ 817.099486] env[69980]: INFO networking_nsxv3.common.synchronization [req-c4c5a1f9-1a2f-4c2c-b33f-abdd0ba70218 req-63874b10-fea6-49fc-9f5c-43854d4ab1d0 service nova] Enqueued Resource ID: a8bd563c-8ecc-4c8a-bb72-ba832a6b3e79 with Priority: HIGHEST for action port [ 817.099486] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d53aff15-d6ed-495c-9f29-fdc03bd13622 with Priority: HIGHEST for action security_group_rules [ 817.099486] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d53aff15-d6ed-495c-9f29-fdc03bd13622 with Priority: HIGHEST for action security_group_members [ 817.099486] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a8bd563c-8ecc-4c8a-bb72-ba832a6b3e79 with Priority: HIGHEST for action port [ 817.100163] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d53aff15-d6ed-495c-9f29-fdc03bd13622 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.100683] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d53aff15-d6ed-495c-9f29-fdc03bd13622" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.100987] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d53aff15-d6ed-495c-9f29-fdc03bd13622" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.104078] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d53aff15-d6ed-495c-9f29-fdc03bd13622" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.104078] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d53aff15-d6ed-495c-9f29-fdc03bd13622',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 817.104078] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-d53aff15-d6ed-495c-9f29-fdc03bd13622 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.104078] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d53aff15-d6ed-495c-9f29-fdc03bd13622" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.104078] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d53aff15-d6ed-495c-9f29-fdc03bd13622" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.104078] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d53aff15-d6ed-495c-9f29-fdc03bd13622" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.104078] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.104078] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.104995] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.105177] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.105289] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.105401] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d53aff15-d6ed-495c-9f29-fdc03bd13622',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 817.106556] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock port-a8bd563c-8ecc-4c8a-bb72-ba832a6b3e79 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.106556] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a8bd563c-8ecc-4c8a-bb72-ba832a6b3e79" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.106556] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a8bd563c-8ecc-4c8a-bb72-ba832a6b3e79" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.106843] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a8bd563c-8ecc-4c8a-bb72-ba832a6b3e79" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.106843] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a8bd563c-8ecc-4c8a-bb72-ba832a6b3e79',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 817.239938] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b472d7ce-a3a7-4859-8fa3-f222ee058e66 in Status: SUCCESS [ 817.240212] env[69980]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b472d7ce-a3a7-4859-8fa3-f222ee058e66 deletion is rescheduled due to dependency. [ 817.240298] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b472d7ce-a3a7-4859-8fa3-f222ee058e66" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.449743] env[69980]: INFO networking_nsxv3.common.synchronization [req-631a9680-d938-4ab0-ab9b-bf31bfb09d92 req-9ac9c9a1-cfc5-4811-bd93-d99d79aca5bc tempest-SecurityGroupsTestJSON-1482814430 tempest-SecurityGroupsTestJSON-1482814430-project-member] Enqueued Resource ID: f9bdd708-8cea-4b45-818f-2a931611c895 with Priority: HIGHEST for action security_group_members [ 817.449743] env[69980]: INFO networking_nsxv3.common.synchronization [req-631a9680-d938-4ab0-ab9b-bf31bfb09d92 req-9ac9c9a1-cfc5-4811-bd93-d99d79aca5bc tempest-SecurityGroupsTestJSON-1482814430 tempest-SecurityGroupsTestJSON-1482814430-project-member] Enqueued Resource ID: e2390617-a1da-45a2-94eb-d162a19e2fae with Priority: HIGHEST for action security_group_members [ 817.449743] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f9bdd708-8cea-4b45-818f-2a931611c895 with Priority: HIGHEST for action security_group_members [ 817.449743] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e2390617-a1da-45a2-94eb-d162a19e2fae with Priority: HIGHEST for action security_group_members [ 817.450330] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-f9bdd708-8cea-4b45-818f-2a931611c895 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.450330] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f9bdd708-8cea-4b45-818f-2a931611c895" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.450402] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f9bdd708-8cea-4b45-818f-2a931611c895" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.450608] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f9bdd708-8cea-4b45-818f-2a931611c895" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.450768] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.450884] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.450949] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.451173] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.451586] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.451693] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f9bdd708-8cea-4b45-818f-2a931611c895',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 817.453665] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-e2390617-a1da-45a2-94eb-d162a19e2fae taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.453811] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e2390617-a1da-45a2-94eb-d162a19e2fae" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.453869] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e2390617-a1da-45a2-94eb-d162a19e2fae" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.454155] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e2390617-a1da-45a2-94eb-d162a19e2fae" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.454240] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.454380] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.454380] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.454546] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.454546] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.454681] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e2390617-a1da-45a2-94eb-d162a19e2fae',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 817.498731] env[69980]: INFO networking_nsxv3.common.synchronization [req-631a9680-d938-4ab0-ab9b-bf31bfb09d92 req-9ac9c9a1-cfc5-4811-bd93-d99d79aca5bc tempest-SecurityGroupsTestJSON-1482814430 tempest-SecurityGroupsTestJSON-1482814430-project-member] Enqueued Resource ID: e2390617-a1da-45a2-94eb-d162a19e2fae with Priority: HIGHEST for action security_group_rules [ 817.498914] env[69980]: INFO networking_nsxv3.common.synchronization [req-631a9680-d938-4ab0-ab9b-bf31bfb09d92 req-9ac9c9a1-cfc5-4811-bd93-d99d79aca5bc tempest-SecurityGroupsTestJSON-1482814430 tempest-SecurityGroupsTestJSON-1482814430-project-member] Enqueued Resource ID: e2390617-a1da-45a2-94eb-d162a19e2fae with Priority: HIGHEST for action security_group_members [ 817.499181] env[69980]: INFO networking_nsxv3.common.synchronization [req-631a9680-d938-4ab0-ab9b-bf31bfb09d92 req-9ac9c9a1-cfc5-4811-bd93-d99d79aca5bc tempest-SecurityGroupsTestJSON-1482814430 tempest-SecurityGroupsTestJSON-1482814430-project-member] Enqueued Resource ID: f9bdd708-8cea-4b45-818f-2a931611c895 with Priority: HIGHEST for action security_group_rules [ 817.499270] env[69980]: INFO networking_nsxv3.common.synchronization [req-631a9680-d938-4ab0-ab9b-bf31bfb09d92 req-9ac9c9a1-cfc5-4811-bd93-d99d79aca5bc tempest-SecurityGroupsTestJSON-1482814430 tempest-SecurityGroupsTestJSON-1482814430-project-member] Enqueued Resource ID: f9bdd708-8cea-4b45-818f-2a931611c895 with Priority: HIGHEST for action security_group_members [ 817.499911] env[69980]: INFO networking_nsxv3.common.synchronization [req-631a9680-d938-4ab0-ab9b-bf31bfb09d92 req-9ac9c9a1-cfc5-4811-bd93-d99d79aca5bc tempest-SecurityGroupsTestJSON-1482814430 tempest-SecurityGroupsTestJSON-1482814430-project-member] Enqueued Resource ID: ddd15313-733b-4470-8916-4af93c716fed with Priority: HIGHEST for action port [ 817.499911] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e2390617-a1da-45a2-94eb-d162a19e2fae with Priority: HIGHEST for action security_group_rules [ 817.500052] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f9bdd708-8cea-4b45-818f-2a931611c895 with Priority: HIGHEST for action security_group_rules [ 817.500650] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ddd15313-733b-4470-8916-4af93c716fed with Priority: HIGHEST for action port [ 817.500780] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e2390617-a1da-45a2-94eb-d162a19e2fae with Priority: HIGHEST for action security_group_members [ 817.500876] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f9bdd708-8cea-4b45-818f-2a931611c895 with Priority: HIGHEST for action security_group_members [ 817.501262] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e2390617-a1da-45a2-94eb-d162a19e2fae taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.501381] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e2390617-a1da-45a2-94eb-d162a19e2fae" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.501445] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e2390617-a1da-45a2-94eb-d162a19e2fae" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.501646] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e2390617-a1da-45a2-94eb-d162a19e2fae" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.501735] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e2390617-a1da-45a2-94eb-d162a19e2fae',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 817.502747] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f9bdd708-8cea-4b45-818f-2a931611c895 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.502882] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f9bdd708-8cea-4b45-818f-2a931611c895" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.502951] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f9bdd708-8cea-4b45-818f-2a931611c895" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.503278] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f9bdd708-8cea-4b45-818f-2a931611c895" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.503374] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f9bdd708-8cea-4b45-818f-2a931611c895',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 817.507453] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock port-ddd15313-733b-4470-8916-4af93c716fed taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.507566] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ddd15313-733b-4470-8916-4af93c716fed" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.507566] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ddd15313-733b-4470-8916-4af93c716fed" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.507737] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ddd15313-733b-4470-8916-4af93c716fed" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.507813] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ddd15313-733b-4470-8916-4af93c716fed',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 817.508674] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-e2390617-a1da-45a2-94eb-d162a19e2fae taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.508674] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e2390617-a1da-45a2-94eb-d162a19e2fae" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.511012] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-f9bdd708-8cea-4b45-818f-2a931611c895 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.511012] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f9bdd708-8cea-4b45-818f-2a931611c895" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.547181] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 61b51096-066e-4c5d-b696-b9c061599dcc: rpc.has_security_group_logging(os_id): False [ 817.564843] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.564983] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.565108] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.565286] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.565384] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.565632] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.565733] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.565797] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.565950] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.566041] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.566131] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 61b51096-066e-4c5d-b696-b9c061599dcc is going to be created. [ 817.608791] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d53aff15-d6ed-495c-9f29-fdc03bd13622',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 817.609814] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-d53aff15-d6ed-495c-9f29-fdc03bd13622 taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.609917] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d53aff15-d6ed-495c-9f29-fdc03bd13622" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.610971] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a8bd563c-8ecc-4c8a-bb72-ba832a6b3e79 with status ACTIVE [ 817.610971] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.610971] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.610971] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.610971] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.610971] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.610971] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.610971] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.610971] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.611383] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.611383] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.611383] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.611482] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.611513] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.615382] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.615382] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.615382] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a8bd563c-8ecc-4c8a-bb72-ba832a6b3e79 is going to be updated. [ 817.631997] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.632311] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.632311] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.632435] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.632722] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.632722] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a8bd563c-8ecc-4c8a-bb72-ba832a6b3e79" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.633694] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.633822] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.633878] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.634134] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.634311] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.643723] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 61b51096-066e-4c5d-b696-b9c061599dcc in Status: IN_PROGRESS for 2s [ 817.936073] env[69980]: INFO networking_nsxv3.common.synchronization [req-982b8e14-2a0d-47c5-adbf-2c4690707a91 req-806a72e3-78a8-48a3-ab85-acba9a112a2d tempest-ImagesNegativeTestJSON-872012680 tempest-ImagesNegativeTestJSON-872012680-project-member] Enqueued Resource ID: d696a1d3-1fa9-4790-b673-19d262f97699 with Priority: HIGHEST for action security_group_members [ 817.936611] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d696a1d3-1fa9-4790-b673-19d262f97699 with Priority: HIGHEST for action security_group_members [ 817.937116] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-d696a1d3-1fa9-4790-b673-19d262f97699 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.937116] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d696a1d3-1fa9-4790-b673-19d262f97699" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.937250] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d696a1d3-1fa9-4790-b673-19d262f97699" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.937483] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d696a1d3-1fa9-4790-b673-19d262f97699" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.937675] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.937810] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.937898] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.938119] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.938238] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.938422] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d696a1d3-1fa9-4790-b673-19d262f97699',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 817.958705] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f9bdd708-8cea-4b45-818f-2a931611c895',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 817.959540] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e2390617-a1da-45a2-94eb-d162a19e2fae',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 818.012244] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-e2390617-a1da-45a2-94eb-d162a19e2fae taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.012244] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e2390617-a1da-45a2-94eb-d162a19e2fae" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.012244] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port ddd15313-733b-4470-8916-4af93c716fed with status ACTIVE [ 818.012244] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.012244] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.012244] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.012244] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.012244] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.012244] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.012244] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.012244] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.012244] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.012244] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.012723] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.012723] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.012723] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.012723] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.012832] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.012890] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: ddd15313-733b-4470-8916-4af93c716fed is going to be updated. [ 818.014382] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-f9bdd708-8cea-4b45-818f-2a931611c895 taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.014484] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f9bdd708-8cea-4b45-818f-2a931611c895" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.034207] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.034343] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.034384] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.034763] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.035050] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.035445] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ddd15313-733b-4470-8916-4af93c716fed" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.113648] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d53aff15-d6ed-495c-9f29-fdc03bd13622',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 818.442537] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.442687] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.442744] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.442945] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.443179] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.443431] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.443542] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.443604] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.443778] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.443854] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.443944] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d696a1d3-1fa9-4790-b673-19d262f97699 already deleted. [ 818.444038] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d696a1d3-1fa9-4790-b673-19d262f97699" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.464225] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f9bdd708-8cea-4b45-818f-2a931611c895',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 818.464225] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e2390617-a1da-45a2-94eb-d162a19e2fae',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 818.616961] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.617259] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.617259] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.617526] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.617612] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.617673] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d53aff15-d6ed-495c-9f29-fdc03bd13622 is going to be created. [ 818.644047] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.644294] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.644363] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.644645] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.644913] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.663391] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d53aff15-d6ed-495c-9f29-fdc03bd13622 in Status: UNINITIALIZED for 2s [ 818.708733] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock network-794 taken with stack trace [, , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.708944] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "network-794" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.709186] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "network-794" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.709525] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "network-794" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.709697] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.709858] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.709976] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.710268] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.710425] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.710634] env[69980]: DEBUG dogpile.cache.region [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] No value present for key: 'zone-id' {{(pid=69980) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 818.710747] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] NeedRegenerationException {{(pid=69980) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 818.710853] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] no value, waiting for create lock {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 818.710991] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] value creation lock acquired {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 818.711121] env[69980]: DEBUG dogpile.cache.region [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] No value present for key: 'zone-id' {{(pid=69980) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 818.711225] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Calling creation function for not-yet-present value {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 818.711354] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 818.714152] env[69980]: INFO networking_nsxv3.common.synchronization [req-37736fc3-56f8-413f-a2ec-f91571081fd6 req-963ecef2-e28a-48dd-9b38-f6eadc2cd04b tempest-SecurityGroupsTestJSON-1482814430 tempest-SecurityGroupsTestJSON-1482814430-project-member] Enqueued Resource ID: cdebe06d-8b9c-47c7-bf4d-f0246381eb14 with Priority: HIGHEST for action security_group_members [ 818.714343] env[69980]: INFO networking_nsxv3.common.synchronization [req-37736fc3-56f8-413f-a2ec-f91571081fd6 req-963ecef2-e28a-48dd-9b38-f6eadc2cd04b tempest-SecurityGroupsTestJSON-1482814430 tempest-SecurityGroupsTestJSON-1482814430-project-member] Enqueued Resource ID: e2390617-a1da-45a2-94eb-d162a19e2fae with Priority: HIGHEST for action security_group_members [ 818.714475] env[69980]: INFO networking_nsxv3.common.synchronization [req-37736fc3-56f8-413f-a2ec-f91571081fd6 req-963ecef2-e28a-48dd-9b38-f6eadc2cd04b tempest-SecurityGroupsTestJSON-1482814430 tempest-SecurityGroupsTestJSON-1482814430-project-member] Enqueued Resource ID: f9bdd708-8cea-4b45-818f-2a931611c895 with Priority: HIGHEST for action security_group_members [ 818.715349] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cdebe06d-8b9c-47c7-bf4d-f0246381eb14 with Priority: HIGHEST for action security_group_members [ 818.715817] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e2390617-a1da-45a2-94eb-d162a19e2fae with Priority: HIGHEST for action security_group_members [ 818.715947] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f9bdd708-8cea-4b45-818f-2a931611c895 with Priority: HIGHEST for action security_group_members [ 818.716476] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-cdebe06d-8b9c-47c7-bf4d-f0246381eb14 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.716591] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cdebe06d-8b9c-47c7-bf4d-f0246381eb14" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.716686] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cdebe06d-8b9c-47c7-bf4d-f0246381eb14" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.716906] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cdebe06d-8b9c-47c7-bf4d-f0246381eb14" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.717077] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.717182] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.717236] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.717443] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.717571] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.717674] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cdebe06d-8b9c-47c7-bf4d-f0246381eb14',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 818.718511] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-e2390617-a1da-45a2-94eb-d162a19e2fae taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.718593] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e2390617-a1da-45a2-94eb-d162a19e2fae" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.718793] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-f9bdd708-8cea-4b45-818f-2a931611c895 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.722049] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f9bdd708-8cea-4b45-818f-2a931611c895" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.734877] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 818.735083] env[69980]: DEBUG dogpile.cache.region [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=69980) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 818.735227] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Released creation lock {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 818.735412] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "network-794" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.735753] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock port-6bba9ece-dfce-4ca0-9d5a-ed9b0958e4ed taken with stack trace [, , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.735941] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "port-6bba9ece-dfce-4ca0-9d5a-ed9b0958e4ed" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.736080] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "port-6bba9ece-dfce-4ca0-9d5a-ed9b0958e4ed" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.736425] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "port-6bba9ece-dfce-4ca0-9d5a-ed9b0958e4ed" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.736569] env[69980]: DEBUG networking_nsxv3.api.rpc [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6bba9ece-dfce-4ca0-9d5a-ed9b0958e4ed',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 818.757033] env[69980]: INFO networking_nsxv3.common.synchronization [req-37736fc3-56f8-413f-a2ec-f91571081fd6 req-963ecef2-e28a-48dd-9b38-f6eadc2cd04b tempest-SecurityGroupsTestJSON-1482814430 tempest-SecurityGroupsTestJSON-1482814430-project-member] Enqueued Resource ID: cdebe06d-8b9c-47c7-bf4d-f0246381eb14 with Priority: HIGHEST for action security_group_rules [ 818.757033] env[69980]: INFO networking_nsxv3.common.synchronization [req-37736fc3-56f8-413f-a2ec-f91571081fd6 req-963ecef2-e28a-48dd-9b38-f6eadc2cd04b tempest-SecurityGroupsTestJSON-1482814430 tempest-SecurityGroupsTestJSON-1482814430-project-member] Enqueued Resource ID: cdebe06d-8b9c-47c7-bf4d-f0246381eb14 with Priority: HIGHEST for action security_group_members [ 818.757033] env[69980]: INFO networking_nsxv3.common.synchronization [req-37736fc3-56f8-413f-a2ec-f91571081fd6 req-963ecef2-e28a-48dd-9b38-f6eadc2cd04b tempest-SecurityGroupsTestJSON-1482814430 tempest-SecurityGroupsTestJSON-1482814430-project-member] Enqueued Resource ID: e2390617-a1da-45a2-94eb-d162a19e2fae with Priority: HIGHEST for action security_group_rules [ 818.757033] env[69980]: INFO networking_nsxv3.common.synchronization [req-37736fc3-56f8-413f-a2ec-f91571081fd6 req-963ecef2-e28a-48dd-9b38-f6eadc2cd04b tempest-SecurityGroupsTestJSON-1482814430 tempest-SecurityGroupsTestJSON-1482814430-project-member] Enqueued Resource ID: e2390617-a1da-45a2-94eb-d162a19e2fae with Priority: HIGHEST for action security_group_members [ 818.757456] env[69980]: INFO networking_nsxv3.common.synchronization [req-37736fc3-56f8-413f-a2ec-f91571081fd6 req-963ecef2-e28a-48dd-9b38-f6eadc2cd04b tempest-SecurityGroupsTestJSON-1482814430 tempest-SecurityGroupsTestJSON-1482814430-project-member] Enqueued Resource ID: f9bdd708-8cea-4b45-818f-2a931611c895 with Priority: HIGHEST for action security_group_rules [ 818.757723] env[69980]: INFO networking_nsxv3.common.synchronization [req-37736fc3-56f8-413f-a2ec-f91571081fd6 req-963ecef2-e28a-48dd-9b38-f6eadc2cd04b tempest-SecurityGroupsTestJSON-1482814430 tempest-SecurityGroupsTestJSON-1482814430-project-member] Enqueued Resource ID: f9bdd708-8cea-4b45-818f-2a931611c895 with Priority: HIGHEST for action security_group_members [ 818.758109] env[69980]: INFO networking_nsxv3.common.synchronization [req-37736fc3-56f8-413f-a2ec-f91571081fd6 req-963ecef2-e28a-48dd-9b38-f6eadc2cd04b tempest-SecurityGroupsTestJSON-1482814430 tempest-SecurityGroupsTestJSON-1482814430-project-member] Enqueued Resource ID: ddd15313-733b-4470-8916-4af93c716fed with Priority: HIGHEST for action port [ 818.759106] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cdebe06d-8b9c-47c7-bf4d-f0246381eb14 with Priority: HIGHEST for action security_group_rules [ 818.759365] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e2390617-a1da-45a2-94eb-d162a19e2fae with Priority: HIGHEST for action security_group_rules [ 818.759575] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f9bdd708-8cea-4b45-818f-2a931611c895 with Priority: HIGHEST for action security_group_members [ 818.759825] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ddd15313-733b-4470-8916-4af93c716fed with Priority: HIGHEST for action port [ 818.760033] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f9bdd708-8cea-4b45-818f-2a931611c895 with Priority: HIGHEST for action security_group_rules [ 818.760219] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cdebe06d-8b9c-47c7-bf4d-f0246381eb14 with Priority: HIGHEST for action security_group_members [ 818.760417] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e2390617-a1da-45a2-94eb-d162a19e2fae with Priority: HIGHEST for action security_group_members [ 818.760776] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cdebe06d-8b9c-47c7-bf4d-f0246381eb14 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.762120] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cdebe06d-8b9c-47c7-bf4d-f0246381eb14" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.762120] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cdebe06d-8b9c-47c7-bf4d-f0246381eb14" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.762120] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cdebe06d-8b9c-47c7-bf4d-f0246381eb14" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.762120] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cdebe06d-8b9c-47c7-bf4d-f0246381eb14',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 818.763285] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e2390617-a1da-45a2-94eb-d162a19e2fae taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.763579] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e2390617-a1da-45a2-94eb-d162a19e2fae" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.765997] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-f9bdd708-8cea-4b45-818f-2a931611c895 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.766176] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f9bdd708-8cea-4b45-818f-2a931611c895" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.766449] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock port-ddd15313-733b-4470-8916-4af93c716fed taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.766587] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ddd15313-733b-4470-8916-4af93c716fed" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.766677] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ddd15313-733b-4470-8916-4af93c716fed" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.766874] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ddd15313-733b-4470-8916-4af93c716fed" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.766971] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ddd15313-733b-4470-8916-4af93c716fed',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 818.767882] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f9bdd708-8cea-4b45-818f-2a931611c895 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.767982] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f9bdd708-8cea-4b45-818f-2a931611c895" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.768188] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-cdebe06d-8b9c-47c7-bf4d-f0246381eb14 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.768269] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cdebe06d-8b9c-47c7-bf4d-f0246381eb14" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.768465] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-e2390617-a1da-45a2-94eb-d162a19e2fae taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.768545] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e2390617-a1da-45a2-94eb-d162a19e2fae" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.965674] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.966799] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.966903] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.967181] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.967381] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.967501] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f9bdd708-8cea-4b45-818f-2a931611c895 is going to be created. [ 818.972220] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.972443] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.972530] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.973494] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.973662] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.973806] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e2390617-a1da-45a2-94eb-d162a19e2fae is going to be updated. [ 818.996862] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.997081] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.997176] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.997479] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.997742] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.000737] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.000893] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.001021] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.001276] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.001604] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.011129] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e2390617-a1da-45a2-94eb-d162a19e2fae in Status: IN_PROGRESS for 2s [ 819.011839] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f9bdd708-8cea-4b45-818f-2a931611c895 in Status: UNINITIALIZED for 2s [ 819.220067] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('cdebe06d-8b9c-47c7-bf4d-f0246381eb14',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 819.239333] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.239566] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.239689] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.239974] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.240143] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.240305] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Segment Port 6bba9ece-dfce-4ca0-9d5a-ed9b0958e4ed not found, creating... [ 819.240564] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.240715] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.240830] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.241068] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.241207] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.241488] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.241651] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.241777] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.241968] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.242115] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.242254] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Resource: SegmentPort with ID: 6bba9ece-dfce-4ca0-9d5a-ed9b0958e4ed is going to be created. [ 819.262352] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.262557] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.262682] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.262950] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.263259] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.263490] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "port-6bba9ece-dfce-4ca0-9d5a-ed9b0958e4ed" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.269261] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-cdebe06d-8b9c-47c7-bf4d-f0246381eb14 taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.269400] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cdebe06d-8b9c-47c7-bf4d-f0246381eb14" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.270643] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port ddd15313-733b-4470-8916-4af93c716fed with status ACTIVE [ 819.270818] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.270964] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.271046] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.271275] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.271329] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.271504] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.271599] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.271670] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.271805] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.271884] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.272086] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.272253] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.272308] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.272494] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.272541] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.272591] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: ddd15313-733b-4470-8916-4af93c716fed is going to be updated. [ 819.291681] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.291865] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.291906] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.292489] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.292489] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.292616] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ddd15313-733b-4470-8916-4af93c716fed" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.656506] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 61b51096-066e-4c5d-b696-b9c061599dcc in Status: SUCCESS [ 819.656799] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-61b51096-066e-4c5d-b696-b9c061599dcc" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.723205] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('cdebe06d-8b9c-47c7-bf4d-f0246381eb14',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 820.033947] env[69980]: INFO networking_nsxv3.common.synchronization [req-982b8e14-2a0d-47c5-adbf-2c4690707a91 req-e61f938a-582f-4db3-9218-94948d91da63 service nova] Enqueued Resource ID: d696a1d3-1fa9-4790-b673-19d262f97699 with Priority: HIGHEST for action security_group_rules [ 820.033947] env[69980]: INFO networking_nsxv3.common.synchronization [req-982b8e14-2a0d-47c5-adbf-2c4690707a91 req-e61f938a-582f-4db3-9218-94948d91da63 service nova] Enqueued Resource ID: d696a1d3-1fa9-4790-b673-19d262f97699 with Priority: HIGHEST for action security_group_members [ 820.033947] env[69980]: INFO networking_nsxv3.common.synchronization [req-982b8e14-2a0d-47c5-adbf-2c4690707a91 req-e61f938a-582f-4db3-9218-94948d91da63 service nova] Enqueued Resource ID: 6bba9ece-dfce-4ca0-9d5a-ed9b0958e4ed with Priority: HIGHEST for action port [ 820.033947] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d696a1d3-1fa9-4790-b673-19d262f97699 with Priority: HIGHEST for action security_group_rules [ 820.033947] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d696a1d3-1fa9-4790-b673-19d262f97699 with Priority: HIGHEST for action security_group_members [ 820.033947] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6bba9ece-dfce-4ca0-9d5a-ed9b0958e4ed with Priority: HIGHEST for action port [ 820.038062] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d696a1d3-1fa9-4790-b673-19d262f97699 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.038062] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d696a1d3-1fa9-4790-b673-19d262f97699" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.038062] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d696a1d3-1fa9-4790-b673-19d262f97699" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.038062] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d696a1d3-1fa9-4790-b673-19d262f97699" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.038062] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d696a1d3-1fa9-4790-b673-19d262f97699',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 820.038062] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-d696a1d3-1fa9-4790-b673-19d262f97699 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.038062] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d696a1d3-1fa9-4790-b673-19d262f97699" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.038062] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d696a1d3-1fa9-4790-b673-19d262f97699" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.038062] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d696a1d3-1fa9-4790-b673-19d262f97699" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.038062] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.038062] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.038062] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.038062] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.038062] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.038062] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d696a1d3-1fa9-4790-b673-19d262f97699',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 820.038837] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock port-6bba9ece-dfce-4ca0-9d5a-ed9b0958e4ed taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.039100] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6bba9ece-dfce-4ca0-9d5a-ed9b0958e4ed" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.039253] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6bba9ece-dfce-4ca0-9d5a-ed9b0958e4ed" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.040155] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6bba9ece-dfce-4ca0-9d5a-ed9b0958e4ed" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.041910] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6bba9ece-dfce-4ca0-9d5a-ed9b0958e4ed',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 820.227116] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.227301] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.227374] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.227604] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.227693] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.229966] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cdebe06d-8b9c-47c7-bf4d-f0246381eb14 is going to be created. [ 820.251352] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.251692] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.251692] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.251937] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.252139] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.260957] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cdebe06d-8b9c-47c7-bf4d-f0246381eb14 in Status: UNINITIALIZED for 2s [ 820.544022] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 6bba9ece-dfce-4ca0-9d5a-ed9b0958e4ed with status ACTIVE [ 820.544022] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.544022] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.544022] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.544219] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.548036] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.548036] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.548036] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.548036] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.548036] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.548036] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.548036] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.548036] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.548036] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.548036] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.548036] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.548036] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 6bba9ece-dfce-4ca0-9d5a-ed9b0958e4ed is going to be updated. [ 820.548036] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-d696a1d3-1fa9-4790-b673-19d262f97699 taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.548036] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d696a1d3-1fa9-4790-b673-19d262f97699" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.548036] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d696a1d3-1fa9-4790-b673-19d262f97699',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 820.576115] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.576115] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.576115] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.576115] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.576115] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.576115] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6bba9ece-dfce-4ca0-9d5a-ed9b0958e4ed" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.681038] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d53aff15-d6ed-495c-9f29-fdc03bd13622 in Status: SUCCESS [ 820.681038] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d53aff15-d6ed-495c-9f29-fdc03bd13622" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.681382] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d53aff15-d6ed-495c-9f29-fdc03bd13622" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.681382] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d53aff15-d6ed-495c-9f29-fdc03bd13622" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.681684] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.681880] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.681938] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.682127] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.682239] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.682355] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d53aff15-d6ed-495c-9f29-fdc03bd13622" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.682482] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d53aff15-d6ed-495c-9f29-fdc03bd13622',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 821.021544] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e2390617-a1da-45a2-94eb-d162a19e2fae in Status: SUCCESS [ 821.021782] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e2390617-a1da-45a2-94eb-d162a19e2fae" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.021945] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e2390617-a1da-45a2-94eb-d162a19e2fae" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.022183] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e2390617-a1da-45a2-94eb-d162a19e2fae" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.022375] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.022493] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.022562] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.022723] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.022806] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.022928] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e2390617-a1da-45a2-94eb-d162a19e2fae',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 821.024429] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f9bdd708-8cea-4b45-818f-2a931611c895 in Status: SUCCESS [ 821.024636] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f9bdd708-8cea-4b45-818f-2a931611c895" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.024784] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f9bdd708-8cea-4b45-818f-2a931611c895" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.024973] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f9bdd708-8cea-4b45-818f-2a931611c895" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.025162] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.025263] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.025327] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.025489] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.025581] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.025675] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f9bdd708-8cea-4b45-818f-2a931611c895',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 821.049724] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d696a1d3-1fa9-4790-b673-19d262f97699',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 821.186025] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-d53aff15-d6ed-495c-9f29-fdc03bd13622 taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.186234] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d53aff15-d6ed-495c-9f29-fdc03bd13622" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.186314] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d53aff15-d6ed-495c-9f29-fdc03bd13622" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.186548] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d53aff15-d6ed-495c-9f29-fdc03bd13622" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.186714] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.186813] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.186879] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.187066] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.187171] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.187287] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d53aff15-d6ed-495c-9f29-fdc03bd13622" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.187448] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-d53aff15-d6ed-495c-9f29-fdc03bd13622 taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.187555] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d53aff15-d6ed-495c-9f29-fdc03bd13622" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.187654] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d53aff15-d6ed-495c-9f29-fdc03bd13622" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.187772] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d53aff15-d6ed-495c-9f29-fdc03bd13622" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.187903] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.187992] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.188065] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.188203] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.188278] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.188358] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d53aff15-d6ed-495c-9f29-fdc03bd13622" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.188449] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d53aff15-d6ed-495c-9f29-fdc03bd13622',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 821.421799] env[69980]: INFO networking_nsxv3.common.synchronization [req-69dc7a1d-6fe6-4da5-963d-efd661db1172 req-43ee2d58-c8fd-4f6e-8dd8-461a74c47633 tempest-FloatingIPsAssociationTestJSON-592488877 tempest-FloatingIPsAssociationTestJSON-592488877-project-member] Enqueued Resource ID: 186800b9-4416-4ee9-97e6-a0aa4cad729b with Priority: HIGHEST for action security_group_members [ 821.423424] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 186800b9-4416-4ee9-97e6-a0aa4cad729b with Priority: HIGHEST for action security_group_members [ 821.423988] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-186800b9-4416-4ee9-97e6-a0aa4cad729b taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.424443] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-186800b9-4416-4ee9-97e6-a0aa4cad729b" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.424531] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-186800b9-4416-4ee9-97e6-a0aa4cad729b" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.424778] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-186800b9-4416-4ee9-97e6-a0aa4cad729b" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.425183] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.425300] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.425480] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.425756] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.425855] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.425972] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('186800b9-4416-4ee9-97e6-a0aa4cad729b',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 821.528114] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f9bdd708-8cea-4b45-818f-2a931611c895',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 821.529173] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e2390617-a1da-45a2-94eb-d162a19e2fae',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 821.555647] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.555818] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.555894] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.556167] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.556262] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.556379] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d696a1d3-1fa9-4790-b673-19d262f97699 is going to be created. [ 821.580365] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.580541] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.581401] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.581401] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.581401] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.590618] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d696a1d3-1fa9-4790-b673-19d262f97699 in Status: UNINITIALIZED for 2s [ 821.690895] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d53aff15-d6ed-495c-9f29-fdc03bd13622: rpc.has_security_group_logging(os_id): False [ 821.723679] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.723846] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.723915] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.724172] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.724259] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.724460] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.724575] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.724670] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.724851] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.724934] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.725163] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.725268] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.725331] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.725477] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.725584] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.725783] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.725892] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.725957] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.726262] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.726350] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.726441] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d53aff15-d6ed-495c-9f29-fdc03bd13622 is going to be created. [ 821.794870] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.795506] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.795506] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.795506] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.795851] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.827974] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d53aff15-d6ed-495c-9f29-fdc03bd13622 in Status: IN_PROGRESS for 2s [ 821.930032] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('186800b9-4416-4ee9-97e6-a0aa4cad729b',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 822.031198] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f9bdd708-8cea-4b45-818f-2a931611c895',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 822.034535] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e2390617-a1da-45a2-94eb-d162a19e2fae',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 822.269998] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cdebe06d-8b9c-47c7-bf4d-f0246381eb14 in Status: SUCCESS [ 822.270284] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cdebe06d-8b9c-47c7-bf4d-f0246381eb14" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.270424] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cdebe06d-8b9c-47c7-bf4d-f0246381eb14" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.270646] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cdebe06d-8b9c-47c7-bf4d-f0246381eb14" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.270841] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.270954] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.271040] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.271242] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.271332] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.271425] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cdebe06d-8b9c-47c7-bf4d-f0246381eb14',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 822.432867] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('186800b9-4416-4ee9-97e6-a0aa4cad729b',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 822.539394] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.539564] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.539649] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.540376] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.540516] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.540722] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f9bdd708-8cea-4b45-818f-2a931611c895 is going to be updated. [ 822.543788] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.543942] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.544047] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.544294] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.544395] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.544522] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e2390617-a1da-45a2-94eb-d162a19e2fae is going to be updated. [ 822.573246] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.573441] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.573504] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.573786] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.573995] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.576084] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.576240] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.576308] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.576475] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.576608] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.590393] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f9bdd708-8cea-4b45-818f-2a931611c895 in Status: IN_PROGRESS for 2s [ 822.591107] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e2390617-a1da-45a2-94eb-d162a19e2fae in Status: IN_PROGRESS for 2s [ 822.773737] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('cdebe06d-8b9c-47c7-bf4d-f0246381eb14',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 822.935821] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.935890] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.935969] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.936205] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.936298] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.936399] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 186800b9-4416-4ee9-97e6-a0aa4cad729b is going to be updated. [ 822.962194] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.962340] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.962413] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.962629] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.962774] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.970636] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 186800b9-4416-4ee9-97e6-a0aa4cad729b in Status: IN_PROGRESS for 2s [ 823.091867] env[69980]: INFO networking_nsxv3.common.synchronization [req-92e81843-bcb7-40c5-8e86-7abe72a6d981 req-55498db7-c752-4efc-a6d3-28284b462af6 tempest-ServersNegativeTestJSON-1861659283 tempest-ServersNegativeTestJSON-1861659283-project-member] Enqueued Resource ID: f44b2d06-c9ca-4621-a354-74c006769956 with Priority: HIGHEST for action security_group_members [ 823.092590] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f44b2d06-c9ca-4621-a354-74c006769956 with Priority: HIGHEST for action security_group_members [ 823.097136] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-f44b2d06-c9ca-4621-a354-74c006769956 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.097304] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f44b2d06-c9ca-4621-a354-74c006769956" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.097367] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f44b2d06-c9ca-4621-a354-74c006769956" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.097653] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f44b2d06-c9ca-4621-a354-74c006769956" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.097857] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.097994] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.098092] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.098276] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.098361] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.098483] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f44b2d06-c9ca-4621-a354-74c006769956',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 823.275659] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('cdebe06d-8b9c-47c7-bf4d-f0246381eb14',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 823.576477] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock network-278 taken with stack trace [, , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.576641] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "network-278" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.576761] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "network-278" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.577104] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "network-278" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.577370] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.577522] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.577635] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.577846] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.577993] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.581340] env[69980]: DEBUG dogpile.cache.region [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] No value present for key: 'zone-id' {{(pid=69980) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 823.581340] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] NeedRegenerationException {{(pid=69980) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 823.581340] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] no value, waiting for create lock {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 823.581340] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] value creation lock acquired {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 823.581340] env[69980]: DEBUG dogpile.cache.region [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] No value present for key: 'zone-id' {{(pid=69980) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 823.581340] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Calling creation function for not-yet-present value {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 823.581340] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 823.598284] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 823.598514] env[69980]: DEBUG dogpile.cache.region [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=69980) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 823.598681] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Released creation lock {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 823.598867] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "network-278" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.599194] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock port-51de4fcc-04eb-42fa-8638-3547d84351b0 taken with stack trace [, , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.599371] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "port-51de4fcc-04eb-42fa-8638-3547d84351b0" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.599498] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "port-51de4fcc-04eb-42fa-8638-3547d84351b0" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.599833] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "port-51de4fcc-04eb-42fa-8638-3547d84351b0" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.599969] env[69980]: DEBUG networking_nsxv3.api.rpc [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('51de4fcc-04eb-42fa-8638-3547d84351b0',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 823.601106] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.601237] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.601305] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.601471] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.601557] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.601736] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.602591] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.602591] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.602591] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.602591] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.602591] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f44b2d06-c9ca-4621-a354-74c006769956 already deleted. [ 823.602591] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f44b2d06-c9ca-4621-a354-74c006769956" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.603126] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d696a1d3-1fa9-4790-b673-19d262f97699 in Status: SUCCESS [ 823.603353] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d696a1d3-1fa9-4790-b673-19d262f97699" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.603493] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d696a1d3-1fa9-4790-b673-19d262f97699" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.603708] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d696a1d3-1fa9-4790-b673-19d262f97699" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.603797] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.603895] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.603957] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.604117] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.604212] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.604290] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d696a1d3-1fa9-4790-b673-19d262f97699" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.604380] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d696a1d3-1fa9-4790-b673-19d262f97699',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 823.784871] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.784871] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.784871] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.784871] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.784871] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.784871] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cdebe06d-8b9c-47c7-bf4d-f0246381eb14 is going to be updated. [ 823.825943] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.826114] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.826181] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.826384] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.826520] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.843025] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cdebe06d-8b9c-47c7-bf4d-f0246381eb14 in Status: IN_PROGRESS for 2s [ 823.847153] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d53aff15-d6ed-495c-9f29-fdc03bd13622 in Status: SUCCESS [ 823.847153] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d53aff15-d6ed-495c-9f29-fdc03bd13622" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.103963] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.104565] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.104831] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.105246] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.105517] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.105779] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Segment Port 51de4fcc-04eb-42fa-8638-3547d84351b0 not found, creating... [ 824.106148] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.106336] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.106507] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.106935] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.106935] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.107354] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.107548] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.107675] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.108017] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.108183] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.108350] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Resource: SegmentPort with ID: 51de4fcc-04eb-42fa-8638-3547d84351b0 is going to be created. [ 824.109657] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-d696a1d3-1fa9-4790-b673-19d262f97699 taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.109795] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d696a1d3-1fa9-4790-b673-19d262f97699" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.109952] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d696a1d3-1fa9-4790-b673-19d262f97699" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.110072] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d696a1d3-1fa9-4790-b673-19d262f97699" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.110410] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.110544] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.110603] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.110968] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.110968] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.111074] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d696a1d3-1fa9-4790-b673-19d262f97699" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.111212] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-d696a1d3-1fa9-4790-b673-19d262f97699 taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.112094] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d696a1d3-1fa9-4790-b673-19d262f97699" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.112094] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d696a1d3-1fa9-4790-b673-19d262f97699" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.112094] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d696a1d3-1fa9-4790-b673-19d262f97699" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.112208] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.112421] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.112421] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.112506] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.112584] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.112681] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d696a1d3-1fa9-4790-b673-19d262f97699" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.113051] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d696a1d3-1fa9-4790-b673-19d262f97699',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 824.131793] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.132127] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.132280] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.132609] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.132953] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.135138] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "port-51de4fcc-04eb-42fa-8638-3547d84351b0" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.601326] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f9bdd708-8cea-4b45-818f-2a931611c895 in Status: SUCCESS [ 824.601326] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f9bdd708-8cea-4b45-818f-2a931611c895" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.601326] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f9bdd708-8cea-4b45-818f-2a931611c895" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.601542] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f9bdd708-8cea-4b45-818f-2a931611c895" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.601667] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.601796] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.601796] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.603453] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.603453] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.603453] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f9bdd708-8cea-4b45-818f-2a931611c895" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.603453] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f9bdd708-8cea-4b45-818f-2a931611c895',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 824.603786] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e2390617-a1da-45a2-94eb-d162a19e2fae in Status: SUCCESS [ 824.604046] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e2390617-a1da-45a2-94eb-d162a19e2fae" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.604143] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f9bdd708-8cea-4b45-818f-2a931611c895" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.604354] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f9bdd708-8cea-4b45-818f-2a931611c895" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.604651] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.604651] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.604806] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.606307] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.606307] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.606307] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f9bdd708-8cea-4b45-818f-2a931611c895',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 824.606307] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e2390617-a1da-45a2-94eb-d162a19e2fae" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.606307] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e2390617-a1da-45a2-94eb-d162a19e2fae" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.606307] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.606307] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.606307] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.606836] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.606836] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.606836] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e2390617-a1da-45a2-94eb-d162a19e2fae" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.606836] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e2390617-a1da-45a2-94eb-d162a19e2fae',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 824.607531] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e2390617-a1da-45a2-94eb-d162a19e2fae" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.607709] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e2390617-a1da-45a2-94eb-d162a19e2fae" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.607855] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.607963] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.608047] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.608202] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.608286] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.608400] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e2390617-a1da-45a2-94eb-d162a19e2fae',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 824.617367] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d696a1d3-1fa9-4790-b673-19d262f97699: rpc.has_security_group_logging(os_id): False [ 824.633360] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.636027] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.636027] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.636027] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.636027] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.636027] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.636027] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.636027] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.636027] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.636027] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.636027] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.636027] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.636027] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.636027] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.636027] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.636705] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.636705] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.636903] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.637157] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.637351] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.637535] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d696a1d3-1fa9-4790-b673-19d262f97699 is going to be created. [ 824.726029] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.726029] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.726029] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.726029] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.726029] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.735593] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d696a1d3-1fa9-4790-b673-19d262f97699 in Status: IN_PROGRESS for 2s [ 824.969546] env[69980]: INFO networking_nsxv3.common.synchronization [req-92e81843-bcb7-40c5-8e86-7abe72a6d981 req-94fa28bc-61a9-40dd-b5de-f49874b29836 service nova] Enqueued Resource ID: f44b2d06-c9ca-4621-a354-74c006769956 with Priority: HIGHEST for action security_group_rules [ 824.969546] env[69980]: INFO networking_nsxv3.common.synchronization [req-92e81843-bcb7-40c5-8e86-7abe72a6d981 req-94fa28bc-61a9-40dd-b5de-f49874b29836 service nova] Enqueued Resource ID: f44b2d06-c9ca-4621-a354-74c006769956 with Priority: HIGHEST for action security_group_members [ 824.969546] env[69980]: INFO networking_nsxv3.common.synchronization [req-92e81843-bcb7-40c5-8e86-7abe72a6d981 req-94fa28bc-61a9-40dd-b5de-f49874b29836 service nova] Enqueued Resource ID: 51de4fcc-04eb-42fa-8638-3547d84351b0 with Priority: HIGHEST for action port [ 824.969546] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f44b2d06-c9ca-4621-a354-74c006769956 with Priority: HIGHEST for action security_group_rules [ 824.969546] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f44b2d06-c9ca-4621-a354-74c006769956 with Priority: HIGHEST for action security_group_members [ 824.969546] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 51de4fcc-04eb-42fa-8638-3547d84351b0 with Priority: HIGHEST for action port [ 824.970260] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f44b2d06-c9ca-4621-a354-74c006769956 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.970519] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f44b2d06-c9ca-4621-a354-74c006769956" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.970698] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f44b2d06-c9ca-4621-a354-74c006769956" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.971164] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f44b2d06-c9ca-4621-a354-74c006769956" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.971358] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f44b2d06-c9ca-4621-a354-74c006769956',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 824.972623] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-f44b2d06-c9ca-4621-a354-74c006769956 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.974059] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f44b2d06-c9ca-4621-a354-74c006769956" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.974059] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f44b2d06-c9ca-4621-a354-74c006769956" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.974059] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f44b2d06-c9ca-4621-a354-74c006769956" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.974059] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.974059] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.974059] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.974059] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.974059] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.974059] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f44b2d06-c9ca-4621-a354-74c006769956',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 824.975652] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock port-51de4fcc-04eb-42fa-8638-3547d84351b0 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.975908] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-51de4fcc-04eb-42fa-8638-3547d84351b0" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.976257] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-51de4fcc-04eb-42fa-8638-3547d84351b0" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.976627] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-51de4fcc-04eb-42fa-8638-3547d84351b0" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.976843] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('51de4fcc-04eb-42fa-8638-3547d84351b0',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 824.988538] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 186800b9-4416-4ee9-97e6-a0aa4cad729b in Status: SUCCESS [ 824.988538] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-186800b9-4416-4ee9-97e6-a0aa4cad729b" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.109661] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f9bdd708-8cea-4b45-818f-2a931611c895',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 825.109996] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f9bdd708-8cea-4b45-818f-2a931611c895',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 825.110870] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-e2390617-a1da-45a2-94eb-d162a19e2fae taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.111013] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e2390617-a1da-45a2-94eb-d162a19e2fae" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.111177] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e2390617-a1da-45a2-94eb-d162a19e2fae',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 825.438545] env[69980]: INFO networking_nsxv3.common.synchronization [req-8c5c5ff7-815d-424b-ab8d-78189f52eb56 req-36ab0e3c-1779-4863-b94b-ecf3295fb340 tempest-DeleteServersAdminTestJSON-1963276659 tempest-DeleteServersAdminTestJSON-1963276659-project-member] Enqueued Resource ID: 07d8236a-b9f2-429a-9942-e7cb46920213 with Priority: HIGHEST for action security_group_members [ 825.439542] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 07d8236a-b9f2-429a-9942-e7cb46920213 with Priority: HIGHEST for action security_group_members [ 825.440020] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-07d8236a-b9f2-429a-9942-e7cb46920213 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.440369] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-07d8236a-b9f2-429a-9942-e7cb46920213" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.440592] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-07d8236a-b9f2-429a-9942-e7cb46920213" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.440927] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-07d8236a-b9f2-429a-9942-e7cb46920213" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.441191] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.441406] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.441547] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.441776] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.441940] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.442282] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('07d8236a-b9f2-429a-9942-e7cb46920213',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 825.479642] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-f44b2d06-c9ca-4621-a354-74c006769956 taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.479780] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f44b2d06-c9ca-4621-a354-74c006769956" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.480146] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f44b2d06-c9ca-4621-a354-74c006769956',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 825.480787] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 51de4fcc-04eb-42fa-8638-3547d84351b0 with status ACTIVE [ 825.481062] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.481124] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.481157] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.481722] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.481722] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.481722] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.481851] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.481851] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.482047] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.482132] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.482400] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.482476] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.482528] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.482749] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.482813] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.482860] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 51de4fcc-04eb-42fa-8638-3547d84351b0 is going to be updated. [ 825.513753] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.513889] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.513967] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.514207] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.514434] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.514504] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-51de4fcc-04eb-42fa-8638-3547d84351b0" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.613271] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f9bdd708-8cea-4b45-818f-2a931611c895: rpc.has_security_group_logging(os_id): False [ 825.614493] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f9bdd708-8cea-4b45-818f-2a931611c895',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 825.616818] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e2390617-a1da-45a2-94eb-d162a19e2fae',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 825.641585] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.641757] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.642427] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.642695] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.642798] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.643043] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.643203] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.643261] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.643391] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.643473] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.643562] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f9bdd708-8cea-4b45-818f-2a931611c895 is going to be created. [ 825.723309] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.723440] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.723505] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.723738] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.723918] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.739615] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f9bdd708-8cea-4b45-818f-2a931611c895 in Status: IN_PROGRESS for 2s [ 825.853187] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cdebe06d-8b9c-47c7-bf4d-f0246381eb14 in Status: SUCCESS [ 825.853411] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cdebe06d-8b9c-47c7-bf4d-f0246381eb14" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.853615] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cdebe06d-8b9c-47c7-bf4d-f0246381eb14" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.853967] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cdebe06d-8b9c-47c7-bf4d-f0246381eb14" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.854150] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.854275] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.854342] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.854511] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.854592] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.855301] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cdebe06d-8b9c-47c7-bf4d-f0246381eb14" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.855301] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('cdebe06d-8b9c-47c7-bf4d-f0246381eb14',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 825.941369] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock network-557 taken with stack trace [, , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.941665] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "network-557" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.941873] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "network-557" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.942254] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "network-557" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.942650] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.942836] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.942956] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.943382] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.943532] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.943738] env[69980]: DEBUG dogpile.cache.region [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] No value present for key: 'zone-id' {{(pid=69980) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 825.943854] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] NeedRegenerationException {{(pid=69980) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 825.943963] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] no value, waiting for create lock {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 825.944080] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] value creation lock acquired {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 825.944190] env[69980]: DEBUG dogpile.cache.region [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] No value present for key: 'zone-id' {{(pid=69980) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 825.944361] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Calling creation function for not-yet-present value {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 825.944506] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 825.946380] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.946494] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.946543] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.946709] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.946793] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.947000] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.947142] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.947208] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.947355] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.947432] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.947559] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 07d8236a-b9f2-429a-9942-e7cb46920213 is going to be updated. [ 825.970857] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 825.971178] env[69980]: DEBUG dogpile.cache.region [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Cache value generated in 0.026 seconds for key(s): 'zone-id' {{(pid=69980) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 825.971178] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Released creation lock {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 825.971362] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "network-557" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.971678] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock port-bed25775-b59d-494f-becd-51ab6319fb89 taken with stack trace [, , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.971838] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "port-bed25775-b59d-494f-becd-51ab6319fb89" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.971951] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "port-bed25775-b59d-494f-becd-51ab6319fb89" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.972438] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "port-bed25775-b59d-494f-becd-51ab6319fb89" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.972438] env[69980]: DEBUG networking_nsxv3.api.rpc [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bed25775-b59d-494f-becd-51ab6319fb89',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 825.979019] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.979019] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.979019] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.979019] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.979019] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.985440] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f44b2d06-c9ca-4621-a354-74c006769956',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 825.986856] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 07d8236a-b9f2-429a-9942-e7cb46920213 in Status: IN_PROGRESS for 2s [ 826.120041] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.120342] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.120477] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.120688] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.120780] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.120888] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f9bdd708-8cea-4b45-818f-2a931611c895 is going to be updated. [ 826.123032] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.123032] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.123032] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.123032] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.123032] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.123032] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e2390617-a1da-45a2-94eb-d162a19e2fae is going to be updated. [ 826.150169] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.150472] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.150472] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.150658] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.151227] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.153675] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.153818] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.153888] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.154078] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.154208] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.173155] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e2390617-a1da-45a2-94eb-d162a19e2fae in Status: IN_PROGRESS for 2s [ 826.173859] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f9bdd708-8cea-4b45-818f-2a931611c895 in Status: IN_PROGRESS for 2s [ 826.358024] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('cdebe06d-8b9c-47c7-bf4d-f0246381eb14',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 826.475251] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.475498] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.475644] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.475934] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.476088] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.476246] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Segment Port bed25775-b59d-494f-becd-51ab6319fb89 not found, creating... [ 826.476496] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.476651] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.476765] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.476976] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.477125] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.477404] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.477569] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.477718] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.477925] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.478138] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.478283] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Resource: SegmentPort with ID: bed25775-b59d-494f-becd-51ab6319fb89 is going to be created. [ 826.488132] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.488258] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.488314] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.488449] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.488530] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.488639] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f44b2d06-c9ca-4621-a354-74c006769956 is going to be created. [ 826.500035] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.500035] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.500035] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.500035] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.500253] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.500436] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "port-bed25775-b59d-494f-becd-51ab6319fb89" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.510372] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.510526] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.510581] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.510739] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.510885] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.518892] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f44b2d06-c9ca-4621-a354-74c006769956 in Status: UNINITIALIZED for 2s [ 826.756768] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d696a1d3-1fa9-4790-b673-19d262f97699 in Status: SUCCESS [ 826.757760] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d696a1d3-1fa9-4790-b673-19d262f97699" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.861673] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for cdebe06d-8b9c-47c7-bf4d-f0246381eb14: rpc.has_security_group_logging(os_id): False [ 826.878901] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.879105] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.879193] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.879406] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.879500] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.879730] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.879829] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.879894] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.880122] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.880249] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.880405] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cdebe06d-8b9c-47c7-bf4d-f0246381eb14 is going to be created. [ 826.933102] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.933494] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.933708] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.934586] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.934586] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.943969] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cdebe06d-8b9c-47c7-bf4d-f0246381eb14 in Status: IN_PROGRESS for 2s [ 827.256030] env[69980]: INFO networking_nsxv3.common.synchronization [req-8c5c5ff7-815d-424b-ab8d-78189f52eb56 req-e456ca08-23ff-4175-a8b6-6b65fa9b4628 service nova] Enqueued Resource ID: 07d8236a-b9f2-429a-9942-e7cb46920213 with Priority: HIGHEST for action security_group_rules [ 827.256320] env[69980]: INFO networking_nsxv3.common.synchronization [req-8c5c5ff7-815d-424b-ab8d-78189f52eb56 req-e456ca08-23ff-4175-a8b6-6b65fa9b4628 service nova] Enqueued Resource ID: 07d8236a-b9f2-429a-9942-e7cb46920213 with Priority: HIGHEST for action security_group_members [ 827.256503] env[69980]: INFO networking_nsxv3.common.synchronization [req-8c5c5ff7-815d-424b-ab8d-78189f52eb56 req-e456ca08-23ff-4175-a8b6-6b65fa9b4628 service nova] Enqueued Resource ID: bed25775-b59d-494f-becd-51ab6319fb89 with Priority: HIGHEST for action port [ 827.258831] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 07d8236a-b9f2-429a-9942-e7cb46920213 with Priority: HIGHEST for action security_group_rules [ 827.261789] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 07d8236a-b9f2-429a-9942-e7cb46920213 with Priority: HIGHEST for action security_group_members [ 827.261789] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bed25775-b59d-494f-becd-51ab6319fb89 with Priority: HIGHEST for action port [ 827.261789] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock rules-07d8236a-b9f2-429a-9942-e7cb46920213 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.261789] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-07d8236a-b9f2-429a-9942-e7cb46920213" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.261789] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-07d8236a-b9f2-429a-9942-e7cb46920213" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.261789] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-07d8236a-b9f2-429a-9942-e7cb46920213" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.261789] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('07d8236a-b9f2-429a-9942-e7cb46920213',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 827.261789] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-07d8236a-b9f2-429a-9942-e7cb46920213 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.261789] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-07d8236a-b9f2-429a-9942-e7cb46920213" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.261789] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock port-bed25775-b59d-494f-becd-51ab6319fb89 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.262242] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-bed25775-b59d-494f-becd-51ab6319fb89" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.262242] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-bed25775-b59d-494f-becd-51ab6319fb89" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.262242] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-bed25775-b59d-494f-becd-51ab6319fb89" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.262242] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bed25775-b59d-494f-becd-51ab6319fb89',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 827.751760] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f9bdd708-8cea-4b45-818f-2a931611c895 in Status: SUCCESS [ 827.752025] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f9bdd708-8cea-4b45-818f-2a931611c895" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.752213] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f9bdd708-8cea-4b45-818f-2a931611c895" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.752437] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f9bdd708-8cea-4b45-818f-2a931611c895" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.752549] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f9bdd708-8cea-4b45-818f-2a931611c895',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 827.764057] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-07d8236a-b9f2-429a-9942-e7cb46920213 taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.764209] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-07d8236a-b9f2-429a-9942-e7cb46920213" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.766880] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port bed25775-b59d-494f-becd-51ab6319fb89 with status ACTIVE [ 827.767085] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.767200] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.767258] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.767540] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.767540] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.767728] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.767825] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.767873] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.767983] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.768075] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.768250] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.768395] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.768395] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.768524] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.768612] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.768716] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: bed25775-b59d-494f-becd-51ab6319fb89 is going to be updated. [ 827.788839] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.788982] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.789072] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.789278] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.789424] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.789584] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-bed25775-b59d-494f-becd-51ab6319fb89" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.997537] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 07d8236a-b9f2-429a-9942-e7cb46920213 in Status: SUCCESS [ 827.998805] env[69980]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 07d8236a-b9f2-429a-9942-e7cb46920213 deletion is rescheduled due to dependency. [ 827.998972] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-07d8236a-b9f2-429a-9942-e7cb46920213" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.999652] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-07d8236a-b9f2-429a-9942-e7cb46920213" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.999905] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-07d8236a-b9f2-429a-9942-e7cb46920213" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.000277] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.001147] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.001228] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.001399] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.001489] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.001595] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('07d8236a-b9f2-429a-9942-e7cb46920213',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 828.185421] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e2390617-a1da-45a2-94eb-d162a19e2fae in Status: SUCCESS [ 828.185421] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e2390617-a1da-45a2-94eb-d162a19e2fae" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.185421] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e2390617-a1da-45a2-94eb-d162a19e2fae" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.185421] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e2390617-a1da-45a2-94eb-d162a19e2fae" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.185421] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.185421] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.185421] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.185421] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.185421] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.185421] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e2390617-a1da-45a2-94eb-d162a19e2fae',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 828.186703] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f9bdd708-8cea-4b45-818f-2a931611c895 in Status: SUCCESS [ 828.186881] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f9bdd708-8cea-4b45-818f-2a931611c895" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.187034] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f9bdd708-8cea-4b45-818f-2a931611c895" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.187200] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f9bdd708-8cea-4b45-818f-2a931611c895" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.187358] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.187460] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.187516] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.187657] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.187734] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.187823] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f9bdd708-8cea-4b45-818f-2a931611c895',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 828.254595] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-f9bdd708-8cea-4b45-818f-2a931611c895 taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.254734] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f9bdd708-8cea-4b45-818f-2a931611c895" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.505955] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('07d8236a-b9f2-429a-9942-e7cb46920213',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 828.527774] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f44b2d06-c9ca-4621-a354-74c006769956 in Status: SUCCESS [ 828.530009] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f44b2d06-c9ca-4621-a354-74c006769956" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.530009] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f44b2d06-c9ca-4621-a354-74c006769956" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.530009] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f44b2d06-c9ca-4621-a354-74c006769956" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.530009] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.530009] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.530009] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.530009] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.530009] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.530009] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f44b2d06-c9ca-4621-a354-74c006769956" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.530009] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f44b2d06-c9ca-4621-a354-74c006769956',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 828.690411] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e2390617-a1da-45a2-94eb-d162a19e2fae',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 828.691913] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f9bdd708-8cea-4b45-818f-2a931611c895',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 828.956103] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cdebe06d-8b9c-47c7-bf4d-f0246381eb14 in Status: SUCCESS [ 828.956371] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cdebe06d-8b9c-47c7-bf4d-f0246381eb14" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.008513] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('07d8236a-b9f2-429a-9942-e7cb46920213',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 829.031515] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-f44b2d06-c9ca-4621-a354-74c006769956 taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.031665] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f44b2d06-c9ca-4621-a354-74c006769956" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.031739] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f44b2d06-c9ca-4621-a354-74c006769956" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.031958] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f44b2d06-c9ca-4621-a354-74c006769956" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.032138] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.032243] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.032384] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.032462] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.032553] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.032639] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f44b2d06-c9ca-4621-a354-74c006769956" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.033057] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-f44b2d06-c9ca-4621-a354-74c006769956 taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.033516] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f44b2d06-c9ca-4621-a354-74c006769956" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.033673] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f44b2d06-c9ca-4621-a354-74c006769956" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.033876] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f44b2d06-c9ca-4621-a354-74c006769956" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.034081] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.034261] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.034324] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.034565] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.034742] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.034876] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f44b2d06-c9ca-4621-a354-74c006769956" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.035015] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f44b2d06-c9ca-4621-a354-74c006769956',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 829.191981] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e2390617-a1da-45a2-94eb-d162a19e2fae',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 829.197090] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f9bdd708-8cea-4b45-818f-2a931611c895',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 829.515285] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.515285] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.515285] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.515285] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.515285] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.515285] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 07d8236a-b9f2-429a-9942-e7cb46920213 is going to be updated. [ 829.538182] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f44b2d06-c9ca-4621-a354-74c006769956: rpc.has_security_group_logging(os_id): False [ 829.544271] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.544271] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.544271] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.544271] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.544271] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.556031] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 07d8236a-b9f2-429a-9942-e7cb46920213 in Status: IN_PROGRESS for 2s [ 829.559052] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.559052] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.559052] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.559052] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.559052] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.559052] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.559052] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.559052] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.559052] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.559887] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.559887] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.559887] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.559887] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.559887] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.559887] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.559887] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.560210] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.560210] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.560210] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.560295] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.560320] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f44b2d06-c9ca-4621-a354-74c006769956 is going to be created. [ 829.626819] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.626819] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.626819] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.626819] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.626819] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.646702] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f44b2d06-c9ca-4621-a354-74c006769956 in Status: IN_PROGRESS for 2s [ 829.698982] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.698982] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.698982] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.698982] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.698982] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.698982] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e2390617-a1da-45a2-94eb-d162a19e2fae is going to be updated. [ 829.699503] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.699772] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.699911] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.700191] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.700360] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.700524] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f9bdd708-8cea-4b45-818f-2a931611c895 is going to be updated. [ 829.738199] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.740023] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.740023] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.740023] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.740023] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.741033] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.741312] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.741504] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.743658] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.743658] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.759731] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f9bdd708-8cea-4b45-818f-2a931611c895 in Status: IN_PROGRESS for 2s [ 829.760607] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e2390617-a1da-45a2-94eb-d162a19e2fae in Status: IN_PROGRESS for 2s [ 830.485618] env[69980]: INFO networking_nsxv3.common.synchronization [req-97d4118b-018f-4fd4-ac24-f2637630c282 req-6e203e58-1fbf-41dd-b531-7523f27b44b4 tempest-ServerRescueTestJSONUnderV235-1182894004 tempest-ServerRescueTestJSONUnderV235-1182894004-project-member] Enqueued Resource ID: 6a65879b-1ebc-46e7-bcb8-1b5f0a00660c with Priority: HIGHEST for action security_group_members [ 830.486661] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6a65879b-1ebc-46e7-bcb8-1b5f0a00660c with Priority: HIGHEST for action security_group_members [ 830.486661] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-6a65879b-1ebc-46e7-bcb8-1b5f0a00660c taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.486817] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6a65879b-1ebc-46e7-bcb8-1b5f0a00660c" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.486817] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6a65879b-1ebc-46e7-bcb8-1b5f0a00660c" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.487049] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6a65879b-1ebc-46e7-bcb8-1b5f0a00660c" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.487941] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.488093] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.488167] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.488323] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.488409] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.488502] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6a65879b-1ebc-46e7-bcb8-1b5f0a00660c',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 830.882803] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock network-123 taken with stack trace [, , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.883241] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "network-123" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.883241] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "network-123" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.883654] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "network-123" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.884019] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.884258] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.884468] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.884812] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.884959] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.886345] env[69980]: DEBUG dogpile.cache.region [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] No value present for key: 'zone-id' {{(pid=69980) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 830.886345] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] NeedRegenerationException {{(pid=69980) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 830.886345] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] no value, waiting for create lock {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 830.886345] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] value creation lock acquired {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 830.886345] env[69980]: DEBUG dogpile.cache.region [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] No value present for key: 'zone-id' {{(pid=69980) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 830.886345] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Calling creation function for not-yet-present value {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 830.886345] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 830.912890] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 830.912890] env[69980]: DEBUG dogpile.cache.region [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Cache value generated in 0.027 seconds for key(s): 'zone-id' {{(pid=69980) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 830.912890] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Released creation lock {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 830.912890] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "network-123" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.913479] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock port-6fe2e3c5-a917-46e9-a779-2344e9877fe3 taken with stack trace [, , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.913740] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "port-6fe2e3c5-a917-46e9-a779-2344e9877fe3" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.914169] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "port-6fe2e3c5-a917-46e9-a779-2344e9877fe3" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.914289] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "port-6fe2e3c5-a917-46e9-a779-2344e9877fe3" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.914523] env[69980]: DEBUG networking_nsxv3.api.rpc [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6fe2e3c5-a917-46e9-a779-2344e9877fe3',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 830.992685] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.992843] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.992931] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.993157] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.993304] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.993594] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.993732] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.993799] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.994023] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.994069] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.994146] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6a65879b-1ebc-46e7-bcb8-1b5f0a00660c already deleted. [ 830.994231] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6a65879b-1ebc-46e7-bcb8-1b5f0a00660c" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.420031] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.420031] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.420031] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.420031] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.420031] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.420031] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Segment Port 6fe2e3c5-a917-46e9-a779-2344e9877fe3 not found, creating... [ 831.420031] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.420031] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.420031] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.420031] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.420031] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.421381] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.421381] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.421381] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.421381] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.421381] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.421381] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Resource: SegmentPort with ID: 6fe2e3c5-a917-46e9-a779-2344e9877fe3 is going to be created. [ 831.441443] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.441637] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.441791] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.442096] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.442335] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.442559] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "port-6fe2e3c5-a917-46e9-a779-2344e9877fe3" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.481357] env[69980]: INFO networking_nsxv3.common.synchronization [req-4421640b-956a-49e4-b2bc-dde8c19a5db3 req-9ab13c0e-bdd0-4cfb-98f3-e3939aff619e tempest-ImagesNegativeTestJSON-872012680 tempest-ImagesNegativeTestJSON-872012680-project-member] Enqueued Resource ID: d696a1d3-1fa9-4790-b673-19d262f97699 with Priority: HIGHEST for action security_group_members [ 831.481638] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d696a1d3-1fa9-4790-b673-19d262f97699 with Priority: HIGHEST for action security_group_members [ 831.485022] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-d696a1d3-1fa9-4790-b673-19d262f97699 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.485022] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d696a1d3-1fa9-4790-b673-19d262f97699" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.485022] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d696a1d3-1fa9-4790-b673-19d262f97699" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.485022] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d696a1d3-1fa9-4790-b673-19d262f97699" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.485022] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.485022] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.485022] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.485022] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.485022] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.485022] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d696a1d3-1fa9-4790-b673-19d262f97699',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 831.564499] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 07d8236a-b9f2-429a-9942-e7cb46920213 in Status: SUCCESS [ 831.564943] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-07d8236a-b9f2-429a-9942-e7cb46920213" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.564943] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-07d8236a-b9f2-429a-9942-e7cb46920213" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.565218] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-07d8236a-b9f2-429a-9942-e7cb46920213" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.565451] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.565592] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.565681] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.565843] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.566232] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.566232] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-07d8236a-b9f2-429a-9942-e7cb46920213" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.566232] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('07d8236a-b9f2-429a-9942-e7cb46920213',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 831.659281] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f44b2d06-c9ca-4621-a354-74c006769956 in Status: SUCCESS [ 831.659580] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f44b2d06-c9ca-4621-a354-74c006769956" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.771178] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f9bdd708-8cea-4b45-818f-2a931611c895 in Status: SUCCESS [ 831.771418] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f9bdd708-8cea-4b45-818f-2a931611c895" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.771589] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f9bdd708-8cea-4b45-818f-2a931611c895" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.771812] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f9bdd708-8cea-4b45-818f-2a931611c895" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.772043] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.772158] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.772224] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.772410] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.772489] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.772591] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f9bdd708-8cea-4b45-818f-2a931611c895" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.772696] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f9bdd708-8cea-4b45-818f-2a931611c895',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 831.774186] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e2390617-a1da-45a2-94eb-d162a19e2fae in Status: SUCCESS [ 831.774407] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e2390617-a1da-45a2-94eb-d162a19e2fae" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.774573] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e2390617-a1da-45a2-94eb-d162a19e2fae" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.774745] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e2390617-a1da-45a2-94eb-d162a19e2fae" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.774913] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.775047] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.775111] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.775269] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.775349] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.775433] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e2390617-a1da-45a2-94eb-d162a19e2fae" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.775689] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-e2390617-a1da-45a2-94eb-d162a19e2fae taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.775689] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e2390617-a1da-45a2-94eb-d162a19e2fae" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.775764] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e2390617-a1da-45a2-94eb-d162a19e2fae" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.775900] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e2390617-a1da-45a2-94eb-d162a19e2fae" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.776057] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.776156] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.776239] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.776390] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.776466] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.776546] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e2390617-a1da-45a2-94eb-d162a19e2fae" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.776645] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e2390617-a1da-45a2-94eb-d162a19e2fae',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 831.986100] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.986481] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.986481] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.986548] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.986651] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.986813] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.986931] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.986983] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.987160] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.987224] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.987326] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d696a1d3-1fa9-4790-b673-19d262f97699 is going to be updated. [ 832.015414] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.015607] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.015683] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.015850] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.016021] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.024844] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d696a1d3-1fa9-4790-b673-19d262f97699 in Status: IN_PROGRESS for 2s [ 832.068201] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-07d8236a-b9f2-429a-9942-e7cb46920213 taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.068519] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-07d8236a-b9f2-429a-9942-e7cb46920213" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.068519] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-07d8236a-b9f2-429a-9942-e7cb46920213" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.068646] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-07d8236a-b9f2-429a-9942-e7cb46920213" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.068845] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.068931] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.068966] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.069127] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.069196] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.069285] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-07d8236a-b9f2-429a-9942-e7cb46920213" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.069432] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-07d8236a-b9f2-429a-9942-e7cb46920213 taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.069531] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-07d8236a-b9f2-429a-9942-e7cb46920213" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.069602] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-07d8236a-b9f2-429a-9942-e7cb46920213" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.069752] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-07d8236a-b9f2-429a-9942-e7cb46920213" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.070112] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.070274] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.070326] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.070474] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.070546] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.070632] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-07d8236a-b9f2-429a-9942-e7cb46920213" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.070724] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('07d8236a-b9f2-429a-9942-e7cb46920213',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 832.281506] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e2390617-a1da-45a2-94eb-d162a19e2fae: rpc.has_security_group_logging(os_id): False [ 832.281506] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f9bdd708-8cea-4b45-818f-2a931611c895',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 832.290152] env[69980]: INFO networking_nsxv3.common.synchronization [req-97d4118b-018f-4fd4-ac24-f2637630c282 req-67ccd3bd-8b8b-4faa-b2c7-1938ecdf858b service nova] Enqueued Resource ID: 6a65879b-1ebc-46e7-bcb8-1b5f0a00660c with Priority: HIGHEST for action security_group_rules [ 832.290152] env[69980]: INFO networking_nsxv3.common.synchronization [req-97d4118b-018f-4fd4-ac24-f2637630c282 req-67ccd3bd-8b8b-4faa-b2c7-1938ecdf858b service nova] Enqueued Resource ID: 6a65879b-1ebc-46e7-bcb8-1b5f0a00660c with Priority: HIGHEST for action security_group_members [ 832.290152] env[69980]: INFO networking_nsxv3.common.synchronization [req-97d4118b-018f-4fd4-ac24-f2637630c282 req-67ccd3bd-8b8b-4faa-b2c7-1938ecdf858b service nova] Enqueued Resource ID: 6fe2e3c5-a917-46e9-a779-2344e9877fe3 with Priority: HIGHEST for action port [ 832.290152] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6a65879b-1ebc-46e7-bcb8-1b5f0a00660c with Priority: HIGHEST for action security_group_rules [ 832.290152] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6a65879b-1ebc-46e7-bcb8-1b5f0a00660c with Priority: HIGHEST for action security_group_members [ 832.290152] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6fe2e3c5-a917-46e9-a779-2344e9877fe3 with Priority: HIGHEST for action port [ 832.290152] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6a65879b-1ebc-46e7-bcb8-1b5f0a00660c taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.290152] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6a65879b-1ebc-46e7-bcb8-1b5f0a00660c" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.290152] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6a65879b-1ebc-46e7-bcb8-1b5f0a00660c" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.290152] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6a65879b-1ebc-46e7-bcb8-1b5f0a00660c" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.290152] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6a65879b-1ebc-46e7-bcb8-1b5f0a00660c',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 832.291590] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-6a65879b-1ebc-46e7-bcb8-1b5f0a00660c taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.291869] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6a65879b-1ebc-46e7-bcb8-1b5f0a00660c" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.292240] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6a65879b-1ebc-46e7-bcb8-1b5f0a00660c" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.293843] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6a65879b-1ebc-46e7-bcb8-1b5f0a00660c" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.294392] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.294823] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.295231] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.295571] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.297188] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.297482] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6a65879b-1ebc-46e7-bcb8-1b5f0a00660c',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 832.299534] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock port-6fe2e3c5-a917-46e9-a779-2344e9877fe3 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.299874] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6fe2e3c5-a917-46e9-a779-2344e9877fe3" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.300055] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6fe2e3c5-a917-46e9-a779-2344e9877fe3" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.300316] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6fe2e3c5-a917-46e9-a779-2344e9877fe3" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.300478] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6fe2e3c5-a917-46e9-a779-2344e9877fe3',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 832.312434] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.312434] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.312434] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.312890] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.312890] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.312954] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.313149] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.313149] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.314083] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.314083] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.314083] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.314083] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.314083] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.314083] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.314083] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.314436] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.314436] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.314436] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.314532] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.314532] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.314600] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e2390617-a1da-45a2-94eb-d162a19e2fae is going to be updated. [ 832.408196] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.408366] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.408439] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.408650] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.408797] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.423926] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e2390617-a1da-45a2-94eb-d162a19e2fae in Status: IN_PROGRESS for 2s [ 832.574996] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 07d8236a-b9f2-429a-9942-e7cb46920213: rpc.has_security_group_logging(os_id): False [ 832.593659] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.593829] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.593889] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.594167] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.594352] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.594627] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.594627] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.594767] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.596352] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.596352] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.596352] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.596352] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.596352] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.596352] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.596352] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.596352] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.596352] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.596352] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.596352] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.596352] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.596831] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 07d8236a-b9f2-429a-9942-e7cb46920213 is going to be updated. [ 832.689903] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.690085] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.690166] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.690400] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.690533] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.709216] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 07d8236a-b9f2-429a-9942-e7cb46920213 in Status: IN_PROGRESS for 2s [ 832.783256] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f9bdd708-8cea-4b45-818f-2a931611c895: rpc.has_security_group_logging(os_id): False [ 832.803163] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6a65879b-1ebc-46e7-bcb8-1b5f0a00660c',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 832.804365] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-6a65879b-1ebc-46e7-bcb8-1b5f0a00660c taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.804491] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6a65879b-1ebc-46e7-bcb8-1b5f0a00660c" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.805975] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.805975] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.805975] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.806255] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.806347] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.806587] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.806708] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.806787] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.806964] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.807240] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.807240] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f9bdd708-8cea-4b45-818f-2a931611c895 is going to be updated. [ 832.808309] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 6fe2e3c5-a917-46e9-a779-2344e9877fe3 with status ACTIVE [ 832.808469] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.808567] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.808630] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.808774] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.808846] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.809011] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.809107] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.809163] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.809555] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.809555] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.809555] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.809715] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.809715] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.809800] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.810053] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.810053] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 6fe2e3c5-a917-46e9-a779-2344e9877fe3 is going to be updated. [ 832.833556] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.833556] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.833755] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.833868] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.834049] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.834196] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6fe2e3c5-a917-46e9-a779-2344e9877fe3" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.875363] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.875709] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.875784] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.877032] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.877032] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.887549] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f9bdd708-8cea-4b45-818f-2a931611c895 in Status: IN_PROGRESS for 2s [ 833.312213] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6a65879b-1ebc-46e7-bcb8-1b5f0a00660c',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 833.820479] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.820479] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.820479] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.820479] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.820479] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.820479] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6a65879b-1ebc-46e7-bcb8-1b5f0a00660c is going to be created. [ 833.845991] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.846101] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.846160] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.846406] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.846617] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.857092] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6a65879b-1ebc-46e7-bcb8-1b5f0a00660c in Status: UNINITIALIZED for 2s [ 834.034208] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d696a1d3-1fa9-4790-b673-19d262f97699 in Status: SUCCESS [ 834.034444] env[69980]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d696a1d3-1fa9-4790-b673-19d262f97699 deletion is rescheduled due to dependency. [ 834.034573] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d696a1d3-1fa9-4790-b673-19d262f97699" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.437404] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e2390617-a1da-45a2-94eb-d162a19e2fae in Status: SUCCESS [ 834.437780] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e2390617-a1da-45a2-94eb-d162a19e2fae" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.437973] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e2390617-a1da-45a2-94eb-d162a19e2fae" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.438317] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e2390617-a1da-45a2-94eb-d162a19e2fae" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.438658] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e2390617-a1da-45a2-94eb-d162a19e2fae',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 834.723375] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 07d8236a-b9f2-429a-9942-e7cb46920213 in Status: SUCCESS [ 834.723513] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-07d8236a-b9f2-429a-9942-e7cb46920213" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.899720] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f9bdd708-8cea-4b45-818f-2a931611c895 in Status: SUCCESS [ 834.899967] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f9bdd708-8cea-4b45-818f-2a931611c895" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.942698] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-e2390617-a1da-45a2-94eb-d162a19e2fae taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.942874] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e2390617-a1da-45a2-94eb-d162a19e2fae" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.942997] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e2390617-a1da-45a2-94eb-d162a19e2fae" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.943174] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e2390617-a1da-45a2-94eb-d162a19e2fae" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.943410] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.943566] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.943566] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.943756] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.943843] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.943919] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e2390617-a1da-45a2-94eb-d162a19e2fae" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.944035] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e2390617-a1da-45a2-94eb-d162a19e2fae',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 835.448471] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-e2390617-a1da-45a2-94eb-d162a19e2fae taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.448845] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e2390617-a1da-45a2-94eb-d162a19e2fae" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.448845] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e2390617-a1da-45a2-94eb-d162a19e2fae" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.449031] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e2390617-a1da-45a2-94eb-d162a19e2fae" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.450373] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.450373] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.450373] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.450544] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.450544] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.450621] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e2390617-a1da-45a2-94eb-d162a19e2fae" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.450827] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-e2390617-a1da-45a2-94eb-d162a19e2fae taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.450926] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e2390617-a1da-45a2-94eb-d162a19e2fae" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.450986] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e2390617-a1da-45a2-94eb-d162a19e2fae" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.451221] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e2390617-a1da-45a2-94eb-d162a19e2fae" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.451373] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.451694] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.451694] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.451694] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.451832] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.451832] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e2390617-a1da-45a2-94eb-d162a19e2fae" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.451903] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e2390617-a1da-45a2-94eb-d162a19e2fae',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 835.502485] env[69980]: INFO networking_nsxv3.common.synchronization [req-2228264b-6320-433d-a32e-c0b02fbd46be req-47384662-c82b-44fd-9cbe-f14ae7ec4c72 tempest-ListServerFiltersTestJSON-1624918227 tempest-ListServerFiltersTestJSON-1624918227-project-member] Enqueued Resource ID: 1340506f-247e-457d-b5d5-d9db4d9c0250 with Priority: HIGHEST for action security_group_members [ 835.503580] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1340506f-247e-457d-b5d5-d9db4d9c0250 with Priority: HIGHEST for action security_group_members [ 835.504468] env[69980]: INFO networking_nsxv3.common.synchronization [None req-151f4552-4eda-4500-81ca-57a438960e75 None None] Enqueued Resource ID: be30e097-0bca-4a7c-82f0-517629fc9c3c with Priority: HIGHEST for action port [ 835.505639] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-1340506f-247e-457d-b5d5-d9db4d9c0250 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.505872] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1340506f-247e-457d-b5d5-d9db4d9c0250" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.506024] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1340506f-247e-457d-b5d5-d9db4d9c0250" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.506324] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1340506f-247e-457d-b5d5-d9db4d9c0250" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.506567] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.506773] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.506921] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.507726] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.507938] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.508134] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1340506f-247e-457d-b5d5-d9db4d9c0250',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 835.510903] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: be30e097-0bca-4a7c-82f0-517629fc9c3c with Priority: HIGHEST for action port [ 835.511739] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock port-be30e097-0bca-4a7c-82f0-517629fc9c3c taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.511856] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-be30e097-0bca-4a7c-82f0-517629fc9c3c" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.511921] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-be30e097-0bca-4a7c-82f0-517629fc9c3c" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.512187] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-be30e097-0bca-4a7c-82f0-517629fc9c3c" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.512273] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('be30e097-0bca-4a7c-82f0-517629fc9c3c',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 835.868319] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6a65879b-1ebc-46e7-bcb8-1b5f0a00660c in Status: SUCCESS [ 835.868451] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6a65879b-1ebc-46e7-bcb8-1b5f0a00660c" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.868637] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6a65879b-1ebc-46e7-bcb8-1b5f0a00660c" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.868864] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6a65879b-1ebc-46e7-bcb8-1b5f0a00660c" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.869059] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.869180] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.870214] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.870214] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.870214] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.870214] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6a65879b-1ebc-46e7-bcb8-1b5f0a00660c" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.870214] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6a65879b-1ebc-46e7-bcb8-1b5f0a00660c',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 835.957164] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e2390617-a1da-45a2-94eb-d162a19e2fae: rpc.has_security_group_logging(os_id): False [ 835.973571] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.973719] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.973792] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.974013] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.974107] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.974332] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.974444] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.974508] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.975463] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.975463] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.975463] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.975463] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.975463] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.975463] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.975463] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.975463] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.975790] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.975790] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.975790] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.975790] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.975885] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e2390617-a1da-45a2-94eb-d162a19e2fae is going to be updated. [ 836.012691] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1340506f-247e-457d-b5d5-d9db4d9c0250',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 836.018172] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port be30e097-0bca-4a7c-82f0-517629fc9c3c [ 836.018172] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.018172] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.018172] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.018172] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.018172] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.018172] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:be30e097-0bca-4a7c-82f0-517629fc9c3c already deleted. [ 836.018172] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-be30e097-0bca-4a7c-82f0-517629fc9c3c" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.035163] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.035319] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.035386] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.035596] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.035740] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.048937] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e2390617-a1da-45a2-94eb-d162a19e2fae in Status: IN_PROGRESS for 2s [ 836.372162] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-6a65879b-1ebc-46e7-bcb8-1b5f0a00660c taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.372329] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6a65879b-1ebc-46e7-bcb8-1b5f0a00660c" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.374461] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6a65879b-1ebc-46e7-bcb8-1b5f0a00660c" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.374461] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6a65879b-1ebc-46e7-bcb8-1b5f0a00660c" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.374461] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.374461] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.374461] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.374461] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.374461] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.374461] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6a65879b-1ebc-46e7-bcb8-1b5f0a00660c" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.374461] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-6a65879b-1ebc-46e7-bcb8-1b5f0a00660c taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.374461] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6a65879b-1ebc-46e7-bcb8-1b5f0a00660c" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.374461] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6a65879b-1ebc-46e7-bcb8-1b5f0a00660c" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.374461] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6a65879b-1ebc-46e7-bcb8-1b5f0a00660c" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.374461] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.374461] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.374461] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.374461] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.374461] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.374461] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6a65879b-1ebc-46e7-bcb8-1b5f0a00660c" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.375229] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6a65879b-1ebc-46e7-bcb8-1b5f0a00660c',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 836.514737] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1340506f-247e-457d-b5d5-d9db4d9c0250',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 836.881146] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6a65879b-1ebc-46e7-bcb8-1b5f0a00660c: rpc.has_security_group_logging(os_id): False [ 836.898665] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.898822] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.898865] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.899137] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.899234] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.899458] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.899584] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.899649] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.899808] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.899887] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.900078] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.900175] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.900232] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.900370] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.900444] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.900618] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.900708] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.900766] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.900899] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.900971] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.902205] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6a65879b-1ebc-46e7-bcb8-1b5f0a00660c is going to be created. [ 836.956290] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.957237] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.957316] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.957533] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.958725] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.970667] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6a65879b-1ebc-46e7-bcb8-1b5f0a00660c in Status: IN_PROGRESS for 2s [ 837.016998] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.017265] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.017265] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.017492] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.017538] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.017640] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1340506f-247e-457d-b5d5-d9db4d9c0250 is going to be updated. [ 837.048379] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.048469] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.048585] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.048789] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.048935] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.063030] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1340506f-247e-457d-b5d5-d9db4d9c0250 in Status: IN_PROGRESS for 2s [ 837.632852] env[69980]: INFO networking_nsxv3.common.synchronization [req-e79bee57-eba7-4a2e-b6e8-2a34a3f02493 req-1011a2cd-ad74-4713-8d0f-e634a9cf3532 tempest-FloatingIPsAssociationNegativeTestJSON-2133390623 tempest-FloatingIPsAssociationNegativeTestJSON-2133390623-project-member] Enqueued Resource ID: 162065c3-9db0-41c8-9437-c51716e30968 with Priority: HIGHEST for action security_group_members [ 837.634318] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 162065c3-9db0-41c8-9437-c51716e30968 with Priority: HIGHEST for action security_group_members [ 837.634318] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-162065c3-9db0-41c8-9437-c51716e30968 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.634931] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-162065c3-9db0-41c8-9437-c51716e30968" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.635035] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-162065c3-9db0-41c8-9437-c51716e30968" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.635266] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-162065c3-9db0-41c8-9437-c51716e30968" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.635464] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.635555] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.635636] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.635805] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.635887] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.635989] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('162065c3-9db0-41c8-9437-c51716e30968',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 838.057456] env[69980]: INFO networking_nsxv3.common.synchronization [None req-aa7b0e78-c13b-4e06-8826-63cedc60dc31 None None] Enqueued Resource ID: 0ea2f118-467e-4b42-9772-e7c20ad9de2a with Priority: HIGHEST for action port [ 838.057456] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0ea2f118-467e-4b42-9772-e7c20ad9de2a with Priority: HIGHEST for action port [ 838.057456] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock port-0ea2f118-467e-4b42-9772-e7c20ad9de2a taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.057456] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0ea2f118-467e-4b42-9772-e7c20ad9de2a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.057456] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0ea2f118-467e-4b42-9772-e7c20ad9de2a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.057456] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0ea2f118-467e-4b42-9772-e7c20ad9de2a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.057456] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0ea2f118-467e-4b42-9772-e7c20ad9de2a',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 838.063524] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e2390617-a1da-45a2-94eb-d162a19e2fae in Status: SUCCESS [ 838.063524] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e2390617-a1da-45a2-94eb-d162a19e2fae" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.119839] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock network-447 taken with stack trace [, , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.119839] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "network-447" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.119839] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "network-447" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.119839] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "network-447" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.119839] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.119839] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.119839] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.120437] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.120729] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.121092] env[69980]: DEBUG dogpile.cache.region [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] No value present for key: 'zone-id' {{(pid=69980) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 838.121346] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] NeedRegenerationException {{(pid=69980) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 838.121554] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] no value, waiting for create lock {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 838.121762] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] value creation lock acquired {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 838.121979] env[69980]: DEBUG dogpile.cache.region [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] No value present for key: 'zone-id' {{(pid=69980) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 838.122210] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Calling creation function for not-yet-present value {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 838.124070] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 838.139261] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.139261] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.139261] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.139261] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.139261] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.139261] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.139261] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.139261] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.139261] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.139261] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.139261] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 162065c3-9db0-41c8-9437-c51716e30968 already deleted. [ 838.139261] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-162065c3-9db0-41c8-9437-c51716e30968" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.142240] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 838.143025] env[69980]: DEBUG dogpile.cache.region [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=69980) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 838.145019] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Released creation lock {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 838.145019] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "network-447" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.145019] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock port-e19812ef-a0c9-4450-8bf7-4822a680a839 taken with stack trace [, , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.145019] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "port-e19812ef-a0c9-4450-8bf7-4822a680a839" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.145019] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "port-e19812ef-a0c9-4450-8bf7-4822a680a839" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.145019] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "port-e19812ef-a0c9-4450-8bf7-4822a680a839" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.145019] env[69980]: DEBUG networking_nsxv3.api.rpc [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e19812ef-a0c9-4450-8bf7-4822a680a839',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 838.559836] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 0ea2f118-467e-4b42-9772-e7c20ad9de2a [ 838.560100] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.560240] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.560309] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.560548] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.560643] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.560749] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:0ea2f118-467e-4b42-9772-e7c20ad9de2a already deleted. [ 838.560834] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0ea2f118-467e-4b42-9772-e7c20ad9de2a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.651572] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.658389] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.658389] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.658389] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.658389] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.658389] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Segment Port e19812ef-a0c9-4450-8bf7-4822a680a839 not found, creating... [ 838.658389] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.658389] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.658389] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.658389] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.658389] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.659017] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.662349] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.662494] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.662833] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.662964] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.663132] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Resource: SegmentPort with ID: e19812ef-a0c9-4450-8bf7-4822a680a839 is going to be created. [ 838.685383] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.685711] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.685856] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.686130] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.686355] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.686748] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "port-e19812ef-a0c9-4450-8bf7-4822a680a839" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.982762] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6a65879b-1ebc-46e7-bcb8-1b5f0a00660c in Status: SUCCESS [ 838.983015] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6a65879b-1ebc-46e7-bcb8-1b5f0a00660c" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.071619] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1340506f-247e-457d-b5d5-d9db4d9c0250 in Status: SUCCESS [ 839.071832] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1340506f-247e-457d-b5d5-d9db4d9c0250" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.489430] env[69980]: INFO networking_nsxv3.common.synchronization [req-e79bee57-eba7-4a2e-b6e8-2a34a3f02493 req-f5b133e9-fda8-468c-b7f9-8868ae98755c service nova] Enqueued Resource ID: 162065c3-9db0-41c8-9437-c51716e30968 with Priority: HIGHEST for action security_group_rules [ 839.489654] env[69980]: INFO networking_nsxv3.common.synchronization [req-e79bee57-eba7-4a2e-b6e8-2a34a3f02493 req-f5b133e9-fda8-468c-b7f9-8868ae98755c service nova] Enqueued Resource ID: 162065c3-9db0-41c8-9437-c51716e30968 with Priority: HIGHEST for action security_group_members [ 839.489760] env[69980]: INFO networking_nsxv3.common.synchronization [req-e79bee57-eba7-4a2e-b6e8-2a34a3f02493 req-f5b133e9-fda8-468c-b7f9-8868ae98755c service nova] Enqueued Resource ID: e19812ef-a0c9-4450-8bf7-4822a680a839 with Priority: HIGHEST for action port [ 839.490484] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 162065c3-9db0-41c8-9437-c51716e30968 with Priority: HIGHEST for action security_group_rules [ 839.490546] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 162065c3-9db0-41c8-9437-c51716e30968 with Priority: HIGHEST for action security_group_members [ 839.490616] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e19812ef-a0c9-4450-8bf7-4822a680a839 with Priority: HIGHEST for action port [ 839.490910] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock rules-162065c3-9db0-41c8-9437-c51716e30968 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.491010] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-162065c3-9db0-41c8-9437-c51716e30968" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.491102] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-162065c3-9db0-41c8-9437-c51716e30968" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.491356] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-162065c3-9db0-41c8-9437-c51716e30968" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.491433] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('162065c3-9db0-41c8-9437-c51716e30968',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 839.492780] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-162065c3-9db0-41c8-9437-c51716e30968 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.492894] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-162065c3-9db0-41c8-9437-c51716e30968" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.492961] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-162065c3-9db0-41c8-9437-c51716e30968" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.493144] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-162065c3-9db0-41c8-9437-c51716e30968" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.493322] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.493513] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.493513] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.493646] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.493706] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.493796] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('162065c3-9db0-41c8-9437-c51716e30968',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 839.495141] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock port-e19812ef-a0c9-4450-8bf7-4822a680a839 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.495141] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e19812ef-a0c9-4450-8bf7-4822a680a839" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.495141] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e19812ef-a0c9-4450-8bf7-4822a680a839" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.495141] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e19812ef-a0c9-4450-8bf7-4822a680a839" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.495141] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e19812ef-a0c9-4450-8bf7-4822a680a839',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 839.883368] env[69980]: INFO networking_nsxv3.common.synchronization [req-b6fb08ff-8adb-4343-8b79-631b58db3f00 req-094483c3-3e4e-465c-8611-4be828eedf04 tempest-ImagesOneServerNegativeTestJSON-332667785 tempest-ImagesOneServerNegativeTestJSON-332667785-project-member] Enqueued Resource ID: d53aff15-d6ed-495c-9f29-fdc03bd13622 with Priority: HIGHEST for action security_group_members [ 839.884717] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d53aff15-d6ed-495c-9f29-fdc03bd13622 with Priority: HIGHEST for action security_group_members [ 839.884717] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-d53aff15-d6ed-495c-9f29-fdc03bd13622 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.884717] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d53aff15-d6ed-495c-9f29-fdc03bd13622" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.884717] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d53aff15-d6ed-495c-9f29-fdc03bd13622" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.884717] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d53aff15-d6ed-495c-9f29-fdc03bd13622" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.884950] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.885170] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.885170] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.885230] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.885281] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.885378] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d53aff15-d6ed-495c-9f29-fdc03bd13622',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 839.998747] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-162065c3-9db0-41c8-9437-c51716e30968 taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.998891] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-162065c3-9db0-41c8-9437-c51716e30968" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.999301] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('162065c3-9db0-41c8-9437-c51716e30968',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 840.000200] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e19812ef-a0c9-4450-8bf7-4822a680a839 with status ACTIVE [ 840.000387] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.000502] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.000568] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.000768] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.000865] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.001110] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.001262] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.001525] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.001672] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.001767] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.001965] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.002084] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.002248] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.002296] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.002393] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.002479] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e19812ef-a0c9-4450-8bf7-4822a680a839 is going to be updated. [ 840.018882] env[69980]: INFO networking_nsxv3.common.synchronization [req-0e7c7484-4765-4c27-accf-9d8e19b12d0b req-dc895176-04a8-4605-9b4f-eca94d87034f tempest-DeleteServersAdminTestJSON-1963276659 tempest-DeleteServersAdminTestJSON-1963276659-project-member] Enqueued Resource ID: 07d8236a-b9f2-429a-9942-e7cb46920213 with Priority: HIGHEST for action security_group_members [ 840.019303] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 07d8236a-b9f2-429a-9942-e7cb46920213 with Priority: HIGHEST for action security_group_members [ 840.019603] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-07d8236a-b9f2-429a-9942-e7cb46920213 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.019719] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-07d8236a-b9f2-429a-9942-e7cb46920213" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.019782] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-07d8236a-b9f2-429a-9942-e7cb46920213" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.019972] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-07d8236a-b9f2-429a-9942-e7cb46920213" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.020280] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.020403] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.020471] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.020634] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.020710] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.020800] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('07d8236a-b9f2-429a-9942-e7cb46920213',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 840.022314] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.022414] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.022480] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.022634] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.022752] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.022890] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e19812ef-a0c9-4450-8bf7-4822a680a839" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.387645] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.387808] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.387881] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.388136] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.388234] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.388430] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.388534] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.388634] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.388741] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.388816] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.388901] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d53aff15-d6ed-495c-9f29-fdc03bd13622 is going to be updated. [ 840.414022] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.414022] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.414022] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.414022] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.414022] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.427542] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d53aff15-d6ed-495c-9f29-fdc03bd13622 in Status: IN_PROGRESS for 2s [ 840.505182] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('162065c3-9db0-41c8-9437-c51716e30968',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 840.524122] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.524327] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.524327] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.524864] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.524864] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.524864] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.525101] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.525101] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.525234] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.525313] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.525406] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 07d8236a-b9f2-429a-9942-e7cb46920213 is going to be updated. [ 840.552264] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.552394] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.552463] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.552784] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.552906] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.565166] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 07d8236a-b9f2-429a-9942-e7cb46920213 in Status: IN_PROGRESS for 2s [ 841.011101] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.011101] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.011101] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.011101] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.011101] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.011101] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 162065c3-9db0-41c8-9437-c51716e30968 is going to be created. [ 841.034187] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.034187] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.034187] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.034187] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.034187] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.042481] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 162065c3-9db0-41c8-9437-c51716e30968 in Status: UNINITIALIZED for 2s [ 842.437403] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d53aff15-d6ed-495c-9f29-fdc03bd13622 in Status: SUCCESS [ 842.437738] env[69980]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d53aff15-d6ed-495c-9f29-fdc03bd13622 deletion is rescheduled due to dependency. [ 842.437738] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d53aff15-d6ed-495c-9f29-fdc03bd13622" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.573914] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 07d8236a-b9f2-429a-9942-e7cb46920213 in Status: SUCCESS [ 842.574329] env[69980]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 07d8236a-b9f2-429a-9942-e7cb46920213 deletion is rescheduled due to dependency. [ 842.574329] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-07d8236a-b9f2-429a-9942-e7cb46920213" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.052540] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 162065c3-9db0-41c8-9437-c51716e30968 in Status: SUCCESS [ 843.052933] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-162065c3-9db0-41c8-9437-c51716e30968" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.053219] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-162065c3-9db0-41c8-9437-c51716e30968" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.053556] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-162065c3-9db0-41c8-9437-c51716e30968" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.053837] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.054089] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.054235] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.054598] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.054770] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.055148] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-162065c3-9db0-41c8-9437-c51716e30968" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.059020] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('162065c3-9db0-41c8-9437-c51716e30968',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 843.458407] env[69980]: INFO networking_nsxv3.common.synchronization [None req-1bc0cc96-02c8-4649-a2dd-79371814e41a tempest-MigrationsAdminTest-1290478568 tempest-MigrationsAdminTest-1290478568-project-member] Enqueued Resource ID: 21d36f2a-f277-4558-885f-653710bc29fe with Priority: HIGHEST for action security_group_rules [ 843.458948] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 21d36f2a-f277-4558-885f-653710bc29fe with Priority: HIGHEST for action security_group_rules [ 843.459573] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock rules-21d36f2a-f277-4558-885f-653710bc29fe taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.459802] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-21d36f2a-f277-4558-885f-653710bc29fe" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.460045] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-21d36f2a-f277-4558-885f-653710bc29fe" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.460591] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-21d36f2a-f277-4558-885f-653710bc29fe" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.460731] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('21d36f2a-f277-4558-885f-653710bc29fe',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 843.557374] env[69980]: INFO networking_nsxv3.common.synchronization [None req-0e1d0bda-0c70-4973-9c48-2bbc45848622 tempest-MigrationsAdminTest-1290478568 tempest-MigrationsAdminTest-1290478568-project-member] Enqueued Resource ID: 21d36f2a-f277-4558-885f-653710bc29fe with Priority: HIGHEST for action security_group_rules [ 843.559370] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 21d36f2a-f277-4558-885f-653710bc29fe with Priority: HIGHEST for action security_group_rules [ 843.559837] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock rules-21d36f2a-f277-4558-885f-653710bc29fe taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.560175] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-21d36f2a-f277-4558-885f-653710bc29fe" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.560973] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-162065c3-9db0-41c8-9437-c51716e30968 taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.561557] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-162065c3-9db0-41c8-9437-c51716e30968" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.561730] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-162065c3-9db0-41c8-9437-c51716e30968" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.562100] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-162065c3-9db0-41c8-9437-c51716e30968" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.562526] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.562749] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.562895] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.563156] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.563360] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.563548] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-162065c3-9db0-41c8-9437-c51716e30968" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.563777] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-162065c3-9db0-41c8-9437-c51716e30968 taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.563989] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-162065c3-9db0-41c8-9437-c51716e30968" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.565233] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-162065c3-9db0-41c8-9437-c51716e30968" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.565233] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-162065c3-9db0-41c8-9437-c51716e30968" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.565233] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.565233] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.565233] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.565233] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.565233] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.565233] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-162065c3-9db0-41c8-9437-c51716e30968" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.565233] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('162065c3-9db0-41c8-9437-c51716e30968',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 843.685847] env[69980]: INFO networking_nsxv3.common.synchronization [None req-373fdb2a-3507-4f35-97ed-26a22835fadc None None] Enqueued Resource ID: b0ef7d79-1015-4251-8025-fac5e1a60689 with Priority: HIGHEST for action port [ 843.685847] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b0ef7d79-1015-4251-8025-fac5e1a60689 with Priority: HIGHEST for action port [ 843.686355] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock port-b0ef7d79-1015-4251-8025-fac5e1a60689 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.687592] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b0ef7d79-1015-4251-8025-fac5e1a60689" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.687913] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b0ef7d79-1015-4251-8025-fac5e1a60689" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.688304] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b0ef7d79-1015-4251-8025-fac5e1a60689" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.688509] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b0ef7d79-1015-4251-8025-fac5e1a60689',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 843.982018] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.982018] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.982018] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.982018] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.982018] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.982018] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 21d36f2a-f277-4558-885f-653710bc29fe already deleted. [ 843.982018] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-21d36f2a-f277-4558-885f-653710bc29fe" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.982018] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-21d36f2a-f277-4558-885f-653710bc29fe" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.982018] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-21d36f2a-f277-4558-885f-653710bc29fe" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.982018] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('21d36f2a-f277-4558-885f-653710bc29fe',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 844.067684] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 162065c3-9db0-41c8-9437-c51716e30968: rpc.has_security_group_logging(os_id): False [ 844.084907] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.085086] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.085218] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.085354] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.085472] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.085616] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.085725] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.085777] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.085898] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.085970] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.086173] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.086262] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.086321] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.086568] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.086638] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.086816] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.086904] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.086955] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.087098] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.087163] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.087244] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 162065c3-9db0-41c8-9437-c51716e30968 is going to be created. [ 844.142324] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.142720] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.142720] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.142804] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.142987] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.153976] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 162065c3-9db0-41c8-9437-c51716e30968 in Status: IN_PROGRESS for 2s [ 844.191016] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b0ef7d79-1015-4251-8025-fac5e1a60689 [ 844.192222] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.192467] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.192734] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.193035] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.193197] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.193425] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b0ef7d79-1015-4251-8025-fac5e1a60689 already deleted. [ 844.193834] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b0ef7d79-1015-4251-8025-fac5e1a60689" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.508255] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.508591] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.508591] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.508818] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.508924] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.509102] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 21d36f2a-f277-4558-885f-653710bc29fe already deleted. [ 844.509193] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-21d36f2a-f277-4558-885f-653710bc29fe" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.520672] env[69980]: INFO networking_nsxv3.common.synchronization [req-397baa54-16ce-4c62-bba4-cf13cd98a661 req-9080d829-9399-49b4-a44c-1cc05ca65101 tempest-SecurityGroupRulesTestJSON-561069711 tempest-SecurityGroupRulesTestJSON-561069711-project-member] Enqueued Resource ID: f1463636-13a9-489b-99c4-414e9903d333 with Priority: HIGHEST for action security_group_rules [ 844.520672] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f1463636-13a9-489b-99c4-414e9903d333 with Priority: HIGHEST for action security_group_rules [ 844.520672] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f1463636-13a9-489b-99c4-414e9903d333 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.520672] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f1463636-13a9-489b-99c4-414e9903d333" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.520871] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f1463636-13a9-489b-99c4-414e9903d333" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.521405] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f1463636-13a9-489b-99c4-414e9903d333" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.521405] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f1463636-13a9-489b-99c4-414e9903d333',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 845.030070] env[69980]: INFO networking_nsxv3.common.synchronization [req-6a0a805c-1614-4f81-a66c-cdff01cf57df req-3810bcb7-01a2-474d-b158-c9cd23f55f98 tempest-SecurityGroupRulesTestJSON-561069711 tempest-SecurityGroupRulesTestJSON-561069711-project-member] Enqueued Resource ID: 52773d1d-04c3-4b66-9fe8-dbc823260448 with Priority: HIGHEST for action security_group_rules [ 845.034020] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 52773d1d-04c3-4b66-9fe8-dbc823260448 with Priority: HIGHEST for action security_group_rules [ 845.034020] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock rules-52773d1d-04c3-4b66-9fe8-dbc823260448 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.034020] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-52773d1d-04c3-4b66-9fe8-dbc823260448" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.034020] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-52773d1d-04c3-4b66-9fe8-dbc823260448" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.034020] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-52773d1d-04c3-4b66-9fe8-dbc823260448" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.034020] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('52773d1d-04c3-4b66-9fe8-dbc823260448',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 845.042770] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.042770] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.042931] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.043013] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.043112] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.043193] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f1463636-13a9-489b-99c4-414e9903d333 already deleted. [ 845.043274] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f1463636-13a9-489b-99c4-414e9903d333" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.499678] env[69980]: INFO networking_nsxv3.common.synchronization [req-7ad60b41-1893-49d9-bf71-f4cc7ddbc218 req-c9b560a2-66e2-4ad5-a455-0a04e20c13c4 tempest-ImagesTestJSON-600722714 tempest-ImagesTestJSON-600722714-project-member] Enqueued Resource ID: 80e3ea48-91a5-4863-b1c2-f3e887204e39 with Priority: HIGHEST for action security_group_members [ 845.502742] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 80e3ea48-91a5-4863-b1c2-f3e887204e39 with Priority: HIGHEST for action security_group_members [ 845.503310] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-80e3ea48-91a5-4863-b1c2-f3e887204e39 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.503462] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-80e3ea48-91a5-4863-b1c2-f3e887204e39" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.503535] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-80e3ea48-91a5-4863-b1c2-f3e887204e39" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.503753] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-80e3ea48-91a5-4863-b1c2-f3e887204e39" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.503919] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.504032] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.504097] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.504396] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.504396] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.504486] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('80e3ea48-91a5-4863-b1c2-f3e887204e39',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 845.556375] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.556826] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.556826] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.556826] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.556826] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.556996] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 52773d1d-04c3-4b66-9fe8-dbc823260448 already deleted. [ 845.556996] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-52773d1d-04c3-4b66-9fe8-dbc823260448" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.937186] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock network-136 taken with stack trace [, , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.937578] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "network-136" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.937578] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "network-136" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.937768] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "network-136" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.938040] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.938177] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.938287] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.938749] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.938749] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.938895] env[69980]: DEBUG dogpile.cache.region [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] No value present for key: 'zone-id' {{(pid=69980) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 845.938998] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] NeedRegenerationException {{(pid=69980) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 845.940859] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] no value, waiting for create lock {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 845.940988] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] value creation lock acquired {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 845.941121] env[69980]: DEBUG dogpile.cache.region [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] No value present for key: 'zone-id' {{(pid=69980) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 845.941233] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Calling creation function for not-yet-present value {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 845.941396] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 845.960295] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 845.960457] env[69980]: DEBUG dogpile.cache.region [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=69980) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 845.961270] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Released creation lock {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 845.961270] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "network-136" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.961270] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock port-d9a893ee-9b8b-431a-8134-3b46e1f54c78 taken with stack trace [, , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.961270] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "port-d9a893ee-9b8b-431a-8134-3b46e1f54c78" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.961475] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "port-d9a893ee-9b8b-431a-8134-3b46e1f54c78" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.961654] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "port-d9a893ee-9b8b-431a-8134-3b46e1f54c78" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.961791] env[69980]: DEBUG networking_nsxv3.api.rpc [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d9a893ee-9b8b-431a-8134-3b46e1f54c78',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 846.006199] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.006422] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.006525] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.006810] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.006941] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.007240] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.007376] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.007453] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.007655] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.007751] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.007859] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 80e3ea48-91a5-4863-b1c2-f3e887204e39 is going to be updated. [ 846.017810] env[69980]: INFO networking_nsxv3.common.synchronization [None req-d3826f2e-e576-4ad0-ae36-29e3e1eebf42 None None] Enqueued Resource ID: 4ed3b2a7-dc20-45db-b7aa-7bcc0dd1cd74 with Priority: HIGHEST for action port [ 846.017810] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4ed3b2a7-dc20-45db-b7aa-7bcc0dd1cd74 with Priority: HIGHEST for action port [ 846.018312] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock port-4ed3b2a7-dc20-45db-b7aa-7bcc0dd1cd74 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.018312] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4ed3b2a7-dc20-45db-b7aa-7bcc0dd1cd74" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.018312] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4ed3b2a7-dc20-45db-b7aa-7bcc0dd1cd74" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.018489] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4ed3b2a7-dc20-45db-b7aa-7bcc0dd1cd74" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.018489] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4ed3b2a7-dc20-45db-b7aa-7bcc0dd1cd74',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 846.031228] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.031392] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.031463] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.031663] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.031814] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.040916] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 80e3ea48-91a5-4863-b1c2-f3e887204e39 in Status: IN_PROGRESS for 2s [ 846.088212] env[69980]: INFO networking_nsxv3.common.synchronization [req-c5777647-4fb9-4b35-8fd1-a4fd4a36ff2e req-4ce326bf-d4ad-46e2-9d7d-94989df53a19 tempest-SecurityGroupRulesTestJSON-561069711 tempest-SecurityGroupRulesTestJSON-561069711-project-member] Enqueued Resource ID: 726b91e5-1439-4706-a1ce-5980ffc52cb2 with Priority: HIGHEST for action security_group_rules [ 846.088700] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 726b91e5-1439-4706-a1ce-5980ffc52cb2 with Priority: HIGHEST for action security_group_rules [ 846.088931] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock rules-726b91e5-1439-4706-a1ce-5980ffc52cb2 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.089068] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-726b91e5-1439-4706-a1ce-5980ffc52cb2" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.089289] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-726b91e5-1439-4706-a1ce-5980ffc52cb2" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.089580] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-726b91e5-1439-4706-a1ce-5980ffc52cb2" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.089678] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('726b91e5-1439-4706-a1ce-5980ffc52cb2',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 846.165838] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 162065c3-9db0-41c8-9437-c51716e30968 in Status: SUCCESS [ 846.166173] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-162065c3-9db0-41c8-9437-c51716e30968" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.464370] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.464616] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.464742] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.465027] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.465179] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.465333] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Segment Port d9a893ee-9b8b-431a-8134-3b46e1f54c78 not found, creating... [ 846.465588] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.465742] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.465857] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.466085] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.466224] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.466502] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.466656] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.466770] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.466970] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.467143] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.467281] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Resource: SegmentPort with ID: d9a893ee-9b8b-431a-8134-3b46e1f54c78 is going to be created. [ 846.485873] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.486086] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.486211] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.486856] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.487106] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.487401] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "port-d9a893ee-9b8b-431a-8134-3b46e1f54c78" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.524524] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 4ed3b2a7-dc20-45db-b7aa-7bcc0dd1cd74 [ 846.524812] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.524957] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.525038] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.525250] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.525341] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.525436] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:4ed3b2a7-dc20-45db-b7aa-7bcc0dd1cd74 already deleted. [ 846.525518] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4ed3b2a7-dc20-45db-b7aa-7bcc0dd1cd74" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.560509] env[69980]: INFO networking_nsxv3.common.synchronization [req-49e546ce-9c87-477a-8ec3-cf6aff51fb90 req-4ee49db1-5684-4818-87a5-6399929fd94e tempest-SecurityGroupRulesTestJSON-561069711 tempest-SecurityGroupRulesTestJSON-561069711-project-member] Enqueued Resource ID: bf6da9f7-a6da-4023-ba41-61f906791d79 with Priority: HIGHEST for action security_group_rules [ 846.561066] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bf6da9f7-a6da-4023-ba41-61f906791d79 with Priority: HIGHEST for action security_group_rules [ 846.561406] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock rules-bf6da9f7-a6da-4023-ba41-61f906791d79 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.561630] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-bf6da9f7-a6da-4023-ba41-61f906791d79" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.561630] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-bf6da9f7-a6da-4023-ba41-61f906791d79" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.562976] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-bf6da9f7-a6da-4023-ba41-61f906791d79" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.562976] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('bf6da9f7-a6da-4023-ba41-61f906791d79',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 846.627959] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.628133] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.628218] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.628434] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.628527] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.628633] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 726b91e5-1439-4706-a1ce-5980ffc52cb2 already deleted. [ 846.628717] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-726b91e5-1439-4706-a1ce-5980ffc52cb2" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.081793] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.081939] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.082025] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.082253] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.082369] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.082437] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bf6da9f7-a6da-4023-ba41-61f906791d79 already deleted. [ 847.082526] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-bf6da9f7-a6da-4023-ba41-61f906791d79" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.152453] env[69980]: INFO networking_nsxv3.common.synchronization [req-e68fa3d1-eef0-4e0f-98ec-d1d2c1c80778 req-b7e73a13-a16d-4395-a872-76b12811a5c8 tempest-SecurityGroupRulesTestJSON-561069711 tempest-SecurityGroupRulesTestJSON-561069711-project-member] Enqueued Resource ID: 5bfc86b7-30c3-4895-9677-374a186417c5 with Priority: HIGHEST for action security_group_rules [ 847.153242] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5bfc86b7-30c3-4895-9677-374a186417c5 with Priority: HIGHEST for action security_group_rules [ 847.153586] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5bfc86b7-30c3-4895-9677-374a186417c5 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.153734] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5bfc86b7-30c3-4895-9677-374a186417c5" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.153823] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5bfc86b7-30c3-4895-9677-374a186417c5" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.154112] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5bfc86b7-30c3-4895-9677-374a186417c5" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.154200] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5bfc86b7-30c3-4895-9677-374a186417c5',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 847.226411] env[69980]: INFO networking_nsxv3.common.synchronization [req-7ad60b41-1893-49d9-bf71-f4cc7ddbc218 req-ed22c1d4-bd31-48e9-8890-3fc4c97d8e99 service nova] Enqueued Resource ID: 80e3ea48-91a5-4863-b1c2-f3e887204e39 with Priority: HIGHEST for action security_group_rules [ 847.226522] env[69980]: INFO networking_nsxv3.common.synchronization [req-7ad60b41-1893-49d9-bf71-f4cc7ddbc218 req-ed22c1d4-bd31-48e9-8890-3fc4c97d8e99 service nova] Enqueued Resource ID: 80e3ea48-91a5-4863-b1c2-f3e887204e39 with Priority: HIGHEST for action security_group_members [ 847.226650] env[69980]: INFO networking_nsxv3.common.synchronization [req-7ad60b41-1893-49d9-bf71-f4cc7ddbc218 req-ed22c1d4-bd31-48e9-8890-3fc4c97d8e99 service nova] Enqueued Resource ID: d9a893ee-9b8b-431a-8134-3b46e1f54c78 with Priority: HIGHEST for action port [ 847.226933] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 80e3ea48-91a5-4863-b1c2-f3e887204e39 with Priority: HIGHEST for action security_group_rules [ 847.227070] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 80e3ea48-91a5-4863-b1c2-f3e887204e39 with Priority: HIGHEST for action security_group_members [ 847.228717] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d9a893ee-9b8b-431a-8134-3b46e1f54c78 with Priority: HIGHEST for action port [ 847.228717] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock rules-80e3ea48-91a5-4863-b1c2-f3e887204e39 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.228717] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-80e3ea48-91a5-4863-b1c2-f3e887204e39" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.228717] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-80e3ea48-91a5-4863-b1c2-f3e887204e39" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.228717] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-80e3ea48-91a5-4863-b1c2-f3e887204e39" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.228717] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('80e3ea48-91a5-4863-b1c2-f3e887204e39',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 847.229436] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-80e3ea48-91a5-4863-b1c2-f3e887204e39 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.229543] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-80e3ea48-91a5-4863-b1c2-f3e887204e39" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.229755] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock port-d9a893ee-9b8b-431a-8134-3b46e1f54c78 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.229812] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d9a893ee-9b8b-431a-8134-3b46e1f54c78" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.229870] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d9a893ee-9b8b-431a-8134-3b46e1f54c78" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.230062] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d9a893ee-9b8b-431a-8134-3b46e1f54c78" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.230132] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d9a893ee-9b8b-431a-8134-3b46e1f54c78',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 847.534558] env[69980]: INFO networking_nsxv3.common.synchronization [req-56b77ef5-d016-45e5-b56f-6d09f08ec560 req-b7672203-a07b-4b0f-a694-5561c959fe09 tempest-SecurityGroupRulesTestJSON-561069711 tempest-SecurityGroupRulesTestJSON-561069711-project-member] Enqueued Resource ID: 5bfc86b7-30c3-4895-9677-374a186417c5 with Priority: HIGHEST for action security_group_rules [ 847.535123] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5bfc86b7-30c3-4895-9677-374a186417c5 with Priority: HIGHEST for action security_group_rules [ 847.535453] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5bfc86b7-30c3-4895-9677-374a186417c5 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.535600] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5bfc86b7-30c3-4895-9677-374a186417c5" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.678613] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.678932] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.678932] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.679070] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.679171] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.679280] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5bfc86b7-30c3-4895-9677-374a186417c5 already deleted. [ 847.679383] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5bfc86b7-30c3-4895-9677-374a186417c5" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.679546] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5bfc86b7-30c3-4895-9677-374a186417c5" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.679711] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5bfc86b7-30c3-4895-9677-374a186417c5" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.679885] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5bfc86b7-30c3-4895-9677-374a186417c5',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 847.731690] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-80e3ea48-91a5-4863-b1c2-f3e887204e39 taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.731818] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-80e3ea48-91a5-4863-b1c2-f3e887204e39" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.732060] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d9a893ee-9b8b-431a-8134-3b46e1f54c78 with status ACTIVE [ 847.732189] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.732286] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.732436] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.732550] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.734456] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.734456] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.734456] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.734456] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.734456] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.734456] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.734456] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.734456] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.734456] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.734456] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.734456] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.734456] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d9a893ee-9b8b-431a-8134-3b46e1f54c78 is going to be updated. [ 847.763047] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.763203] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.763273] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.763520] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.763654] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.763816] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d9a893ee-9b8b-431a-8134-3b46e1f54c78" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.958876] env[69980]: INFO networking_nsxv3.common.synchronization [req-567af799-51ff-4c8f-bcd8-6e99276a526f req-61aa65e7-fcb7-4387-8e7f-5bf93b167edd tempest-ServersAdminTestJSON-1581544378 tempest-ServersAdminTestJSON-1581544378-project-member] Enqueued Resource ID: 700dc02a-f3c2-4363-9a0e-d7cdcb13a5b8 with Priority: HIGHEST for action security_group_members [ 847.959437] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 700dc02a-f3c2-4363-9a0e-d7cdcb13a5b8 with Priority: HIGHEST for action security_group_members [ 847.959749] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-700dc02a-f3c2-4363-9a0e-d7cdcb13a5b8 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.959872] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-700dc02a-f3c2-4363-9a0e-d7cdcb13a5b8" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.959938] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-700dc02a-f3c2-4363-9a0e-d7cdcb13a5b8" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.963577] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-700dc02a-f3c2-4363-9a0e-d7cdcb13a5b8" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.963577] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.963731] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.963768] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.963945] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.964043] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.964140] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('700dc02a-f3c2-4363-9a0e-d7cdcb13a5b8',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 847.998887] env[69980]: INFO networking_nsxv3.common.synchronization [req-b3dca753-877d-4998-a7a5-114c873e569c req-2f8a64c8-8374-4cb2-8a92-284006e19d94 tempest-SecurityGroupRulesTestJSON-561069711 tempest-SecurityGroupRulesTestJSON-561069711-project-member] Enqueued Resource ID: 5bfc86b7-30c3-4895-9677-374a186417c5 with Priority: HIGHEST for action security_group_rules [ 847.999588] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5bfc86b7-30c3-4895-9677-374a186417c5 with Priority: HIGHEST for action security_group_rules [ 847.999958] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5bfc86b7-30c3-4895-9677-374a186417c5 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.000087] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5bfc86b7-30c3-4895-9677-374a186417c5" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.052974] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 80e3ea48-91a5-4863-b1c2-f3e887204e39 in Status: SUCCESS [ 848.053238] env[69980]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 80e3ea48-91a5-4863-b1c2-f3e887204e39 deletion is rescheduled due to dependency. [ 848.053487] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-80e3ea48-91a5-4863-b1c2-f3e887204e39" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.053699] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-80e3ea48-91a5-4863-b1c2-f3e887204e39" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.053972] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-80e3ea48-91a5-4863-b1c2-f3e887204e39" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.054675] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.054849] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.054910] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.055134] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.055331] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.055541] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('80e3ea48-91a5-4863-b1c2-f3e887204e39',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 848.210358] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.210539] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.210616] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.210828] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.210912] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.211011] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5bfc86b7-30c3-4895-9677-374a186417c5 already deleted. [ 848.211092] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5bfc86b7-30c3-4895-9677-374a186417c5" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.211235] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5bfc86b7-30c3-4895-9677-374a186417c5" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.211450] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5bfc86b7-30c3-4895-9677-374a186417c5" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.212527] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5bfc86b7-30c3-4895-9677-374a186417c5',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 848.420944] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock network-504 taken with stack trace [, , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.420944] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "network-504" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.420944] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "network-504" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.420944] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "network-504" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.420944] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.420944] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.420944] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.420944] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.421947] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.421947] env[69980]: DEBUG dogpile.cache.region [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] No value present for key: 'zone-id' {{(pid=69980) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 848.421947] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] NeedRegenerationException {{(pid=69980) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 848.421947] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] no value, waiting for create lock {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 848.422229] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] value creation lock acquired {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 848.422229] env[69980]: DEBUG dogpile.cache.region [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] No value present for key: 'zone-id' {{(pid=69980) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 848.422229] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Calling creation function for not-yet-present value {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 848.422403] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 848.439926] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 848.440118] env[69980]: DEBUG dogpile.cache.region [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=69980) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 848.440257] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Released creation lock {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 848.440430] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "network-504" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.440735] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock port-be70cd8d-e482-400f-9516-22be357c6e4f taken with stack trace [, , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.440903] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "port-be70cd8d-e482-400f-9516-22be357c6e4f" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.441030] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "port-be70cd8d-e482-400f-9516-22be357c6e4f" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.441363] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "port-be70cd8d-e482-400f-9516-22be357c6e4f" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.441523] env[69980]: DEBUG networking_nsxv3.api.rpc [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('be70cd8d-e482-400f-9516-22be357c6e4f',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 848.466862] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.467019] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.467100] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.467298] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.467391] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.467580] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.467677] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.467737] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.467882] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.467979] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.468045] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 700dc02a-f3c2-4363-9a0e-d7cdcb13a5b8 already deleted. [ 848.468123] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-700dc02a-f3c2-4363-9a0e-d7cdcb13a5b8" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.559809] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('80e3ea48-91a5-4863-b1c2-f3e887204e39',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 848.740529] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.740821] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.740821] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.740939] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.741038] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.741135] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5bfc86b7-30c3-4895-9677-374a186417c5 already deleted. [ 848.741256] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5bfc86b7-30c3-4895-9677-374a186417c5" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.943580] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.943747] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.943747] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.944039] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.944194] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.944346] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Segment Port be70cd8d-e482-400f-9516-22be357c6e4f not found, creating... [ 848.944633] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.944796] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.944910] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.945147] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.945286] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.945570] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.945733] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.945841] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.946056] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.946193] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.946328] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Resource: SegmentPort with ID: be70cd8d-e482-400f-9516-22be357c6e4f is going to be created. [ 848.966734] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.966939] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.967127] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.967412] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.968030] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.968030] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "port-be70cd8d-e482-400f-9516-22be357c6e4f" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.063996] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('80e3ea48-91a5-4863-b1c2-f3e887204e39',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 849.571378] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.571378] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.571378] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.571378] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.571378] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.571378] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 80e3ea48-91a5-4863-b1c2-f3e887204e39 is going to be updated. [ 849.600020] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.600020] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.600020] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.600020] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.600020] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.606915] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 80e3ea48-91a5-4863-b1c2-f3e887204e39 in Status: IN_PROGRESS for 2s [ 849.901490] env[69980]: INFO networking_nsxv3.common.synchronization [req-567af799-51ff-4c8f-bcd8-6e99276a526f req-079b059d-95bd-4d90-94f6-9aa9425bdfe8 service nova] Enqueued Resource ID: 700dc02a-f3c2-4363-9a0e-d7cdcb13a5b8 with Priority: HIGHEST for action security_group_rules [ 849.901743] env[69980]: INFO networking_nsxv3.common.synchronization [req-567af799-51ff-4c8f-bcd8-6e99276a526f req-079b059d-95bd-4d90-94f6-9aa9425bdfe8 service nova] Enqueued Resource ID: 700dc02a-f3c2-4363-9a0e-d7cdcb13a5b8 with Priority: HIGHEST for action security_group_members [ 849.901794] env[69980]: INFO networking_nsxv3.common.synchronization [req-567af799-51ff-4c8f-bcd8-6e99276a526f req-079b059d-95bd-4d90-94f6-9aa9425bdfe8 service nova] Enqueued Resource ID: be70cd8d-e482-400f-9516-22be357c6e4f with Priority: HIGHEST for action port [ 849.902291] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 700dc02a-f3c2-4363-9a0e-d7cdcb13a5b8 with Priority: HIGHEST for action security_group_rules [ 849.902291] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 700dc02a-f3c2-4363-9a0e-d7cdcb13a5b8 with Priority: HIGHEST for action security_group_members [ 849.902291] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: be70cd8d-e482-400f-9516-22be357c6e4f with Priority: HIGHEST for action port [ 849.902760] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock rules-700dc02a-f3c2-4363-9a0e-d7cdcb13a5b8 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.902926] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-700dc02a-f3c2-4363-9a0e-d7cdcb13a5b8" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.903017] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-700dc02a-f3c2-4363-9a0e-d7cdcb13a5b8" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.903806] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-700dc02a-f3c2-4363-9a0e-d7cdcb13a5b8" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.903953] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('700dc02a-f3c2-4363-9a0e-d7cdcb13a5b8',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 849.905246] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-700dc02a-f3c2-4363-9a0e-d7cdcb13a5b8 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.905453] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-700dc02a-f3c2-4363-9a0e-d7cdcb13a5b8" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.905557] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-700dc02a-f3c2-4363-9a0e-d7cdcb13a5b8" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.905755] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-700dc02a-f3c2-4363-9a0e-d7cdcb13a5b8" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.905943] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.908015] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.908015] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.908015] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.908015] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.908015] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('700dc02a-f3c2-4363-9a0e-d7cdcb13a5b8',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 849.908015] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock port-be70cd8d-e482-400f-9516-22be357c6e4f taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.908015] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-be70cd8d-e482-400f-9516-22be357c6e4f" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.908015] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-be70cd8d-e482-400f-9516-22be357c6e4f" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.908015] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-be70cd8d-e482-400f-9516-22be357c6e4f" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.908015] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('be70cd8d-e482-400f-9516-22be357c6e4f',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 850.412959] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-700dc02a-f3c2-4363-9a0e-d7cdcb13a5b8 taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.412959] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-700dc02a-f3c2-4363-9a0e-d7cdcb13a5b8" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.412959] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('700dc02a-f3c2-4363-9a0e-d7cdcb13a5b8',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 850.412959] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port be70cd8d-e482-400f-9516-22be357c6e4f with status ACTIVE [ 850.412959] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.412959] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.412959] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.412959] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.412959] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.412959] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.412959] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.412959] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.412959] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.413581] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.413581] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.413581] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.413581] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.413581] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.413753] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.413753] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: be70cd8d-e482-400f-9516-22be357c6e4f is going to be updated. [ 850.435700] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.435903] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.435986] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.436266] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.436440] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.436636] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-be70cd8d-e482-400f-9516-22be357c6e4f" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.916171] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('700dc02a-f3c2-4363-9a0e-d7cdcb13a5b8',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 851.420198] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.420198] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.420198] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.420198] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.420198] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.420198] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 700dc02a-f3c2-4363-9a0e-d7cdcb13a5b8 is going to be created. [ 851.444561] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.444735] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.444821] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.445021] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.447093] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.457353] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 700dc02a-f3c2-4363-9a0e-d7cdcb13a5b8 in Status: UNINITIALIZED for 2s [ 851.621300] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 80e3ea48-91a5-4863-b1c2-f3e887204e39 in Status: SUCCESS [ 851.621831] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-80e3ea48-91a5-4863-b1c2-f3e887204e39" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.621831] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-80e3ea48-91a5-4863-b1c2-f3e887204e39" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.621951] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-80e3ea48-91a5-4863-b1c2-f3e887204e39" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.622152] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.622269] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.622334] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.622493] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.622576] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.622660] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-80e3ea48-91a5-4863-b1c2-f3e887204e39" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.622751] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('80e3ea48-91a5-4863-b1c2-f3e887204e39',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 852.127091] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-80e3ea48-91a5-4863-b1c2-f3e887204e39 taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.127485] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-80e3ea48-91a5-4863-b1c2-f3e887204e39" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.127485] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-80e3ea48-91a5-4863-b1c2-f3e887204e39" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.127485] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-80e3ea48-91a5-4863-b1c2-f3e887204e39" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.127907] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.127907] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.127907] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.128512] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.128602] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.128804] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-80e3ea48-91a5-4863-b1c2-f3e887204e39" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.128875] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-80e3ea48-91a5-4863-b1c2-f3e887204e39 taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.129367] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-80e3ea48-91a5-4863-b1c2-f3e887204e39" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.129367] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-80e3ea48-91a5-4863-b1c2-f3e887204e39" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.129367] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-80e3ea48-91a5-4863-b1c2-f3e887204e39" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.129367] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.129367] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.129621] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.129621] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.129693] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.129817] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-80e3ea48-91a5-4863-b1c2-f3e887204e39" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.129882] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('80e3ea48-91a5-4863-b1c2-f3e887204e39',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 852.501048] env[69980]: INFO networking_nsxv3.common.synchronization [req-75d1092c-c037-454e-8f7d-284b179fb548 req-5322e7fb-a16e-400d-9cc0-0a612a5b9255 tempest-ServerRescueTestJSONUnderV235-1182894004 tempest-ServerRescueTestJSONUnderV235-1182894004-project-member] Enqueued Resource ID: 6a65879b-1ebc-46e7-bcb8-1b5f0a00660c with Priority: HIGHEST for action security_group_members [ 852.501308] env[69980]: INFO networking_nsxv3.common.synchronization [req-75d1092c-c037-454e-8f7d-284b179fb548 req-5322e7fb-a16e-400d-9cc0-0a612a5b9255 tempest-ServerRescueTestJSONUnderV235-1182894004 tempest-ServerRescueTestJSONUnderV235-1182894004-project-member] Enqueued Resource ID: cada291a-300d-4b36-ad20-911bc4440550 with Priority: HIGHEST for action security_group_members [ 852.501794] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6a65879b-1ebc-46e7-bcb8-1b5f0a00660c with Priority: HIGHEST for action security_group_members [ 852.501935] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cada291a-300d-4b36-ad20-911bc4440550 with Priority: HIGHEST for action security_group_members [ 852.502230] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-6a65879b-1ebc-46e7-bcb8-1b5f0a00660c taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.503496] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6a65879b-1ebc-46e7-bcb8-1b5f0a00660c" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.503604] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6a65879b-1ebc-46e7-bcb8-1b5f0a00660c" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.503782] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6a65879b-1ebc-46e7-bcb8-1b5f0a00660c" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.504266] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.504393] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.504438] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.504608] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.504704] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.504803] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6a65879b-1ebc-46e7-bcb8-1b5f0a00660c',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 852.505633] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-cada291a-300d-4b36-ad20-911bc4440550 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.505781] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cada291a-300d-4b36-ad20-911bc4440550" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.505810] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cada291a-300d-4b36-ad20-911bc4440550" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.505991] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cada291a-300d-4b36-ad20-911bc4440550" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.506146] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.506240] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.506303] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.506439] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.506521] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.506606] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cada291a-300d-4b36-ad20-911bc4440550',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 852.573273] env[69980]: INFO networking_nsxv3.common.synchronization [req-75d1092c-c037-454e-8f7d-284b179fb548 req-5322e7fb-a16e-400d-9cc0-0a612a5b9255 tempest-ServerRescueTestJSONUnderV235-1182894004 tempest-ServerRescueTestJSONUnderV235-1182894004-project-member] Enqueued Resource ID: 6a65879b-1ebc-46e7-bcb8-1b5f0a00660c with Priority: HIGHEST for action security_group_rules [ 852.573499] env[69980]: INFO networking_nsxv3.common.synchronization [req-75d1092c-c037-454e-8f7d-284b179fb548 req-5322e7fb-a16e-400d-9cc0-0a612a5b9255 tempest-ServerRescueTestJSONUnderV235-1182894004 tempest-ServerRescueTestJSONUnderV235-1182894004-project-member] Enqueued Resource ID: 6a65879b-1ebc-46e7-bcb8-1b5f0a00660c with Priority: HIGHEST for action security_group_members [ 852.573651] env[69980]: INFO networking_nsxv3.common.synchronization [req-75d1092c-c037-454e-8f7d-284b179fb548 req-5322e7fb-a16e-400d-9cc0-0a612a5b9255 tempest-ServerRescueTestJSONUnderV235-1182894004 tempest-ServerRescueTestJSONUnderV235-1182894004-project-member] Enqueued Resource ID: cada291a-300d-4b36-ad20-911bc4440550 with Priority: HIGHEST for action security_group_rules [ 852.573783] env[69980]: INFO networking_nsxv3.common.synchronization [req-75d1092c-c037-454e-8f7d-284b179fb548 req-5322e7fb-a16e-400d-9cc0-0a612a5b9255 tempest-ServerRescueTestJSONUnderV235-1182894004 tempest-ServerRescueTestJSONUnderV235-1182894004-project-member] Enqueued Resource ID: cada291a-300d-4b36-ad20-911bc4440550 with Priority: HIGHEST for action security_group_members [ 852.573908] env[69980]: INFO networking_nsxv3.common.synchronization [req-75d1092c-c037-454e-8f7d-284b179fb548 req-5322e7fb-a16e-400d-9cc0-0a612a5b9255 tempest-ServerRescueTestJSONUnderV235-1182894004 tempest-ServerRescueTestJSONUnderV235-1182894004-project-member] Enqueued Resource ID: 6fe2e3c5-a917-46e9-a779-2344e9877fe3 with Priority: HIGHEST for action port [ 852.575610] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6a65879b-1ebc-46e7-bcb8-1b5f0a00660c with Priority: HIGHEST for action security_group_rules [ 852.575716] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cada291a-300d-4b36-ad20-911bc4440550 with Priority: HIGHEST for action security_group_rules [ 852.575818] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6fe2e3c5-a917-46e9-a779-2344e9877fe3 with Priority: HIGHEST for action port [ 852.575912] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6a65879b-1ebc-46e7-bcb8-1b5f0a00660c with Priority: HIGHEST for action security_group_members [ 852.576008] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cada291a-300d-4b36-ad20-911bc4440550 with Priority: HIGHEST for action security_group_members [ 852.576286] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6a65879b-1ebc-46e7-bcb8-1b5f0a00660c taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.576409] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6a65879b-1ebc-46e7-bcb8-1b5f0a00660c" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.576625] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6a65879b-1ebc-46e7-bcb8-1b5f0a00660c" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.576889] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6a65879b-1ebc-46e7-bcb8-1b5f0a00660c" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.576988] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6a65879b-1ebc-46e7-bcb8-1b5f0a00660c',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 852.578133] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cada291a-300d-4b36-ad20-911bc4440550 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.578345] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cada291a-300d-4b36-ad20-911bc4440550" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.578345] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cada291a-300d-4b36-ad20-911bc4440550" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.578656] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cada291a-300d-4b36-ad20-911bc4440550" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.578741] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cada291a-300d-4b36-ad20-911bc4440550',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 852.579729] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock port-6fe2e3c5-a917-46e9-a779-2344e9877fe3 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.579729] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6fe2e3c5-a917-46e9-a779-2344e9877fe3" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.579729] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6fe2e3c5-a917-46e9-a779-2344e9877fe3" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.579902] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6fe2e3c5-a917-46e9-a779-2344e9877fe3" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.579984] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6fe2e3c5-a917-46e9-a779-2344e9877fe3',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 852.583750] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-6a65879b-1ebc-46e7-bcb8-1b5f0a00660c taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.583750] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6a65879b-1ebc-46e7-bcb8-1b5f0a00660c" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.583750] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-cada291a-300d-4b36-ad20-911bc4440550 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.583750] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cada291a-300d-4b36-ad20-911bc4440550" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.635889] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 80e3ea48-91a5-4863-b1c2-f3e887204e39: rpc.has_security_group_logging(os_id): False [ 852.654415] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.654589] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.654888] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.654888] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.655067] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.655151] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.655246] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.655308] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.655448] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.655525] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.655713] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.655832] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.655896] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.656054] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.656122] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.656331] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.656390] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.656451] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.656598] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.656660] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.656743] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 80e3ea48-91a5-4863-b1c2-f3e887204e39 is going to be updated. [ 852.725472] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.725655] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.725758] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.726039] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.726352] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.739221] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 80e3ea48-91a5-4863-b1c2-f3e887204e39 in Status: IN_PROGRESS for 2s [ 853.011302] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6a65879b-1ebc-46e7-bcb8-1b5f0a00660c',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 853.011988] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('cada291a-300d-4b36-ad20-911bc4440550',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 853.084647] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-cada291a-300d-4b36-ad20-911bc4440550 taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.085277] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cada291a-300d-4b36-ad20-911bc4440550" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.085277] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 6fe2e3c5-a917-46e9-a779-2344e9877fe3 with status ACTIVE [ 853.085277] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.085277] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.085434] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.085862] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.085862] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.085862] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.086050] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.086050] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.086167] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.086772] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.086772] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.086772] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.086772] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.086772] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.086772] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.086985] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 6fe2e3c5-a917-46e9-a779-2344e9877fe3 is going to be updated. [ 853.089787] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-6a65879b-1ebc-46e7-bcb8-1b5f0a00660c taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.089787] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6a65879b-1ebc-46e7-bcb8-1b5f0a00660c" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.111253] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.111626] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.111794] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.112072] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.112264] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.112488] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6fe2e3c5-a917-46e9-a779-2344e9877fe3" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.467954] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 700dc02a-f3c2-4363-9a0e-d7cdcb13a5b8 in Status: SUCCESS [ 853.468779] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-700dc02a-f3c2-4363-9a0e-d7cdcb13a5b8" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.468877] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-700dc02a-f3c2-4363-9a0e-d7cdcb13a5b8" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.469386] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-700dc02a-f3c2-4363-9a0e-d7cdcb13a5b8" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.469714] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.469809] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.469961] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.470079] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.470141] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.470231] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-700dc02a-f3c2-4363-9a0e-d7cdcb13a5b8" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.470325] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('700dc02a-f3c2-4363-9a0e-d7cdcb13a5b8',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 853.515503] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6a65879b-1ebc-46e7-bcb8-1b5f0a00660c',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 853.520022] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('cada291a-300d-4b36-ad20-911bc4440550',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 853.755677] env[69980]: INFO networking_nsxv3.common.synchronization [req-70164ac8-4004-454e-bbf0-9177b51451cb req-2d0ff600-e146-41bb-bdf3-c913f91bf685 tempest-ServerRescueTestJSONUnderV235-1182894004 tempest-ServerRescueTestJSONUnderV235-1182894004-project-member] Enqueued Resource ID: 6a65879b-1ebc-46e7-bcb8-1b5f0a00660c with Priority: HIGHEST for action security_group_members [ 853.755849] env[69980]: INFO networking_nsxv3.common.synchronization [req-70164ac8-4004-454e-bbf0-9177b51451cb req-2d0ff600-e146-41bb-bdf3-c913f91bf685 tempest-ServerRescueTestJSONUnderV235-1182894004 tempest-ServerRescueTestJSONUnderV235-1182894004-project-member] Enqueued Resource ID: cada291a-300d-4b36-ad20-911bc4440550 with Priority: HIGHEST for action security_group_members [ 853.756439] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6a65879b-1ebc-46e7-bcb8-1b5f0a00660c with Priority: HIGHEST for action security_group_members [ 853.756533] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cada291a-300d-4b36-ad20-911bc4440550 with Priority: HIGHEST for action security_group_members [ 853.756768] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-6a65879b-1ebc-46e7-bcb8-1b5f0a00660c taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.756874] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6a65879b-1ebc-46e7-bcb8-1b5f0a00660c" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.758973] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-cada291a-300d-4b36-ad20-911bc4440550 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.759112] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cada291a-300d-4b36-ad20-911bc4440550" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.903197] env[69980]: INFO networking_nsxv3.common.synchronization [req-70164ac8-4004-454e-bbf0-9177b51451cb req-2d0ff600-e146-41bb-bdf3-c913f91bf685 tempest-ServerRescueTestJSONUnderV235-1182894004 tempest-ServerRescueTestJSONUnderV235-1182894004-project-member] Enqueued Resource ID: 6a65879b-1ebc-46e7-bcb8-1b5f0a00660c with Priority: HIGHEST for action security_group_rules [ 853.903591] env[69980]: INFO networking_nsxv3.common.synchronization [req-70164ac8-4004-454e-bbf0-9177b51451cb req-2d0ff600-e146-41bb-bdf3-c913f91bf685 tempest-ServerRescueTestJSONUnderV235-1182894004 tempest-ServerRescueTestJSONUnderV235-1182894004-project-member] Enqueued Resource ID: 6a65879b-1ebc-46e7-bcb8-1b5f0a00660c with Priority: HIGHEST for action security_group_members [ 853.903699] env[69980]: INFO networking_nsxv3.common.synchronization [req-70164ac8-4004-454e-bbf0-9177b51451cb req-2d0ff600-e146-41bb-bdf3-c913f91bf685 tempest-ServerRescueTestJSONUnderV235-1182894004 tempest-ServerRescueTestJSONUnderV235-1182894004-project-member] Enqueued Resource ID: 6fe2e3c5-a917-46e9-a779-2344e9877fe3 with Priority: HIGHEST for action port [ 853.904314] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6a65879b-1ebc-46e7-bcb8-1b5f0a00660c with Priority: HIGHEST for action security_group_rules [ 853.904454] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6a65879b-1ebc-46e7-bcb8-1b5f0a00660c with Priority: HIGHEST for action security_group_members [ 853.904606] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6fe2e3c5-a917-46e9-a779-2344e9877fe3 with Priority: HIGHEST for action port [ 853.904809] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6a65879b-1ebc-46e7-bcb8-1b5f0a00660c taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.904940] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6a65879b-1ebc-46e7-bcb8-1b5f0a00660c" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.905171] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-6a65879b-1ebc-46e7-bcb8-1b5f0a00660c taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.905282] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6a65879b-1ebc-46e7-bcb8-1b5f0a00660c" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.905536] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock port-6fe2e3c5-a917-46e9-a779-2344e9877fe3 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.905840] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6fe2e3c5-a917-46e9-a779-2344e9877fe3" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.905840] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6fe2e3c5-a917-46e9-a779-2344e9877fe3" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.906020] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6fe2e3c5-a917-46e9-a779-2344e9877fe3" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.906020] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6fe2e3c5-a917-46e9-a779-2344e9877fe3',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 853.973208] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-700dc02a-f3c2-4363-9a0e-d7cdcb13a5b8 taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.973392] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-700dc02a-f3c2-4363-9a0e-d7cdcb13a5b8" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.973510] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-700dc02a-f3c2-4363-9a0e-d7cdcb13a5b8" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.973649] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-700dc02a-f3c2-4363-9a0e-d7cdcb13a5b8" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.973819] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.973928] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.973981] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.974241] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.974400] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.974661] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-700dc02a-f3c2-4363-9a0e-d7cdcb13a5b8" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.974751] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-700dc02a-f3c2-4363-9a0e-d7cdcb13a5b8 taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.974837] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-700dc02a-f3c2-4363-9a0e-d7cdcb13a5b8" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.974837] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-700dc02a-f3c2-4363-9a0e-d7cdcb13a5b8" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.974970] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-700dc02a-f3c2-4363-9a0e-d7cdcb13a5b8" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.975133] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.975274] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.975332] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.975974] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.975974] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.975974] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-700dc02a-f3c2-4363-9a0e-d7cdcb13a5b8" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.975974] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('700dc02a-f3c2-4363-9a0e-d7cdcb13a5b8',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 854.017721] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.017882] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.017956] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.018197] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.018296] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.018402] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6a65879b-1ebc-46e7-bcb8-1b5f0a00660c is going to be updated. [ 854.020159] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.020349] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.020421] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.020740] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.020831] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.020925] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cada291a-300d-4b36-ad20-911bc4440550 is going to be created. [ 854.048854] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.048944] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.049027] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.049251] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.049459] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.054636] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.054773] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.054839] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.055038] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.055172] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.066327] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6a65879b-1ebc-46e7-bcb8-1b5f0a00660c in Status: IN_PROGRESS for 2s [ 854.067017] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cada291a-300d-4b36-ad20-911bc4440550 in Status: UNINITIALIZED for 2s [ 854.408126] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 6fe2e3c5-a917-46e9-a779-2344e9877fe3 with status ACTIVE [ 854.408373] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.408510] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.408586] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.408818] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.408948] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.409155] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.409263] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.409326] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.409485] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.409570] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.409750] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.409840] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.409926] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.410048] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.410113] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.410333] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 6fe2e3c5-a917-46e9-a779-2344e9877fe3 is going to be updated. [ 854.431494] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.431839] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.431984] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.432308] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.432546] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.432828] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6fe2e3c5-a917-46e9-a779-2344e9877fe3" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.478248] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 700dc02a-f3c2-4363-9a0e-d7cdcb13a5b8: rpc.has_security_group_logging(os_id): False [ 854.501761] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.502256] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.504018] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.504018] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.504018] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.504018] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.504018] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.504018] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.504018] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.504018] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.504018] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.504018] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.504018] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.508421] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.508421] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.508421] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.508421] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.508421] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.508421] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.508421] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.508421] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 700dc02a-f3c2-4363-9a0e-d7cdcb13a5b8 is going to be created. [ 854.580449] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.580640] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.580686] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.580871] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.581065] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.604826] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 700dc02a-f3c2-4363-9a0e-d7cdcb13a5b8 in Status: IN_PROGRESS for 2s [ 854.764174] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 80e3ea48-91a5-4863-b1c2-f3e887204e39 in Status: SUCCESS [ 854.764401] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-80e3ea48-91a5-4863-b1c2-f3e887204e39" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.999655] env[69980]: INFO networking_nsxv3.common.synchronization [None req-2957ee59-b0bb-4ada-9633-8e1e3559723b None None] Enqueued Resource ID: 7b25251c-795f-45cb-9a94-f06517904754 with Priority: HIGHEST for action port [ 855.002742] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7b25251c-795f-45cb-9a94-f06517904754 with Priority: HIGHEST for action port [ 855.004373] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock port-7b25251c-795f-45cb-9a94-f06517904754 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.006279] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7b25251c-795f-45cb-9a94-f06517904754" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.006380] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7b25251c-795f-45cb-9a94-f06517904754" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.006668] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7b25251c-795f-45cb-9a94-f06517904754" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.006762] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7b25251c-795f-45cb-9a94-f06517904754',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 855.292031] env[69980]: INFO networking_nsxv3.common.synchronization [None req-11ac778e-c6bd-4742-a965-0857af4a8546 None None] Enqueued Resource ID: 087a3a34-6b11-45bd-9140-08744453b36e with Priority: HIGHEST for action port [ 855.293445] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 087a3a34-6b11-45bd-9140-08744453b36e with Priority: HIGHEST for action port [ 855.293445] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock port-087a3a34-6b11-45bd-9140-08744453b36e taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.293719] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-087a3a34-6b11-45bd-9140-08744453b36e" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.293719] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-087a3a34-6b11-45bd-9140-08744453b36e" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.295182] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-087a3a34-6b11-45bd-9140-08744453b36e" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.295182] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('087a3a34-6b11-45bd-9140-08744453b36e',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 855.509620] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 7b25251c-795f-45cb-9a94-f06517904754 [ 855.509905] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.509978] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.510104] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.510295] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.510384] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.510546] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:7b25251c-795f-45cb-9a94-f06517904754 already deleted. [ 855.510546] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7b25251c-795f-45cb-9a94-f06517904754" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.796961] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 087a3a34-6b11-45bd-9140-08744453b36e [ 855.797298] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.798408] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.798408] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.798408] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.798408] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.798408] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:087a3a34-6b11-45bd-9140-08744453b36e already deleted. [ 855.798920] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-087a3a34-6b11-45bd-9140-08744453b36e" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.089063] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6a65879b-1ebc-46e7-bcb8-1b5f0a00660c in Status: SUCCESS [ 856.089063] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6a65879b-1ebc-46e7-bcb8-1b5f0a00660c" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.089063] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cada291a-300d-4b36-ad20-911bc4440550 in Status: SUCCESS [ 856.089063] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cada291a-300d-4b36-ad20-911bc4440550" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.089063] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6a65879b-1ebc-46e7-bcb8-1b5f0a00660c" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.089063] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6a65879b-1ebc-46e7-bcb8-1b5f0a00660c" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.089701] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.090022] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.090189] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.090455] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.090652] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.090849] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6a65879b-1ebc-46e7-bcb8-1b5f0a00660c',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 856.091794] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cada291a-300d-4b36-ad20-911bc4440550" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.092150] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cada291a-300d-4b36-ad20-911bc4440550" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.092443] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.092681] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.092825] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.093081] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.093252] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.093419] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cada291a-300d-4b36-ad20-911bc4440550',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 856.596270] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6a65879b-1ebc-46e7-bcb8-1b5f0a00660c',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 856.603751] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.603751] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.603751] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.603751] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.603751] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.603751] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.603751] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.603751] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.603751] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.603751] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.603751] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cada291a-300d-4b36-ad20-911bc4440550 is going to be deleted. [ 856.618505] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 700dc02a-f3c2-4363-9a0e-d7cdcb13a5b8 in Status: SUCCESS [ 856.618505] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-700dc02a-f3c2-4363-9a0e-d7cdcb13a5b8" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.650814] env[69980]: INFO networking_nsxv3.common.synchronization [req-0b536bc7-e590-45ce-b244-b7d78232a7c2 req-d6e9072c-5ada-48c6-97e1-b56bcc1777e7 tempest-ServersAdminTestJSON-1581544378 tempest-ServersAdminTestJSON-1581544378-project-member] Enqueued Resource ID: 700dc02a-f3c2-4363-9a0e-d7cdcb13a5b8 with Priority: HIGHEST for action security_group_members [ 856.652170] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 700dc02a-f3c2-4363-9a0e-d7cdcb13a5b8 with Priority: HIGHEST for action security_group_members [ 856.654199] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-700dc02a-f3c2-4363-9a0e-d7cdcb13a5b8 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.654199] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-700dc02a-f3c2-4363-9a0e-d7cdcb13a5b8" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.654199] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-700dc02a-f3c2-4363-9a0e-d7cdcb13a5b8" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.654199] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-700dc02a-f3c2-4363-9a0e-d7cdcb13a5b8" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.654199] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.654199] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.654199] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.654702] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.654702] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.654702] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('700dc02a-f3c2-4363-9a0e-d7cdcb13a5b8',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 856.671296] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.671296] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.671296] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.671296] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.671296] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.671296] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cada291a-300d-4b36-ad20-911bc4440550" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.673425] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cada291a-300d-4b36-ad20-911bc4440550" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.673425] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cada291a-300d-4b36-ad20-911bc4440550" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.673425] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.673583] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.673583] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.673709] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.674161] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.674161] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cada291a-300d-4b36-ad20-911bc4440550',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 857.101863] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6a65879b-1ebc-46e7-bcb8-1b5f0a00660c',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 857.158917] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('700dc02a-f3c2-4363-9a0e-d7cdcb13a5b8',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 857.180021] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.180021] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.180021] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.180021] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.180021] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.180021] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.180021] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.180021] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.180021] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.180341] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.180341] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cada291a-300d-4b36-ad20-911bc4440550 already deleted. [ 857.180558] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cada291a-300d-4b36-ad20-911bc4440550" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.184029] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('cada291a-300d-4b36-ad20-911bc4440550',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 857.184029] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cada291a-300d-4b36-ad20-911bc4440550" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.184029] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cada291a-300d-4b36-ad20-911bc4440550" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.184029] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.184029] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.184029] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.184029] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.184029] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.184029] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cada291a-300d-4b36-ad20-911bc4440550',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 857.371590] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock network-504 taken with stack trace [, , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.371774] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "network-504" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.371966] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "network-504" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.372301] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "network-504" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.378038] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.378038] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.378038] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.378038] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.378038] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.378038] env[69980]: DEBUG dogpile.cache.region [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] No value present for key: 'zone-id' {{(pid=69980) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 857.378038] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] NeedRegenerationException {{(pid=69980) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 857.378038] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] no value, waiting for create lock {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 857.378038] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] value creation lock acquired {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 857.378038] env[69980]: DEBUG dogpile.cache.region [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] No value present for key: 'zone-id' {{(pid=69980) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 857.378038] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Calling creation function for not-yet-present value {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 857.378038] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 857.397240] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 857.397240] env[69980]: DEBUG dogpile.cache.region [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=69980) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 857.397240] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Released creation lock {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 857.397240] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "network-504" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.397240] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock port-0b2754d1-bcb7-4836-a4ca-8d0d854703a3 taken with stack trace [, , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.397240] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "port-0b2754d1-bcb7-4836-a4ca-8d0d854703a3" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.397240] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "port-0b2754d1-bcb7-4836-a4ca-8d0d854703a3" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.397840] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "port-0b2754d1-bcb7-4836-a4ca-8d0d854703a3" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.397840] env[69980]: DEBUG networking_nsxv3.api.rpc [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0b2754d1-bcb7-4836-a4ca-8d0d854703a3',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 857.527565] env[69980]: INFO networking_nsxv3.common.synchronization [None req-cb1c2a29-7ac4-40c4-b0e5-da0e111bac23 None None] Enqueued Resource ID: ffd0d364-eddf-4f95-8c77-b347ca3839d6 with Priority: HIGHEST for action port [ 857.529209] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ffd0d364-eddf-4f95-8c77-b347ca3839d6 with Priority: HIGHEST for action port [ 857.529209] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock port-ffd0d364-eddf-4f95-8c77-b347ca3839d6 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.529209] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ffd0d364-eddf-4f95-8c77-b347ca3839d6" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.529209] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ffd0d364-eddf-4f95-8c77-b347ca3839d6" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.529209] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ffd0d364-eddf-4f95-8c77-b347ca3839d6" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.529209] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ffd0d364-eddf-4f95-8c77-b347ca3839d6',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 857.607038] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.607038] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.607038] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.607038] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.607038] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.607038] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6a65879b-1ebc-46e7-bcb8-1b5f0a00660c is going to be updated. [ 857.632657] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.632824] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.632892] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.633638] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.633638] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.641994] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6a65879b-1ebc-46e7-bcb8-1b5f0a00660c in Status: IN_PROGRESS for 2s [ 857.663397] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('700dc02a-f3c2-4363-9a0e-d7cdcb13a5b8',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 857.682368] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('cada291a-300d-4b36-ad20-911bc4440550',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 857.685337] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.685669] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.685777] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.686150] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.686150] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.686299] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.686407] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.686464] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.686618] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.686700] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.686783] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cada291a-300d-4b36-ad20-911bc4440550 already deleted. [ 857.686859] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cada291a-300d-4b36-ad20-911bc4440550" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.819342] env[69980]: INFO networking_nsxv3.common.synchronization [None req-802e6489-f624-46f4-9e2f-f6c26c7cb03b None None] Enqueued Resource ID: a5feb231-b9fd-48cb-a623-78e4504d8e95 with Priority: HIGHEST for action port [ 857.819770] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a5feb231-b9fd-48cb-a623-78e4504d8e95 with Priority: HIGHEST for action port [ 857.820803] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock port-a5feb231-b9fd-48cb-a623-78e4504d8e95 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.820803] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a5feb231-b9fd-48cb-a623-78e4504d8e95" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.820803] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a5feb231-b9fd-48cb-a623-78e4504d8e95" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.820803] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a5feb231-b9fd-48cb-a623-78e4504d8e95" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.820803] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a5feb231-b9fd-48cb-a623-78e4504d8e95',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 857.904022] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.904022] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.904022] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.904022] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.904022] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.904022] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Segment Port 0b2754d1-bcb7-4836-a4ca-8d0d854703a3 not found, creating... [ 857.904022] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.904022] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.904022] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.904022] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.904022] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.904463] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.904463] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.904463] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.904463] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.904463] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.907381] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Resource: SegmentPort with ID: 0b2754d1-bcb7-4836-a4ca-8d0d854703a3 is going to be created. [ 857.928547] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.930776] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.930776] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.930776] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.930776] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.930776] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "port-0b2754d1-bcb7-4836-a4ca-8d0d854703a3" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.032322] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ffd0d364-eddf-4f95-8c77-b347ca3839d6 [ 858.033439] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.034353] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.034353] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.034353] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.034353] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.034353] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ffd0d364-eddf-4f95-8c77-b347ca3839d6 already deleted. [ 858.034353] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ffd0d364-eddf-4f95-8c77-b347ca3839d6" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.036251] env[69980]: INFO networking_nsxv3.common.synchronization [None req-d3fd663b-e594-41de-a942-e87b2181bd7d tempest-AttachInterfacesTestJSON-1782090316 tempest-AttachInterfacesTestJSON-1782090316-project-member] Enqueued Resource ID: 7f2e833b-9263-48ef-ba09-f0afee0fa4af with Priority: HIGHEST for action security_group_rules [ 858.036572] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7f2e833b-9263-48ef-ba09-f0afee0fa4af with Priority: HIGHEST for action security_group_rules [ 858.037380] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7f2e833b-9263-48ef-ba09-f0afee0fa4af taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.037504] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7f2e833b-9263-48ef-ba09-f0afee0fa4af" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.037579] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7f2e833b-9263-48ef-ba09-f0afee0fa4af" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.038071] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7f2e833b-9263-48ef-ba09-f0afee0fa4af" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.038071] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7f2e833b-9263-48ef-ba09-f0afee0fa4af',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 858.169072] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.169072] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.169072] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.169072] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.169072] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.169072] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 700dc02a-f3c2-4363-9a0e-d7cdcb13a5b8 is going to be updated. [ 858.186504] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for cada291a-300d-4b36-ad20-911bc4440550: rpc.has_security_group_logging(os_id): False [ 858.202149] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.202336] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.202385] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.202573] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.202724] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.205577] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.205727] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.206637] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.206637] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.206637] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.206637] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.206637] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.206637] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.206975] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.206975] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.206975] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cada291a-300d-4b36-ad20-911bc4440550 is going to be created. [ 858.215054] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 700dc02a-f3c2-4363-9a0e-d7cdcb13a5b8 in Status: IN_PROGRESS for 2s [ 858.230821] env[69980]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [-] Warning Code=404 Message=b'{\n "httpStatus" : "NOT_FOUND",\n "error_code" : 500232,\n "module_name" : "Policy",\n "error_message" : "Following dependent objects, used in path=[/infra/domains/default/security-policies/cada291a-300d-4b36-ad20-911bc4440550], does not exist path=[/infra/domains/default/groups/cada291a-300d-4b36-ad20-911bc4440550]."\n}' [ 858.230821] env[69980]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cada291a-300d-4b36-ad20-911bc4440550 failed to be updated, retrying after metadata refresh: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/cada291a-300d-4b36-ad20-911bc4440550 [ 858.230821] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 858.241014] env[69980]: INFO networking_nsxv3.common.synchronization [None req-1aa2356d-fe9b-4a88-98d4-03d6deb53af6 tempest-AttachInterfacesTestJSON-1782090316 tempest-AttachInterfacesTestJSON-1782090316-project-member] Enqueued Resource ID: 7f2e833b-9263-48ef-ba09-f0afee0fa4af with Priority: HIGHEST for action security_group_rules [ 858.248761] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7f2e833b-9263-48ef-ba09-f0afee0fa4af with Priority: HIGHEST for action security_group_rules [ 858.248761] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7f2e833b-9263-48ef-ba09-f0afee0fa4af taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.248761] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7f2e833b-9263-48ef-ba09-f0afee0fa4af" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.279522] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.279522] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.279522] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.279819] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.282500] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.282500] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.282500] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.282500] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.282500] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.282500] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.282500] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.282500] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.282500] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.283067] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.283067] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.283067] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cada291a-300d-4b36-ad20-911bc4440550 is going to be created. [ 858.309196] env[69980]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [-] Warning Code=404 Message=b'{\n "httpStatus" : "NOT_FOUND",\n "error_code" : 500232,\n "module_name" : "Policy",\n "error_message" : "Following dependent objects, used in path=[/infra/domains/default/security-policies/cada291a-300d-4b36-ad20-911bc4440550], does not exist path=[/infra/domains/default/groups/cada291a-300d-4b36-ad20-911bc4440550]."\n}': requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/cada291a-300d-4b36-ad20-911bc4440550 [ 858.309466] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cada291a-300d-4b36-ad20-911bc4440550" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.310302] env[69980]: Traceback (most recent call last): [ 858.310302] env[69980]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 36, in wrapper [ 858.310302] env[69980]: return func(*args, **kwargs) [ 858.310302] env[69980]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 786, in _realize [ 858.310302] env[69980]: res.raise_for_status() [ 858.310302] env[69980]: File "/opt/stack/data/venv/lib/python3.10/site-packages/requests/models.py", line 1024, in raise_for_status [ 858.310302] env[69980]: raise HTTPError(http_error_msg, response=self) [ 858.310302] env[69980]: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/cada291a-300d-4b36-ad20-911bc4440550 [ 858.310302] env[69980]: During handling of the above exception, another exception occurred: [ 858.310302] env[69980]: Traceback (most recent call last): [ 858.310302] env[69980]: File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/hubs/poll.py", line 111, in wait [ 858.310302] env[69980]: listener.cb(fileno) [ 858.310302] env[69980]: File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py", line 272, in main [ 858.310302] env[69980]: result = function(*args, **kwargs) [ 858.310302] env[69980]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py", line 210, in security_group_rules [ 858.310302] env[69980]: self.nsx_provider.sg_rules_realize(os_sg, logged=logged) [ 858.310302] env[69980]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 1012, in sg_rules_realize [ 858.310302] env[69980]: return self._realize(Provider.SG_RULES, delete, self.payload.sg_rules_container, os_sg, provider_sg) [ 858.310302] env[69980]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 45, in wrapper [ 858.310302] env[69980]: return func(self, resource_type, delete, self.payload.sg_rules_container, os_obj, provider_sg) [ 858.310302] env[69980]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 786, in _realize [ 858.310302] env[69980]: res.raise_for_status() [ 858.310302] env[69980]: File "/opt/stack/data/venv/lib/python3.10/site-packages/requests/models.py", line 1024, in raise_for_status [ 858.310302] env[69980]: raise HTTPError(http_error_msg, response=self) [ 858.310302] env[69980]: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/cada291a-300d-4b36-ad20-911bc4440550 [ 858.310302] env[69980]: Removing descriptor: 5 [ 858.323482] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a5feb231-b9fd-48cb-a623-78e4504d8e95 [ 858.323482] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.323482] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.323482] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.323482] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.323482] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.323482] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a5feb231-b9fd-48cb-a623-78e4504d8e95 already deleted. [ 858.323482] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a5feb231-b9fd-48cb-a623-78e4504d8e95" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.562015] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.562015] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.562015] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.562015] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.562015] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.562015] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7f2e833b-9263-48ef-ba09-f0afee0fa4af already deleted. [ 858.562015] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7f2e833b-9263-48ef-ba09-f0afee0fa4af" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.562015] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7f2e833b-9263-48ef-ba09-f0afee0fa4af" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.562015] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7f2e833b-9263-48ef-ba09-f0afee0fa4af" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.562015] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7f2e833b-9263-48ef-ba09-f0afee0fa4af',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 858.728862] env[69980]: INFO networking_nsxv3.common.synchronization [req-0b536bc7-e590-45ce-b244-b7d78232a7c2 req-953b85a5-2dee-45d6-9597-e2d4251b59e8 service nova] Enqueued Resource ID: 700dc02a-f3c2-4363-9a0e-d7cdcb13a5b8 with Priority: HIGHEST for action security_group_rules [ 858.729171] env[69980]: INFO networking_nsxv3.common.synchronization [req-0b536bc7-e590-45ce-b244-b7d78232a7c2 req-953b85a5-2dee-45d6-9597-e2d4251b59e8 service nova] Enqueued Resource ID: 700dc02a-f3c2-4363-9a0e-d7cdcb13a5b8 with Priority: HIGHEST for action security_group_members [ 858.729238] env[69980]: INFO networking_nsxv3.common.synchronization [req-0b536bc7-e590-45ce-b244-b7d78232a7c2 req-953b85a5-2dee-45d6-9597-e2d4251b59e8 service nova] Enqueued Resource ID: 0b2754d1-bcb7-4836-a4ca-8d0d854703a3 with Priority: HIGHEST for action port [ 858.729569] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 700dc02a-f3c2-4363-9a0e-d7cdcb13a5b8 with Priority: HIGHEST for action security_group_rules [ 858.729715] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 700dc02a-f3c2-4363-9a0e-d7cdcb13a5b8 with Priority: HIGHEST for action security_group_members [ 858.729715] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0b2754d1-bcb7-4836-a4ca-8d0d854703a3 with Priority: HIGHEST for action port [ 858.732983] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock rules-700dc02a-f3c2-4363-9a0e-d7cdcb13a5b8 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.733146] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-700dc02a-f3c2-4363-9a0e-d7cdcb13a5b8" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.733239] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-700dc02a-f3c2-4363-9a0e-d7cdcb13a5b8" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.734028] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-700dc02a-f3c2-4363-9a0e-d7cdcb13a5b8" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.734028] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('700dc02a-f3c2-4363-9a0e-d7cdcb13a5b8',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 858.734853] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-700dc02a-f3c2-4363-9a0e-d7cdcb13a5b8 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.735932] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-700dc02a-f3c2-4363-9a0e-d7cdcb13a5b8" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.736240] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock port-0b2754d1-bcb7-4836-a4ca-8d0d854703a3 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.736380] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0b2754d1-bcb7-4836-a4ca-8d0d854703a3" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.736446] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0b2754d1-bcb7-4836-a4ca-8d0d854703a3" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.736645] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0b2754d1-bcb7-4836-a4ca-8d0d854703a3" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.736726] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0b2754d1-bcb7-4836-a4ca-8d0d854703a3',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 859.084433] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.087020] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.087020] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.087020] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.087020] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.087020] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7f2e833b-9263-48ef-ba09-f0afee0fa4af already deleted. [ 859.087020] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7f2e833b-9263-48ef-ba09-f0afee0fa4af" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.241455] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-700dc02a-f3c2-4363-9a0e-d7cdcb13a5b8 taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.241455] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-700dc02a-f3c2-4363-9a0e-d7cdcb13a5b8" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.241455] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 0b2754d1-bcb7-4836-a4ca-8d0d854703a3 with status ACTIVE [ 859.241455] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.241455] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.241455] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.241455] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.241455] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.241455] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.241455] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.241455] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.241455] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.241455] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.241455] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.242125] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.242125] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.242125] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.242238] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.242273] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 0b2754d1-bcb7-4836-a4ca-8d0d854703a3 is going to be updated. [ 859.265023] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.265424] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.265499] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.265715] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.265890] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.266084] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0b2754d1-bcb7-4836-a4ca-8d0d854703a3" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.657820] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6a65879b-1ebc-46e7-bcb8-1b5f0a00660c in Status: SUCCESS [ 859.658594] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6a65879b-1ebc-46e7-bcb8-1b5f0a00660c" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.658594] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6a65879b-1ebc-46e7-bcb8-1b5f0a00660c" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.658594] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6a65879b-1ebc-46e7-bcb8-1b5f0a00660c" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.658762] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.658762] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.658851] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.658939] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.659028] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.659112] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6a65879b-1ebc-46e7-bcb8-1b5f0a00660c" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.659212] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6a65879b-1ebc-46e7-bcb8-1b5f0a00660c',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 859.660055] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6a65879b-1ebc-46e7-bcb8-1b5f0a00660c" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.660223] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6a65879b-1ebc-46e7-bcb8-1b5f0a00660c" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.660382] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.660487] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.660546] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.660683] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.660759] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.660846] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6a65879b-1ebc-46e7-bcb8-1b5f0a00660c',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 860.165575] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-6a65879b-1ebc-46e7-bcb8-1b5f0a00660c taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.165918] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6a65879b-1ebc-46e7-bcb8-1b5f0a00660c" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.165960] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6a65879b-1ebc-46e7-bcb8-1b5f0a00660c',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 860.226229] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 700dc02a-f3c2-4363-9a0e-d7cdcb13a5b8 in Status: SUCCESS [ 860.226483] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-700dc02a-f3c2-4363-9a0e-d7cdcb13a5b8" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.226686] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-700dc02a-f3c2-4363-9a0e-d7cdcb13a5b8" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.226926] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-700dc02a-f3c2-4363-9a0e-d7cdcb13a5b8" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.227539] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.227698] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.227780] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.227976] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.228096] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.228217] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('700dc02a-f3c2-4363-9a0e-d7cdcb13a5b8',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 860.246429] env[69980]: INFO networking_nsxv3.common.synchronization [None req-306b19a0-6220-48ec-b7cc-b235105597b9 None None] Enqueued Resource ID: e4facd83-4508-4166-b3cf-0209cb5220dd with Priority: HIGHEST for action port [ 860.246957] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e4facd83-4508-4166-b3cf-0209cb5220dd with Priority: HIGHEST for action port [ 860.247474] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock port-e4facd83-4508-4166-b3cf-0209cb5220dd taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.247605] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e4facd83-4508-4166-b3cf-0209cb5220dd" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.247671] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e4facd83-4508-4166-b3cf-0209cb5220dd" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.247903] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e4facd83-4508-4166-b3cf-0209cb5220dd" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.247988] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e4facd83-4508-4166-b3cf-0209cb5220dd',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 860.670075] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6a65879b-1ebc-46e7-bcb8-1b5f0a00660c',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 860.730536] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('700dc02a-f3c2-4363-9a0e-d7cdcb13a5b8',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 860.756572] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port e4facd83-4508-4166-b3cf-0209cb5220dd [ 860.756808] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.756921] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.756976] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.757189] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.757271] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.757361] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:e4facd83-4508-4166-b3cf-0209cb5220dd already deleted. [ 860.757438] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e4facd83-4508-4166-b3cf-0209cb5220dd" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.171820] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.172190] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.172229] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.172506] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.172608] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.172715] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6a65879b-1ebc-46e7-bcb8-1b5f0a00660c is going to be updated. [ 861.201719] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.202165] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.202165] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.202165] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.202299] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.213711] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6a65879b-1ebc-46e7-bcb8-1b5f0a00660c in Status: IN_PROGRESS for 2s [ 861.238242] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('700dc02a-f3c2-4363-9a0e-d7cdcb13a5b8',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 861.739739] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.739874] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.739928] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.740189] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.740612] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.740737] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 700dc02a-f3c2-4363-9a0e-d7cdcb13a5b8 is going to be updated. [ 861.791450] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.792567] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.792567] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.792567] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.792567] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.803568] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 700dc02a-f3c2-4363-9a0e-d7cdcb13a5b8 in Status: IN_PROGRESS for 2s [ 861.865251] env[69980]: INFO networking_nsxv3.common.synchronization [req-99e56602-9f58-4762-95ef-8e8dc55e5984 req-dca074cc-828b-418d-8733-5941f619226b tempest-ServerDiskConfigTestJSON-214268531 tempest-ServerDiskConfigTestJSON-214268531-project-member] Enqueued Resource ID: 0dbf2bcd-0572-43ef-b18d-cc3cca7fcfd5 with Priority: HIGHEST for action security_group_members [ 861.866132] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0dbf2bcd-0572-43ef-b18d-cc3cca7fcfd5 with Priority: HIGHEST for action security_group_members [ 861.866223] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-0dbf2bcd-0572-43ef-b18d-cc3cca7fcfd5 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.868550] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0dbf2bcd-0572-43ef-b18d-cc3cca7fcfd5" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.868550] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0dbf2bcd-0572-43ef-b18d-cc3cca7fcfd5" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.868550] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0dbf2bcd-0572-43ef-b18d-cc3cca7fcfd5" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.868854] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.869023] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.869124] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.869325] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.869446] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.869833] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0dbf2bcd-0572-43ef-b18d-cc3cca7fcfd5',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 862.355652] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock network-932 taken with stack trace [, , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.356223] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "network-932" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.356446] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "network-932" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.356806] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "network-932" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.357208] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.357498] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.357738] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.358073] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.358316] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.358615] env[69980]: DEBUG dogpile.cache.region [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] No value present for key: 'zone-id' {{(pid=69980) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 862.358828] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] NeedRegenerationException {{(pid=69980) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 862.359043] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] no value, waiting for create lock {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 862.361023] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] value creation lock acquired {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 862.361023] env[69980]: DEBUG dogpile.cache.region [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] No value present for key: 'zone-id' {{(pid=69980) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 862.361023] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Calling creation function for not-yet-present value {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 862.361023] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 862.373765] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.376772] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.376772] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.376772] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.384057] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 862.384057] env[69980]: DEBUG dogpile.cache.region [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=69980) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 862.384057] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Released creation lock {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 862.384057] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "network-932" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.384057] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock port-f0838f22-d038-410e-9e03-39adb74a97aa taken with stack trace [, , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.384057] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "port-f0838f22-d038-410e-9e03-39adb74a97aa" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.384057] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "port-f0838f22-d038-410e-9e03-39adb74a97aa" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.384057] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "port-f0838f22-d038-410e-9e03-39adb74a97aa" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.384057] env[69980]: DEBUG networking_nsxv3.api.rpc [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f0838f22-d038-410e-9e03-39adb74a97aa',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 862.400282] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.400538] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.400659] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.400739] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.400970] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.401072] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.401167] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0dbf2bcd-0572-43ef-b18d-cc3cca7fcfd5 is going to be updated. [ 862.525602] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.525789] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.526632] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.526632] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.526632] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.534504] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0dbf2bcd-0572-43ef-b18d-cc3cca7fcfd5 in Status: IN_PROGRESS for 2s [ 862.631048] env[69980]: INFO networking_nsxv3.common.synchronization [None req-7aa8daa1-1dc0-4939-ad6f-843fd73453be None None] Enqueued Resource ID: a8751de3-d46c-4e39-86e4-d1e8bde3c097 with Priority: HIGHEST for action port [ 862.632228] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a8751de3-d46c-4e39-86e4-d1e8bde3c097 with Priority: HIGHEST for action port [ 862.632685] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock port-a8751de3-d46c-4e39-86e4-d1e8bde3c097 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.632685] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a8751de3-d46c-4e39-86e4-d1e8bde3c097" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.632839] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a8751de3-d46c-4e39-86e4-d1e8bde3c097" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.633084] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a8751de3-d46c-4e39-86e4-d1e8bde3c097" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.633464] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a8751de3-d46c-4e39-86e4-d1e8bde3c097',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 862.891904] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.891904] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.891904] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.891904] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.891904] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.891904] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Segment Port f0838f22-d038-410e-9e03-39adb74a97aa not found, creating... [ 862.891904] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.891904] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.891904] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.891904] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.891904] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.892405] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.892405] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.892405] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.892405] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.894732] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.895186] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Resource: SegmentPort with ID: f0838f22-d038-410e-9e03-39adb74a97aa is going to be created. [ 862.914710] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.916756] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.916756] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.916756] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.916756] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.916756] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "port-f0838f22-d038-410e-9e03-39adb74a97aa" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.130477] env[69980]: INFO networking_nsxv3.common.synchronization [req-c7165489-24eb-4349-bc18-df481298307e req-9f455d67-676b-4f66-b25a-eda38951d1ef tempest-FloatingIPsAssociationNegativeTestJSON-2133390623 tempest-FloatingIPsAssociationNegativeTestJSON-2133390623-project-member] Enqueued Resource ID: 162065c3-9db0-41c8-9437-c51716e30968 with Priority: HIGHEST for action security_group_members [ 863.131180] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 162065c3-9db0-41c8-9437-c51716e30968 with Priority: HIGHEST for action security_group_members [ 863.131569] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-162065c3-9db0-41c8-9437-c51716e30968 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.132379] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-162065c3-9db0-41c8-9437-c51716e30968" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.132379] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-162065c3-9db0-41c8-9437-c51716e30968" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.132379] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-162065c3-9db0-41c8-9437-c51716e30968" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.132379] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.132379] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.132688] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.132688] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.132755] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.132784] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('162065c3-9db0-41c8-9437-c51716e30968',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 863.137232] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a8751de3-d46c-4e39-86e4-d1e8bde3c097 [ 863.137753] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.137753] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.137753] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.137937] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.137984] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.138095] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a8751de3-d46c-4e39-86e4-d1e8bde3c097 already deleted. [ 863.138667] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a8751de3-d46c-4e39-86e4-d1e8bde3c097" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.169912] env[69980]: INFO networking_nsxv3.common.synchronization [req-ef8435c9-a471-48d6-93f6-ac6e3ff315de req-d1e32983-c6c9-4f53-bbc4-bf98ad10aeeb tempest-FloatingIPsAssociationTestJSON-592488877 tempest-FloatingIPsAssociationTestJSON-592488877-project-member] Enqueued Resource ID: 186800b9-4416-4ee9-97e6-a0aa4cad729b with Priority: HIGHEST for action security_group_members [ 863.169912] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 186800b9-4416-4ee9-97e6-a0aa4cad729b with Priority: HIGHEST for action security_group_members [ 863.169912] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-186800b9-4416-4ee9-97e6-a0aa4cad729b taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.169912] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-186800b9-4416-4ee9-97e6-a0aa4cad729b" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.169912] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-186800b9-4416-4ee9-97e6-a0aa4cad729b" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.170157] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-186800b9-4416-4ee9-97e6-a0aa4cad729b" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.170230] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.170331] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.170393] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.170546] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.170637] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.170733] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('186800b9-4416-4ee9-97e6-a0aa4cad729b',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 863.224756] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6a65879b-1ebc-46e7-bcb8-1b5f0a00660c in Status: SUCCESS [ 863.224990] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6a65879b-1ebc-46e7-bcb8-1b5f0a00660c" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.225190] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6a65879b-1ebc-46e7-bcb8-1b5f0a00660c" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.225412] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6a65879b-1ebc-46e7-bcb8-1b5f0a00660c" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.225602] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.225720] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.225786] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.225944] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.226038] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.226135] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6a65879b-1ebc-46e7-bcb8-1b5f0a00660c',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 863.635645] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.635938] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.635938] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.636118] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.657310] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.657557] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.657819] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.657819] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.657988] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.658049] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.658099] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 162065c3-9db0-41c8-9437-c51716e30968 is going to be updated. [ 863.672195] env[69980]: INFO networking_nsxv3.common.synchronization [req-99e56602-9f58-4762-95ef-8e8dc55e5984 req-a4020adf-370c-447f-9dc5-4a35eeacceff service nova] Enqueued Resource ID: 0dbf2bcd-0572-43ef-b18d-cc3cca7fcfd5 with Priority: HIGHEST for action security_group_rules [ 863.672195] env[69980]: INFO networking_nsxv3.common.synchronization [req-99e56602-9f58-4762-95ef-8e8dc55e5984 req-a4020adf-370c-447f-9dc5-4a35eeacceff service nova] Enqueued Resource ID: 0dbf2bcd-0572-43ef-b18d-cc3cca7fcfd5 with Priority: HIGHEST for action security_group_members [ 863.672195] env[69980]: INFO networking_nsxv3.common.synchronization [req-99e56602-9f58-4762-95ef-8e8dc55e5984 req-a4020adf-370c-447f-9dc5-4a35eeacceff service nova] Enqueued Resource ID: f0838f22-d038-410e-9e03-39adb74a97aa with Priority: HIGHEST for action port [ 863.672480] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0dbf2bcd-0572-43ef-b18d-cc3cca7fcfd5 with Priority: HIGHEST for action security_group_rules [ 863.672619] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0dbf2bcd-0572-43ef-b18d-cc3cca7fcfd5 with Priority: HIGHEST for action security_group_members [ 863.672803] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f0838f22-d038-410e-9e03-39adb74a97aa with Priority: HIGHEST for action port [ 863.673054] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.673215] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.673265] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.673823] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.675147] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0dbf2bcd-0572-43ef-b18d-cc3cca7fcfd5 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.675147] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0dbf2bcd-0572-43ef-b18d-cc3cca7fcfd5" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.675147] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0dbf2bcd-0572-43ef-b18d-cc3cca7fcfd5" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.675147] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0dbf2bcd-0572-43ef-b18d-cc3cca7fcfd5" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.675147] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0dbf2bcd-0572-43ef-b18d-cc3cca7fcfd5',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 863.676157] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-0dbf2bcd-0572-43ef-b18d-cc3cca7fcfd5 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.676157] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0dbf2bcd-0572-43ef-b18d-cc3cca7fcfd5" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.676557] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock port-f0838f22-d038-410e-9e03-39adb74a97aa taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.676557] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f0838f22-d038-410e-9e03-39adb74a97aa" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.676557] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f0838f22-d038-410e-9e03-39adb74a97aa" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.676734] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f0838f22-d038-410e-9e03-39adb74a97aa" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.676734] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f0838f22-d038-410e-9e03-39adb74a97aa',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 863.690988] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.691160] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.691218] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.691416] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.691561] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.702673] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.702917] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.703043] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.703108] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.703327] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.703412] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.703495] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 186800b9-4416-4ee9-97e6-a0aa4cad729b is going to be updated. [ 863.705510] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 162065c3-9db0-41c8-9437-c51716e30968 in Status: IN_PROGRESS for 2s [ 863.727665] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6a65879b-1ebc-46e7-bcb8-1b5f0a00660c',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 863.761157] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.761237] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.761335] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.761647] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.761839] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.773361] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 186800b9-4416-4ee9-97e6-a0aa4cad729b in Status: IN_PROGRESS for 2s [ 863.814989] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 700dc02a-f3c2-4363-9a0e-d7cdcb13a5b8 in Status: SUCCESS [ 863.815242] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-700dc02a-f3c2-4363-9a0e-d7cdcb13a5b8" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.815525] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-700dc02a-f3c2-4363-9a0e-d7cdcb13a5b8" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.815797] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-700dc02a-f3c2-4363-9a0e-d7cdcb13a5b8" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.816047] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.816195] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.816268] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.816472] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.816581] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.816683] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-700dc02a-f3c2-4363-9a0e-d7cdcb13a5b8" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.816789] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('700dc02a-f3c2-4363-9a0e-d7cdcb13a5b8',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 864.180575] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-0dbf2bcd-0572-43ef-b18d-cc3cca7fcfd5 taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.180720] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0dbf2bcd-0572-43ef-b18d-cc3cca7fcfd5" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.180933] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f0838f22-d038-410e-9e03-39adb74a97aa with status ACTIVE [ 864.181121] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.181271] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.181347] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.181636] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.181769] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.181969] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.182106] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.182186] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.184989] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.184989] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.184989] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.184989] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.184989] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.184989] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.184989] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.184989] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f0838f22-d038-410e-9e03-39adb74a97aa is going to be updated. [ 864.213930] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.214107] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.214178] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.214386] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.214516] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.216249] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f0838f22-d038-410e-9e03-39adb74a97aa" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.229608] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6a65879b-1ebc-46e7-bcb8-1b5f0a00660c',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 864.282429] env[69980]: INFO networking_nsxv3.common.synchronization [None req-359f8545-0060-4d3b-9ee2-7560ddc1cf94 None None] Enqueued Resource ID: 084795d8-2f36-4c28-8de7-464c01275cf6 with Priority: HIGHEST for action port [ 864.282985] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 084795d8-2f36-4c28-8de7-464c01275cf6 with Priority: HIGHEST for action port [ 864.285214] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock port-084795d8-2f36-4c28-8de7-464c01275cf6 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.285214] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-084795d8-2f36-4c28-8de7-464c01275cf6" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.285214] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-084795d8-2f36-4c28-8de7-464c01275cf6" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.285214] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-084795d8-2f36-4c28-8de7-464c01275cf6" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.285214] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('084795d8-2f36-4c28-8de7-464c01275cf6',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 864.322910] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-700dc02a-f3c2-4363-9a0e-d7cdcb13a5b8 taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.323109] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-700dc02a-f3c2-4363-9a0e-d7cdcb13a5b8" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.323153] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-700dc02a-f3c2-4363-9a0e-d7cdcb13a5b8" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.325040] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-700dc02a-f3c2-4363-9a0e-d7cdcb13a5b8" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.325040] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.325040] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.325040] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.325040] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.325040] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.325040] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-700dc02a-f3c2-4363-9a0e-d7cdcb13a5b8" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.325040] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-700dc02a-f3c2-4363-9a0e-d7cdcb13a5b8 taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.325040] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-700dc02a-f3c2-4363-9a0e-d7cdcb13a5b8" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.325040] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-700dc02a-f3c2-4363-9a0e-d7cdcb13a5b8" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.325040] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-700dc02a-f3c2-4363-9a0e-d7cdcb13a5b8" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.325040] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.325614] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.325614] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.325614] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.325614] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.325614] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-700dc02a-f3c2-4363-9a0e-d7cdcb13a5b8" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.326203] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('700dc02a-f3c2-4363-9a0e-d7cdcb13a5b8',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 864.546744] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0dbf2bcd-0572-43ef-b18d-cc3cca7fcfd5 in Status: SUCCESS [ 864.546947] env[69980]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0dbf2bcd-0572-43ef-b18d-cc3cca7fcfd5 deletion is rescheduled due to dependency. [ 864.547136] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0dbf2bcd-0572-43ef-b18d-cc3cca7fcfd5" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.547290] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0dbf2bcd-0572-43ef-b18d-cc3cca7fcfd5" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.547726] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0dbf2bcd-0572-43ef-b18d-cc3cca7fcfd5" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.547964] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.548149] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.548211] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.548408] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.548521] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.548653] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0dbf2bcd-0572-43ef-b18d-cc3cca7fcfd5',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 864.608389] env[69980]: INFO networking_nsxv3.common.synchronization [req-09311242-5e3b-4a9b-9411-6808ffa86e49 req-15494a69-03ab-47e1-876f-43b0e9db2914 tempest-ServersAdminNegativeTestJSON-1599780358 tempest-ServersAdminNegativeTestJSON-1599780358-project-member] Enqueued Resource ID: 2961e549-f7d2-46b0-a1f4-9365d96bb58a with Priority: HIGHEST for action security_group_members [ 864.609394] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2961e549-f7d2-46b0-a1f4-9365d96bb58a with Priority: HIGHEST for action security_group_members [ 864.609743] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-2961e549-f7d2-46b0-a1f4-9365d96bb58a taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.609928] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2961e549-f7d2-46b0-a1f4-9365d96bb58a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.611038] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2961e549-f7d2-46b0-a1f4-9365d96bb58a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.611038] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2961e549-f7d2-46b0-a1f4-9365d96bb58a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.611038] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.611038] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.611038] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.611038] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.611038] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.611038] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2961e549-f7d2-46b0-a1f4-9365d96bb58a',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 864.736081] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.736081] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.736081] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.736081] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.736454] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.736454] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6a65879b-1ebc-46e7-bcb8-1b5f0a00660c is going to be updated. [ 864.785738] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.785891] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.785949] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.786898] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.786898] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.787355] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 084795d8-2f36-4c28-8de7-464c01275cf6 [ 864.788578] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.788670] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.792017] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.792017] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.792017] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.792017] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:084795d8-2f36-4c28-8de7-464c01275cf6 already deleted. [ 864.792017] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-084795d8-2f36-4c28-8de7-464c01275cf6" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.799102] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6a65879b-1ebc-46e7-bcb8-1b5f0a00660c in Status: IN_PROGRESS for 2s [ 864.836143] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 700dc02a-f3c2-4363-9a0e-d7cdcb13a5b8: rpc.has_security_group_logging(os_id): False [ 864.856030] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.856191] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.856290] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.856489] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.884761] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.885046] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.885206] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.885257] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.885466] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.885557] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.885922] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.885922] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.885922] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.886091] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.886166] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.886358] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.886456] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.886519] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.886675] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.886748] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.886837] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 700dc02a-f3c2-4363-9a0e-d7cdcb13a5b8 is going to be updated. [ 864.978357] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.978499] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.978567] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.978811] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.978927] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.002346] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 700dc02a-f3c2-4363-9a0e-d7cdcb13a5b8 in Status: IN_PROGRESS for 2s [ 865.050850] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0dbf2bcd-0572-43ef-b18d-cc3cca7fcfd5',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 865.116038] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2961e549-f7d2-46b0-a1f4-9365d96bb58a',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 865.133779] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock network-557 taken with stack trace [, , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.134038] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "network-557" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.134164] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "network-557" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.134458] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "network-557" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.134845] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.135643] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.135918] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.136653] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.137230] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.138287] env[69980]: DEBUG dogpile.cache.region [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] No value present for key: 'zone-id' {{(pid=69980) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 865.138424] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] NeedRegenerationException {{(pid=69980) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 865.138544] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] no value, waiting for create lock {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 865.138793] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] value creation lock acquired {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 865.138793] env[69980]: DEBUG dogpile.cache.region [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] No value present for key: 'zone-id' {{(pid=69980) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 865.138896] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Calling creation function for not-yet-present value {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 865.139049] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 865.171674] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 865.171674] env[69980]: DEBUG dogpile.cache.region [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Cache value generated in 0.031 seconds for key(s): 'zone-id' {{(pid=69980) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 865.171674] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Released creation lock {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 865.171674] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "network-557" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.171674] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock port-d4c6775f-216e-4a02-997e-8441f739315c taken with stack trace [, , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.171674] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "port-d4c6775f-216e-4a02-997e-8441f739315c" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.171674] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "port-d4c6775f-216e-4a02-997e-8441f739315c" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.171674] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "port-d4c6775f-216e-4a02-997e-8441f739315c" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.171674] env[69980]: DEBUG networking_nsxv3.api.rpc [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d4c6775f-216e-4a02-997e-8441f739315c',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 865.250156] env[69980]: INFO networking_nsxv3.common.synchronization [req-ff059b88-9684-4ac1-88ea-9ff0ea013a45 req-ed40cb1f-98d9-4839-b229-428e6a712c8a tempest-ServerRescueTestJSONUnderV235-1182894004 tempest-ServerRescueTestJSONUnderV235-1182894004-project-member] Enqueued Resource ID: 6a65879b-1ebc-46e7-bcb8-1b5f0a00660c with Priority: HIGHEST for action security_group_members [ 865.250335] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6a65879b-1ebc-46e7-bcb8-1b5f0a00660c with Priority: HIGHEST for action security_group_members [ 865.250680] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-6a65879b-1ebc-46e7-bcb8-1b5f0a00660c taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.250815] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6a65879b-1ebc-46e7-bcb8-1b5f0a00660c" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.340797] env[69980]: INFO networking_nsxv3.common.synchronization [req-eab824fc-c7b2-4224-8177-a228364b7c5c req-593c8317-c795-42ed-8e37-edc7434f1c56 tempest-ServersV294TestFqdnHostnames-550580335 tempest-ServersV294TestFqdnHostnames-550580335-project-member] Enqueued Resource ID: 61b51096-066e-4c5d-b696-b9c061599dcc with Priority: HIGHEST for action security_group_members [ 865.341442] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 61b51096-066e-4c5d-b696-b9c061599dcc with Priority: HIGHEST for action security_group_members [ 865.341817] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-61b51096-066e-4c5d-b696-b9c061599dcc taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.341982] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-61b51096-066e-4c5d-b696-b9c061599dcc" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.342080] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-61b51096-066e-4c5d-b696-b9c061599dcc" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.342332] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-61b51096-066e-4c5d-b696-b9c061599dcc" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.342492] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.342637] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.342706] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.342890] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.342985] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.343092] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('61b51096-066e-4c5d-b696-b9c061599dcc',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 865.553878] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0dbf2bcd-0572-43ef-b18d-cc3cca7fcfd5',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 865.618718] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2961e549-f7d2-46b0-a1f4-9365d96bb58a',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 865.676948] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.678097] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.678097] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.678097] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.678097] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.678097] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Segment Port d4c6775f-216e-4a02-997e-8441f739315c not found, creating... [ 865.678311] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.678374] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.678481] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.678698] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.678840] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.679132] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.679287] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.679402] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.679607] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.679741] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.679876] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Resource: SegmentPort with ID: d4c6775f-216e-4a02-997e-8441f739315c is going to be created. [ 865.719088] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 162065c3-9db0-41c8-9437-c51716e30968 in Status: SUCCESS [ 865.719298] env[69980]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 162065c3-9db0-41c8-9437-c51716e30968 deletion is rescheduled due to dependency. [ 865.719417] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-162065c3-9db0-41c8-9437-c51716e30968" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.722662] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.722662] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.722662] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.722842] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.723074] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.723318] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "port-d4c6775f-216e-4a02-997e-8441f739315c" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.782297] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 186800b9-4416-4ee9-97e6-a0aa4cad729b in Status: SUCCESS [ 865.782567] env[69980]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 186800b9-4416-4ee9-97e6-a0aa4cad729b deletion is rescheduled due to dependency. [ 865.782663] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-186800b9-4416-4ee9-97e6-a0aa4cad729b" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.845762] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.845934] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.846012] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.846232] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.888650] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.888916] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.889115] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.889115] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.889321] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.889401] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.889491] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 61b51096-066e-4c5d-b696-b9c061599dcc is going to be updated. [ 865.930594] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.930771] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.930846] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.931069] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.931208] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.947037] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 61b51096-066e-4c5d-b696-b9c061599dcc in Status: IN_PROGRESS for 2s [ 866.058069] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.058249] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.058324] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.058535] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.058767] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.058767] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0dbf2bcd-0572-43ef-b18d-cc3cca7fcfd5 is going to be updated. [ 866.083687] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.083853] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.083910] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.084113] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.084280] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.092049] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0dbf2bcd-0572-43ef-b18d-cc3cca7fcfd5 in Status: IN_PROGRESS for 2s [ 866.120924] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.120924] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.120924] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.121772] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.121815] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.122013] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2961e549-f7d2-46b0-a1f4-9365d96bb58a is going to be updated. [ 866.161347] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.161741] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.161741] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.161896] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.162012] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.175350] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2961e549-f7d2-46b0-a1f4-9365d96bb58a in Status: IN_PROGRESS for 2s [ 866.461368] env[69980]: INFO networking_nsxv3.common.synchronization [req-09311242-5e3b-4a9b-9411-6808ffa86e49 req-5c4dcfdc-1b5a-457c-9cf9-378178d06b01 service nova] Enqueued Resource ID: 2961e549-f7d2-46b0-a1f4-9365d96bb58a with Priority: HIGHEST for action security_group_rules [ 866.461531] env[69980]: INFO networking_nsxv3.common.synchronization [req-09311242-5e3b-4a9b-9411-6808ffa86e49 req-5c4dcfdc-1b5a-457c-9cf9-378178d06b01 service nova] Enqueued Resource ID: 2961e549-f7d2-46b0-a1f4-9365d96bb58a with Priority: HIGHEST for action security_group_members [ 866.461651] env[69980]: INFO networking_nsxv3.common.synchronization [req-09311242-5e3b-4a9b-9411-6808ffa86e49 req-5c4dcfdc-1b5a-457c-9cf9-378178d06b01 service nova] Enqueued Resource ID: d4c6775f-216e-4a02-997e-8441f739315c with Priority: HIGHEST for action port [ 866.461880] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2961e549-f7d2-46b0-a1f4-9365d96bb58a with Priority: HIGHEST for action security_group_rules [ 866.462121] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2961e549-f7d2-46b0-a1f4-9365d96bb58a with Priority: HIGHEST for action security_group_members [ 866.462121] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d4c6775f-216e-4a02-997e-8441f739315c with Priority: HIGHEST for action port [ 866.462720] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2961e549-f7d2-46b0-a1f4-9365d96bb58a taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.462837] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2961e549-f7d2-46b0-a1f4-9365d96bb58a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.462837] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2961e549-f7d2-46b0-a1f4-9365d96bb58a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.464232] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2961e549-f7d2-46b0-a1f4-9365d96bb58a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.464232] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2961e549-f7d2-46b0-a1f4-9365d96bb58a',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 866.464476] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-2961e549-f7d2-46b0-a1f4-9365d96bb58a taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.464476] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2961e549-f7d2-46b0-a1f4-9365d96bb58a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.464774] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock port-d4c6775f-216e-4a02-997e-8441f739315c taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.464906] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d4c6775f-216e-4a02-997e-8441f739315c" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.464972] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d4c6775f-216e-4a02-997e-8441f739315c" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.465158] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d4c6775f-216e-4a02-997e-8441f739315c" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.465235] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d4c6775f-216e-4a02-997e-8441f739315c',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 866.549501] env[69980]: INFO networking_nsxv3.common.synchronization [None req-9dd3abf7-aa41-446d-8215-afe8b9018284 None None] Enqueued Resource ID: 18ee838a-7192-437c-b109-4ed2ea7ce75c with Priority: HIGHEST for action port [ 866.549501] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 18ee838a-7192-437c-b109-4ed2ea7ce75c with Priority: HIGHEST for action port [ 866.549501] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock port-18ee838a-7192-437c-b109-4ed2ea7ce75c taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.549501] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-18ee838a-7192-437c-b109-4ed2ea7ce75c" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.549501] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-18ee838a-7192-437c-b109-4ed2ea7ce75c" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.549719] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-18ee838a-7192-437c-b109-4ed2ea7ce75c" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.549719] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('18ee838a-7192-437c-b109-4ed2ea7ce75c',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 866.811345] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6a65879b-1ebc-46e7-bcb8-1b5f0a00660c in Status: SUCCESS [ 866.811952] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6a65879b-1ebc-46e7-bcb8-1b5f0a00660c" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.812251] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6a65879b-1ebc-46e7-bcb8-1b5f0a00660c" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.812493] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6a65879b-1ebc-46e7-bcb8-1b5f0a00660c" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.812712] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.812851] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.812928] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.813128] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.813225] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.813331] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6a65879b-1ebc-46e7-bcb8-1b5f0a00660c" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.813504] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-6a65879b-1ebc-46e7-bcb8-1b5f0a00660c taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.813658] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6a65879b-1ebc-46e7-bcb8-1b5f0a00660c" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.813719] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6a65879b-1ebc-46e7-bcb8-1b5f0a00660c" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.813894] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6a65879b-1ebc-46e7-bcb8-1b5f0a00660c" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.814075] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.814183] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.814269] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.814416] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.814506] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.814609] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6a65879b-1ebc-46e7-bcb8-1b5f0a00660c" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.814702] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6a65879b-1ebc-46e7-bcb8-1b5f0a00660c',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 866.815594] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6a65879b-1ebc-46e7-bcb8-1b5f0a00660c" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.815809] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6a65879b-1ebc-46e7-bcb8-1b5f0a00660c" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.816018] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.816135] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.816213] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.817270] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.817270] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.817270] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6a65879b-1ebc-46e7-bcb8-1b5f0a00660c',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 866.970172] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-2961e549-f7d2-46b0-a1f4-9365d96bb58a taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.970172] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2961e549-f7d2-46b0-a1f4-9365d96bb58a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.970172] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d4c6775f-216e-4a02-997e-8441f739315c with status ACTIVE [ 866.970172] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.970172] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.970172] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.970172] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.970172] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.970172] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.970172] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.970172] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.970172] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.970172] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.970172] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.970807] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.970807] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.970807] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.971224] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.971518] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d4c6775f-216e-4a02-997e-8441f739315c is going to be updated. [ 866.996264] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.996456] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.996456] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.997510] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.997510] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.997510] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d4c6775f-216e-4a02-997e-8441f739315c" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.024881] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 700dc02a-f3c2-4363-9a0e-d7cdcb13a5b8 in Status: SUCCESS [ 867.025056] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-700dc02a-f3c2-4363-9a0e-d7cdcb13a5b8" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.052386] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 18ee838a-7192-437c-b109-4ed2ea7ce75c [ 867.052627] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.052780] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.054384] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.054384] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.054384] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.054384] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:18ee838a-7192-437c-b109-4ed2ea7ce75c already deleted. [ 867.054384] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-18ee838a-7192-437c-b109-4ed2ea7ce75c" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.319848] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.320027] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.320104] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.320455] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.321584] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6a65879b-1ebc-46e7-bcb8-1b5f0a00660c: rpc.has_security_group_logging(os_id): False [ 867.344599] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.344742] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.347665] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.347665] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.347665] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.347665] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.347665] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.347665] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.347893] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6a65879b-1ebc-46e7-bcb8-1b5f0a00660c is going to be updated. [ 867.351586] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.351586] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.351586] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.351586] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.351586] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.351586] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.351586] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.351586] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.351586] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.351586] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.351586] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.351586] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.351586] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.351586] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.352018] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.352018] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.352018] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.352018] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.352018] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6a65879b-1ebc-46e7-bcb8-1b5f0a00660c is going to be updated. [ 867.365363] env[69980]: INFO networking_nsxv3.common.synchronization [req-31188ca5-fd7b-46d0-8f66-4087d4c7e677 req-f52b3412-7803-469d-9c32-790909efb852 tempest-ServersTestBootFromVolume-1163221882 tempest-ServersTestBootFromVolume-1163221882-project-member] Enqueued Resource ID: f2b778ac-011d-472f-9220-d8d50a881380 with Priority: HIGHEST for action security_group_members [ 867.365946] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f2b778ac-011d-472f-9220-d8d50a881380 with Priority: HIGHEST for action security_group_members [ 867.366314] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-f2b778ac-011d-472f-9220-d8d50a881380 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.366444] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f2b778ac-011d-472f-9220-d8d50a881380" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.366508] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f2b778ac-011d-472f-9220-d8d50a881380" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.366778] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f2b778ac-011d-472f-9220-d8d50a881380" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.366950] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.367609] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.367609] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.367734] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.367771] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.367858] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f2b778ac-011d-472f-9220-d8d50a881380',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 867.390397] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.390512] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.393924] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.393924] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.393924] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.402438] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6a65879b-1ebc-46e7-bcb8-1b5f0a00660c in Status: IN_PROGRESS for 2s [ 867.420507] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.420996] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.420996] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.420996] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.421137] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.437455] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6a65879b-1ebc-46e7-bcb8-1b5f0a00660c in Status: IN_PROGRESS for 2s [ 867.871616] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.872092] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.872092] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.872412] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.872412] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.872631] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.872771] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.872813] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.873075] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.873075] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.873283] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f2b778ac-011d-472f-9220-d8d50a881380 already deleted. [ 867.873283] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f2b778ac-011d-472f-9220-d8d50a881380" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.879016] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock network-61 taken with stack trace [, , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.879224] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "network-61" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.879344] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "network-61" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.879638] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "network-61" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.880085] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.880227] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.880656] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.880656] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.882046] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.882046] env[69980]: DEBUG dogpile.cache.region [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] No value present for key: 'zone-id' {{(pid=69980) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 867.882046] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] NeedRegenerationException {{(pid=69980) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 867.882046] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] no value, waiting for create lock {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 867.882046] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] value creation lock acquired {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 867.882046] env[69980]: DEBUG dogpile.cache.region [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] No value present for key: 'zone-id' {{(pid=69980) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 867.882046] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Calling creation function for not-yet-present value {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 867.882046] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 867.903371] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 867.903595] env[69980]: DEBUG dogpile.cache.region [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=69980) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 867.903699] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Released creation lock {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 867.903904] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "network-61" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.904258] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock port-d3e13c5a-bfc9-44ed-96b2-051d8c56b5e2 taken with stack trace [, , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.904500] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "port-d3e13c5a-bfc9-44ed-96b2-051d8c56b5e2" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.904559] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "port-d3e13c5a-bfc9-44ed-96b2-051d8c56b5e2" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.905013] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "port-d3e13c5a-bfc9-44ed-96b2-051d8c56b5e2" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.905273] env[69980]: DEBUG networking_nsxv3.api.rpc [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d3e13c5a-bfc9-44ed-96b2-051d8c56b5e2',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 867.962265] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 61b51096-066e-4c5d-b696-b9c061599dcc in Status: SUCCESS [ 867.962265] env[69980]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 61b51096-066e-4c5d-b696-b9c061599dcc deletion is rescheduled due to dependency. [ 867.962265] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-61b51096-066e-4c5d-b696-b9c061599dcc" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.105010] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0dbf2bcd-0572-43ef-b18d-cc3cca7fcfd5 in Status: SUCCESS [ 868.105271] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0dbf2bcd-0572-43ef-b18d-cc3cca7fcfd5" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.105468] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0dbf2bcd-0572-43ef-b18d-cc3cca7fcfd5" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.105763] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0dbf2bcd-0572-43ef-b18d-cc3cca7fcfd5" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.106045] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.106192] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.106272] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.106464] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.106620] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.106702] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0dbf2bcd-0572-43ef-b18d-cc3cca7fcfd5" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.106804] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('0dbf2bcd-0572-43ef-b18d-cc3cca7fcfd5',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 868.186905] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2961e549-f7d2-46b0-a1f4-9365d96bb58a in Status: SUCCESS [ 868.187301] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2961e549-f7d2-46b0-a1f4-9365d96bb58a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.187964] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2961e549-f7d2-46b0-a1f4-9365d96bb58a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.187964] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2961e549-f7d2-46b0-a1f4-9365d96bb58a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.188221] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.188368] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.188368] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.188493] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.188643] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.188831] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2961e549-f7d2-46b0-a1f4-9365d96bb58a',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 868.411824] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.412203] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.412419] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.412824] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.413068] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.413305] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Segment Port d3e13c5a-bfc9-44ed-96b2-051d8c56b5e2 not found, creating... [ 868.413721] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.414097] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.414298] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.414462] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.414680] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.415288] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.415445] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.415687] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.415943] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.416094] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.416255] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Resource: SegmentPort with ID: d3e13c5a-bfc9-44ed-96b2-051d8c56b5e2 is going to be created. [ 868.436016] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.436254] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.436382] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.436647] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.436929] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.437218] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "port-d3e13c5a-bfc9-44ed-96b2-051d8c56b5e2" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.609509] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-0dbf2bcd-0572-43ef-b18d-cc3cca7fcfd5 taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.609702] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0dbf2bcd-0572-43ef-b18d-cc3cca7fcfd5" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.609794] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0dbf2bcd-0572-43ef-b18d-cc3cca7fcfd5" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.610093] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0dbf2bcd-0572-43ef-b18d-cc3cca7fcfd5" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.610256] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.610361] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.610442] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.610623] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.610730] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.610823] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0dbf2bcd-0572-43ef-b18d-cc3cca7fcfd5" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.610976] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-0dbf2bcd-0572-43ef-b18d-cc3cca7fcfd5 taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.611101] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0dbf2bcd-0572-43ef-b18d-cc3cca7fcfd5" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.611161] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0dbf2bcd-0572-43ef-b18d-cc3cca7fcfd5" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.611312] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0dbf2bcd-0572-43ef-b18d-cc3cca7fcfd5" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.611467] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.611574] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.611667] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.611815] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.611893] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.611976] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0dbf2bcd-0572-43ef-b18d-cc3cca7fcfd5" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.612078] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('0dbf2bcd-0572-43ef-b18d-cc3cca7fcfd5',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 868.691465] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2961e549-f7d2-46b0-a1f4-9365d96bb58a',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 869.114409] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 0dbf2bcd-0572-43ef-b18d-cc3cca7fcfd5: rpc.has_security_group_logging(os_id): False [ 869.132548] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.133270] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.133473] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.134365] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.134365] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.134365] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.134365] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.134365] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.134365] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.134365] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.134653] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.134653] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.134653] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.134822] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.134855] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.135339] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.135339] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.135339] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.135481] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.135481] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.135578] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0dbf2bcd-0572-43ef-b18d-cc3cca7fcfd5 is going to be updated. [ 869.158448] env[69980]: INFO networking_nsxv3.common.synchronization [req-d1cdf8bb-1333-4af0-ba01-26a36f598e2e req-bd50e4f4-ef0f-4cd6-b5a0-f33e96d1d31a tempest-ListImageFiltersTestJSON-1575668155 tempest-ListImageFiltersTestJSON-1575668155-project-member] Enqueued Resource ID: 241bcad9-5919-4c26-b0b9-beb6a98733bd with Priority: HIGHEST for action security_group_members [ 869.158998] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 241bcad9-5919-4c26-b0b9-beb6a98733bd with Priority: HIGHEST for action security_group_members [ 869.159672] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-241bcad9-5919-4c26-b0b9-beb6a98733bd taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.159800] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-241bcad9-5919-4c26-b0b9-beb6a98733bd" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.159870] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-241bcad9-5919-4c26-b0b9-beb6a98733bd" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.161631] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-241bcad9-5919-4c26-b0b9-beb6a98733bd" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.161847] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.161986] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.162093] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.162286] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.162402] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.162521] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('241bcad9-5919-4c26-b0b9-beb6a98733bd',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 869.193245] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2961e549-f7d2-46b0-a1f4-9365d96bb58a',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 869.194985] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.195135] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.195204] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.195407] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.195543] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.214230] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0dbf2bcd-0572-43ef-b18d-cc3cca7fcfd5 in Status: IN_PROGRESS for 2s [ 869.417951] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6a65879b-1ebc-46e7-bcb8-1b5f0a00660c in Status: SUCCESS [ 869.417951] env[69980]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6a65879b-1ebc-46e7-bcb8-1b5f0a00660c deletion is rescheduled due to dependency. [ 869.417951] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6a65879b-1ebc-46e7-bcb8-1b5f0a00660c" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.449933] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6a65879b-1ebc-46e7-bcb8-1b5f0a00660c in Status: SUCCESS [ 869.450207] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6a65879b-1ebc-46e7-bcb8-1b5f0a00660c" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.450394] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6a65879b-1ebc-46e7-bcb8-1b5f0a00660c" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.450922] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6a65879b-1ebc-46e7-bcb8-1b5f0a00660c" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.450922] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6a65879b-1ebc-46e7-bcb8-1b5f0a00660c',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 869.599331] env[69980]: INFO networking_nsxv3.common.synchronization [req-31188ca5-fd7b-46d0-8f66-4087d4c7e677 req-eda8618b-f7e3-4fdb-b67d-76f1aad22b88 service nova] Enqueued Resource ID: f2b778ac-011d-472f-9220-d8d50a881380 with Priority: HIGHEST for action security_group_rules [ 869.599331] env[69980]: INFO networking_nsxv3.common.synchronization [req-31188ca5-fd7b-46d0-8f66-4087d4c7e677 req-eda8618b-f7e3-4fdb-b67d-76f1aad22b88 service nova] Enqueued Resource ID: f2b778ac-011d-472f-9220-d8d50a881380 with Priority: HIGHEST for action security_group_members [ 869.599331] env[69980]: INFO networking_nsxv3.common.synchronization [req-31188ca5-fd7b-46d0-8f66-4087d4c7e677 req-eda8618b-f7e3-4fdb-b67d-76f1aad22b88 service nova] Enqueued Resource ID: d3e13c5a-bfc9-44ed-96b2-051d8c56b5e2 with Priority: HIGHEST for action port [ 869.599331] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f2b778ac-011d-472f-9220-d8d50a881380 with Priority: HIGHEST for action security_group_rules [ 869.599796] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f2b778ac-011d-472f-9220-d8d50a881380 with Priority: HIGHEST for action security_group_members [ 869.599796] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d3e13c5a-bfc9-44ed-96b2-051d8c56b5e2 with Priority: HIGHEST for action port [ 869.600029] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f2b778ac-011d-472f-9220-d8d50a881380 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.600151] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f2b778ac-011d-472f-9220-d8d50a881380" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.600195] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f2b778ac-011d-472f-9220-d8d50a881380" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.600465] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f2b778ac-011d-472f-9220-d8d50a881380" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.600465] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f2b778ac-011d-472f-9220-d8d50a881380',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 869.601982] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-f2b778ac-011d-472f-9220-d8d50a881380 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.601982] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f2b778ac-011d-472f-9220-d8d50a881380" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.601982] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f2b778ac-011d-472f-9220-d8d50a881380" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.601982] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f2b778ac-011d-472f-9220-d8d50a881380" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.601982] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.602290] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.602290] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.602290] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.602624] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.602624] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f2b778ac-011d-472f-9220-d8d50a881380',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 869.608656] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock port-d3e13c5a-bfc9-44ed-96b2-051d8c56b5e2 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.608656] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d3e13c5a-bfc9-44ed-96b2-051d8c56b5e2" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.608656] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d3e13c5a-bfc9-44ed-96b2-051d8c56b5e2" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.608656] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d3e13c5a-bfc9-44ed-96b2-051d8c56b5e2" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.608656] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d3e13c5a-bfc9-44ed-96b2-051d8c56b5e2',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 869.664547] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('241bcad9-5919-4c26-b0b9-beb6a98733bd',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 869.700040] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.700040] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.700040] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.700040] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.700255] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.700255] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2961e549-f7d2-46b0-a1f4-9365d96bb58a is going to be updated. [ 869.729904] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.730085] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.730144] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.730347] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.730495] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.739073] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2961e549-f7d2-46b0-a1f4-9365d96bb58a in Status: IN_PROGRESS for 2s [ 869.975732] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.975909] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.975981] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.976196] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.976308] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.977103] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6a65879b-1ebc-46e7-bcb8-1b5f0a00660c is going to be deleted. [ 870.035094] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.035256] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.035311] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.035522] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.035633] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.035764] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6a65879b-1ebc-46e7-bcb8-1b5f0a00660c" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.105459] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f2b778ac-011d-472f-9220-d8d50a881380',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 870.115915] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d3e13c5a-bfc9-44ed-96b2-051d8c56b5e2 with status ACTIVE [ 870.115915] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.115915] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.115915] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.115915] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.115915] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.115915] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.115915] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.115915] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.115915] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.115915] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.115915] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.115915] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.115915] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.115915] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.115915] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.115915] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d3e13c5a-bfc9-44ed-96b2-051d8c56b5e2 is going to be updated. [ 870.116714] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-f2b778ac-011d-472f-9220-d8d50a881380 taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.116776] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f2b778ac-011d-472f-9220-d8d50a881380" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.142727] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.143235] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.144080] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.144080] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.144080] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.144080] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d3e13c5a-bfc9-44ed-96b2-051d8c56b5e2" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.168820] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('241bcad9-5919-4c26-b0b9-beb6a98733bd',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 870.613619] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f2b778ac-011d-472f-9220-d8d50a881380',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 870.670801] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.670956] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.673022] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.673022] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.673022] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.673022] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 241bcad9-5919-4c26-b0b9-beb6a98733bd is going to be updated. [ 870.716644] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.716644] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.716644] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.716644] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.716644] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.725987] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 241bcad9-5919-4c26-b0b9-beb6a98733bd in Status: IN_PROGRESS for 2s [ 871.115506] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.115691] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.115791] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.116099] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.116395] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.116395] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f2b778ac-011d-472f-9220-d8d50a881380 is going to be created. [ 871.142448] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.142587] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.142677] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.143069] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.143069] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.157022] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f2b778ac-011d-472f-9220-d8d50a881380 in Status: UNINITIALIZED for 2s [ 871.229045] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0dbf2bcd-0572-43ef-b18d-cc3cca7fcfd5 in Status: SUCCESS [ 871.229045] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0dbf2bcd-0572-43ef-b18d-cc3cca7fcfd5" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.750058] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2961e549-f7d2-46b0-a1f4-9365d96bb58a in Status: SUCCESS [ 871.750058] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2961e549-f7d2-46b0-a1f4-9365d96bb58a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.750178] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2961e549-f7d2-46b0-a1f4-9365d96bb58a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.750478] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2961e549-f7d2-46b0-a1f4-9365d96bb58a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.751119] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.751119] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.751119] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.751119] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.751345] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.751345] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2961e549-f7d2-46b0-a1f4-9365d96bb58a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.751345] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('2961e549-f7d2-46b0-a1f4-9365d96bb58a',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 872.255513] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-2961e549-f7d2-46b0-a1f4-9365d96bb58a taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.255513] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2961e549-f7d2-46b0-a1f4-9365d96bb58a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.255513] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2961e549-f7d2-46b0-a1f4-9365d96bb58a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.255513] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2961e549-f7d2-46b0-a1f4-9365d96bb58a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.255513] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.255513] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.255513] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.255513] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.255513] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.255513] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2961e549-f7d2-46b0-a1f4-9365d96bb58a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.255513] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-2961e549-f7d2-46b0-a1f4-9365d96bb58a taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.255513] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2961e549-f7d2-46b0-a1f4-9365d96bb58a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.255513] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2961e549-f7d2-46b0-a1f4-9365d96bb58a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.255513] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2961e549-f7d2-46b0-a1f4-9365d96bb58a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.256292] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.256292] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.256292] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.256292] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.256292] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.256292] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2961e549-f7d2-46b0-a1f4-9365d96bb58a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.256292] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('2961e549-f7d2-46b0-a1f4-9365d96bb58a',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 872.736231] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 241bcad9-5919-4c26-b0b9-beb6a98733bd in Status: SUCCESS [ 872.736502] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-241bcad9-5919-4c26-b0b9-beb6a98733bd" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.758058] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 2961e549-f7d2-46b0-a1f4-9365d96bb58a: rpc.has_security_group_logging(os_id): False [ 872.775605] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.775829] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.775829] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.776045] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.795979] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.796286] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.796405] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.796468] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.796686] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.796764] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.796952] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.797053] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.797112] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.797253] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.797323] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.797775] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.797877] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.797936] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.798497] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.798577] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.798663] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2961e549-f7d2-46b0-a1f4-9365d96bb58a is going to be updated. [ 872.854971] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.855149] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.855223] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.855430] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.855578] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.868359] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2961e549-f7d2-46b0-a1f4-9365d96bb58a in Status: IN_PROGRESS for 2s [ 873.167434] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f2b778ac-011d-472f-9220-d8d50a881380 in Status: SUCCESS [ 873.167747] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f2b778ac-011d-472f-9220-d8d50a881380" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.168026] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f2b778ac-011d-472f-9220-d8d50a881380" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.168354] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f2b778ac-011d-472f-9220-d8d50a881380" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.168659] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.168845] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.168965] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.170056] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.170274] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.170325] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f2b778ac-011d-472f-9220-d8d50a881380" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.170418] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f2b778ac-011d-472f-9220-d8d50a881380',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 873.564572] env[69980]: INFO networking_nsxv3.common.synchronization [req-baf58361-f003-454a-a49f-41d8ce04bbec req-405d9d14-0a00-4290-a1ca-28d941538bd5 tempest-InstanceActionsNegativeTestJSON-1747841294 tempest-InstanceActionsNegativeTestJSON-1747841294-project-member] Enqueued Resource ID: 825b0052-8bd1-4107-8258-075804cbc484 with Priority: HIGHEST for action security_group_members [ 873.565181] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 825b0052-8bd1-4107-8258-075804cbc484 with Priority: HIGHEST for action security_group_members [ 873.567065] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-825b0052-8bd1-4107-8258-075804cbc484 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.567065] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-825b0052-8bd1-4107-8258-075804cbc484" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.567065] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-825b0052-8bd1-4107-8258-075804cbc484" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.567065] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-825b0052-8bd1-4107-8258-075804cbc484" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.568465] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.568634] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.568705] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.568885] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.568994] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.570253] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('825b0052-8bd1-4107-8258-075804cbc484',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 873.673292] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f2b778ac-011d-472f-9220-d8d50a881380',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 874.022694] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock network-674 taken with stack trace [, , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.022898] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "network-674" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.023029] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "network-674" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.023374] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "network-674" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.023727] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.023862] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.023963] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.025400] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.025651] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.026302] env[69980]: DEBUG dogpile.cache.region [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] No value present for key: 'zone-id' {{(pid=69980) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 874.026429] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] NeedRegenerationException {{(pid=69980) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 874.026545] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] no value, waiting for create lock {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 874.026657] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] value creation lock acquired {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 874.026775] env[69980]: DEBUG dogpile.cache.region [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] No value present for key: 'zone-id' {{(pid=69980) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 874.026901] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Calling creation function for not-yet-present value {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 874.027051] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 874.052729] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 874.052729] env[69980]: DEBUG dogpile.cache.region [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=69980) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 874.052729] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Released creation lock {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 874.052729] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "network-674" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.052729] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock port-e5d60ebe-1440-44ce-8d23-1bf3778f635e taken with stack trace [, , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.052729] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "port-e5d60ebe-1440-44ce-8d23-1bf3778f635e" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.052729] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "port-e5d60ebe-1440-44ce-8d23-1bf3778f635e" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.054311] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "port-e5d60ebe-1440-44ce-8d23-1bf3778f635e" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.054946] env[69980]: DEBUG networking_nsxv3.api.rpc [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e5d60ebe-1440-44ce-8d23-1bf3778f635e',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 874.076154] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.076154] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.076154] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.076154] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.076154] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.076154] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.076154] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.076154] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.076154] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.076154] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.076154] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 825b0052-8bd1-4107-8258-075804cbc484 already deleted. [ 874.076154] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-825b0052-8bd1-4107-8258-075804cbc484" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.177061] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f2b778ac-011d-472f-9220-d8d50a881380: rpc.has_security_group_logging(os_id): False [ 874.194683] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.195147] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.196283] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.196283] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.196283] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.196283] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.196283] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.196283] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.196651] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.196651] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.196722] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f2b778ac-011d-472f-9220-d8d50a881380 is going to be created. [ 874.282433] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.286017] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.286017] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.286017] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.286017] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.297461] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f2b778ac-011d-472f-9220-d8d50a881380 in Status: IN_PROGRESS for 2s [ 874.558279] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.559345] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.559345] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.559345] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.559345] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.559567] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Segment Port e5d60ebe-1440-44ce-8d23-1bf3778f635e not found, creating... [ 874.560144] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.560144] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.560144] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.560372] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.560439] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.560729] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.560893] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.561048] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.561228] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.561363] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.561505] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Resource: SegmentPort with ID: e5d60ebe-1440-44ce-8d23-1bf3778f635e is going to be created. [ 874.581295] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.581715] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.581715] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.581908] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.582149] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.582375] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "port-e5d60ebe-1440-44ce-8d23-1bf3778f635e" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.730262] env[69980]: INFO networking_nsxv3.common.synchronization [None req-b6636eb0-19d1-4950-a79f-c278c1295b14 None None] Enqueued Resource ID: 81b08e11-d562-4171-a8a0-230a33c0203a with Priority: HIGHEST for action port [ 874.730819] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 81b08e11-d562-4171-a8a0-230a33c0203a with Priority: HIGHEST for action port [ 874.731115] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock port-81b08e11-d562-4171-a8a0-230a33c0203a taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.731266] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-81b08e11-d562-4171-a8a0-230a33c0203a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.731338] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-81b08e11-d562-4171-a8a0-230a33c0203a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.731646] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-81b08e11-d562-4171-a8a0-230a33c0203a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.731742] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('81b08e11-d562-4171-a8a0-230a33c0203a',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 874.881670] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2961e549-f7d2-46b0-a1f4-9365d96bb58a in Status: SUCCESS [ 874.881760] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2961e549-f7d2-46b0-a1f4-9365d96bb58a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.237022] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 81b08e11-d562-4171-a8a0-230a33c0203a [ 875.237022] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.237022] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.237022] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.237022] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.237022] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.237022] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:81b08e11-d562-4171-a8a0-230a33c0203a already deleted. [ 875.237022] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-81b08e11-d562-4171-a8a0-230a33c0203a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.422874] env[69980]: INFO networking_nsxv3.common.synchronization [req-baf58361-f003-454a-a49f-41d8ce04bbec req-5fb10033-a62a-4c57-94ab-319b510f5d86 service nova] Enqueued Resource ID: 825b0052-8bd1-4107-8258-075804cbc484 with Priority: HIGHEST for action security_group_rules [ 875.423011] env[69980]: INFO networking_nsxv3.common.synchronization [req-baf58361-f003-454a-a49f-41d8ce04bbec req-5fb10033-a62a-4c57-94ab-319b510f5d86 service nova] Enqueued Resource ID: 825b0052-8bd1-4107-8258-075804cbc484 with Priority: HIGHEST for action security_group_members [ 875.423172] env[69980]: INFO networking_nsxv3.common.synchronization [req-baf58361-f003-454a-a49f-41d8ce04bbec req-5fb10033-a62a-4c57-94ab-319b510f5d86 service nova] Enqueued Resource ID: e5d60ebe-1440-44ce-8d23-1bf3778f635e with Priority: HIGHEST for action port [ 875.423427] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 825b0052-8bd1-4107-8258-075804cbc484 with Priority: HIGHEST for action security_group_rules [ 875.423579] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 825b0052-8bd1-4107-8258-075804cbc484 with Priority: HIGHEST for action security_group_members [ 875.423784] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e5d60ebe-1440-44ce-8d23-1bf3778f635e with Priority: HIGHEST for action port [ 875.426891] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock rules-825b0052-8bd1-4107-8258-075804cbc484 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.427084] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-825b0052-8bd1-4107-8258-075804cbc484" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.427274] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-825b0052-8bd1-4107-8258-075804cbc484" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.427956] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-825b0052-8bd1-4107-8258-075804cbc484" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.427956] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('825b0052-8bd1-4107-8258-075804cbc484',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 875.433478] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-825b0052-8bd1-4107-8258-075804cbc484 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.433699] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-825b0052-8bd1-4107-8258-075804cbc484" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.433820] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-825b0052-8bd1-4107-8258-075804cbc484" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.434130] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-825b0052-8bd1-4107-8258-075804cbc484" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.434395] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.434627] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.434627] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.434860] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.434992] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.435169] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('825b0052-8bd1-4107-8258-075804cbc484',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 875.436513] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock port-e5d60ebe-1440-44ce-8d23-1bf3778f635e taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.436670] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e5d60ebe-1440-44ce-8d23-1bf3778f635e" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.436773] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e5d60ebe-1440-44ce-8d23-1bf3778f635e" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.438894] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e5d60ebe-1440-44ce-8d23-1bf3778f635e" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.438894] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e5d60ebe-1440-44ce-8d23-1bf3778f635e',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 875.770739] env[69980]: INFO networking_nsxv3.common.synchronization [None req-3e6ef89a-035a-4631-99a1-54cfb424dfd2 tempest-ServerActionsTestOtherA-1240783872 tempest-ServerActionsTestOtherA-1240783872-project-member] Enqueued Resource ID: 9057c45b-1d82-49a9-8ffb-aaf0cddf5801 with Priority: HIGHEST for action security_group_rules [ 875.770739] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9057c45b-1d82-49a9-8ffb-aaf0cddf5801 with Priority: HIGHEST for action security_group_rules [ 875.771222] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9057c45b-1d82-49a9-8ffb-aaf0cddf5801 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.771222] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9057c45b-1d82-49a9-8ffb-aaf0cddf5801" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.771222] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9057c45b-1d82-49a9-8ffb-aaf0cddf5801" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.771434] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9057c45b-1d82-49a9-8ffb-aaf0cddf5801" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.771579] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9057c45b-1d82-49a9-8ffb-aaf0cddf5801',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 875.891806] env[69980]: INFO networking_nsxv3.common.synchronization [None req-1303a036-1f88-4a23-9e5d-3879a028918f tempest-ServerActionsTestOtherA-1240783872 tempest-ServerActionsTestOtherA-1240783872-project-member] Enqueued Resource ID: 9057c45b-1d82-49a9-8ffb-aaf0cddf5801 with Priority: HIGHEST for action security_group_rules [ 875.891806] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9057c45b-1d82-49a9-8ffb-aaf0cddf5801 with Priority: HIGHEST for action security_group_rules [ 875.891806] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9057c45b-1d82-49a9-8ffb-aaf0cddf5801 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.891806] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9057c45b-1d82-49a9-8ffb-aaf0cddf5801" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.942651] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-825b0052-8bd1-4107-8258-075804cbc484 taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.944395] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-825b0052-8bd1-4107-8258-075804cbc484" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.944895] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('825b0052-8bd1-4107-8258-075804cbc484',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 875.946237] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e5d60ebe-1440-44ce-8d23-1bf3778f635e with status ACTIVE [ 875.946732] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.947065] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.947274] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.947654] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.947886] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.948260] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.948539] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.948740] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.949066] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.949276] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.949632] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.949900] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.950093] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.950622] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.950854] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.951080] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e5d60ebe-1440-44ce-8d23-1bf3778f635e is going to be updated. [ 875.973127] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.973274] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.973352] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.973560] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.973747] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.973912] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e5d60ebe-1440-44ce-8d23-1bf3778f635e" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.294766] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.294918] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.294982] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.295203] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.295292] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.295389] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9057c45b-1d82-49a9-8ffb-aaf0cddf5801 already deleted. [ 876.295472] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9057c45b-1d82-49a9-8ffb-aaf0cddf5801" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.295622] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9057c45b-1d82-49a9-8ffb-aaf0cddf5801" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.295769] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9057c45b-1d82-49a9-8ffb-aaf0cddf5801" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.295854] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9057c45b-1d82-49a9-8ffb-aaf0cddf5801',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 876.311831] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f2b778ac-011d-472f-9220-d8d50a881380 in Status: SUCCESS [ 876.311972] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f2b778ac-011d-472f-9220-d8d50a881380" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.454150] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('825b0052-8bd1-4107-8258-075804cbc484',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 876.821544] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.821544] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.821544] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.821544] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.821544] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.821544] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9057c45b-1d82-49a9-8ffb-aaf0cddf5801 already deleted. [ 876.821544] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9057c45b-1d82-49a9-8ffb-aaf0cddf5801" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.960511] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.960680] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.960758] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.960954] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.961060] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.961181] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 825b0052-8bd1-4107-8258-075804cbc484 is going to be created. [ 876.990982] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.990982] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.990982] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.990982] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.990982] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.002743] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 825b0052-8bd1-4107-8258-075804cbc484 in Status: UNINITIALIZED for 2s [ 877.034956] env[69980]: INFO networking_nsxv3.common.synchronization [None req-e8cae5c6-b5df-4892-bfbc-9dc7dc929e42 None None] Enqueued Resource ID: 3727c923-f597-4715-92f8-2e0a49d4ddb5 with Priority: HIGHEST for action port [ 877.035230] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3727c923-f597-4715-92f8-2e0a49d4ddb5 with Priority: HIGHEST for action port [ 877.035780] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock port-3727c923-f597-4715-92f8-2e0a49d4ddb5 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.035895] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3727c923-f597-4715-92f8-2e0a49d4ddb5" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.035959] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3727c923-f597-4715-92f8-2e0a49d4ddb5" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.036221] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3727c923-f597-4715-92f8-2e0a49d4ddb5" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.036293] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3727c923-f597-4715-92f8-2e0a49d4ddb5',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 877.540905] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 3727c923-f597-4715-92f8-2e0a49d4ddb5 [ 877.541183] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.541317] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.541448] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.541609] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.541704] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.541825] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:3727c923-f597-4715-92f8-2e0a49d4ddb5 already deleted. [ 877.541883] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3727c923-f597-4715-92f8-2e0a49d4ddb5" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.831322] env[69980]: INFO networking_nsxv3.common.synchronization [req-5623bcbe-6324-4a53-b5b7-c037eabb6fbd req-c7f4d153-ff45-455b-b9fc-0f7025a4797e tempest-ListServerFiltersTestJSON-1624918227 tempest-ListServerFiltersTestJSON-1624918227-project-member] Enqueued Resource ID: 1340506f-247e-457d-b5d5-d9db4d9c0250 with Priority: HIGHEST for action security_group_members [ 878.832069] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1340506f-247e-457d-b5d5-d9db4d9c0250 with Priority: HIGHEST for action security_group_members [ 878.832189] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-1340506f-247e-457d-b5d5-d9db4d9c0250 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.832300] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1340506f-247e-457d-b5d5-d9db4d9c0250" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.832366] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1340506f-247e-457d-b5d5-d9db4d9c0250" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.832699] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1340506f-247e-457d-b5d5-d9db4d9c0250" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.833332] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.834111] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.835144] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.835352] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.835517] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.835570] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1340506f-247e-457d-b5d5-d9db4d9c0250',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 878.914512] env[69980]: INFO networking_nsxv3.common.synchronization [req-127485d3-6d19-456d-adf8-f527d846e043 req-618a1904-08e1-4771-bab3-c1945f97d4ad tempest-ListServersNegativeTestJSON-1235469780 tempest-ListServersNegativeTestJSON-1235469780-project-member] Enqueued Resource ID: 0b52672e-87ad-43b6-b078-903b8601b014 with Priority: HIGHEST for action security_group_members [ 878.914997] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0b52672e-87ad-43b6-b078-903b8601b014 with Priority: HIGHEST for action security_group_members [ 878.915380] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-0b52672e-87ad-43b6-b078-903b8601b014 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.915533] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0b52672e-87ad-43b6-b078-903b8601b014" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.915602] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0b52672e-87ad-43b6-b078-903b8601b014" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.917090] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0b52672e-87ad-43b6-b078-903b8601b014" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.917090] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.917090] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.917090] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.917090] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.917090] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.917090] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0b52672e-87ad-43b6-b078-903b8601b014',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 879.019033] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 825b0052-8bd1-4107-8258-075804cbc484 in Status: SUCCESS [ 879.019534] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-825b0052-8bd1-4107-8258-075804cbc484" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.019835] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-825b0052-8bd1-4107-8258-075804cbc484" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.020274] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-825b0052-8bd1-4107-8258-075804cbc484" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.020656] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.021383] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.021646] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.022039] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.022264] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.022477] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-825b0052-8bd1-4107-8258-075804cbc484" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.022697] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('825b0052-8bd1-4107-8258-075804cbc484',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 879.340898] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.340898] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.340898] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.340898] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.355553] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock network-83 taken with stack trace [, , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.355737] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "network-83" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.355869] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "network-83" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.356254] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "network-83" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.356531] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.356781] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.356840] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.357253] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.357422] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.357636] env[69980]: DEBUG dogpile.cache.region [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] No value present for key: 'zone-id' {{(pid=69980) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 879.357822] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] NeedRegenerationException {{(pid=69980) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 879.357911] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] no value, waiting for create lock {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 879.358025] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] value creation lock acquired {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 879.358138] env[69980]: DEBUG dogpile.cache.region [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] No value present for key: 'zone-id' {{(pid=69980) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 879.358243] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Calling creation function for not-yet-present value {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 879.358376] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 879.392517] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.393067] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.393067] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.393067] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.393279] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.393279] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.393279] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1340506f-247e-457d-b5d5-d9db4d9c0250 is going to be updated. [ 879.421435] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.423924] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.423924] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.423924] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.423924] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.423924] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.423924] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.423924] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.423924] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.423924] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.423924] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0b52672e-87ad-43b6-b078-903b8601b014 already deleted. [ 879.423924] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0b52672e-87ad-43b6-b078-903b8601b014" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.430401] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 879.430704] env[69980]: DEBUG dogpile.cache.region [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Cache value generated in 0.072 seconds for key(s): 'zone-id' {{(pid=69980) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 879.430879] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Released creation lock {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 879.431121] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "network-83" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.431816] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock port-5eea0488-f75f-4255-8704-5822a7456b75 taken with stack trace [, , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.431908] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "port-5eea0488-f75f-4255-8704-5822a7456b75" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.432082] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "port-5eea0488-f75f-4255-8704-5822a7456b75" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.432467] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "port-5eea0488-f75f-4255-8704-5822a7456b75" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.432613] env[69980]: DEBUG networking_nsxv3.api.rpc [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5eea0488-f75f-4255-8704-5822a7456b75',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 879.447392] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.447392] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.447392] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.447392] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.447392] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.470194] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1340506f-247e-457d-b5d5-d9db4d9c0250 in Status: IN_PROGRESS for 2s [ 879.525083] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-825b0052-8bd1-4107-8258-075804cbc484 taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.525275] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-825b0052-8bd1-4107-8258-075804cbc484" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.525962] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-825b0052-8bd1-4107-8258-075804cbc484" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.525962] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-825b0052-8bd1-4107-8258-075804cbc484" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.525962] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.526096] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.526170] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.526344] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.526438] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.527222] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-825b0052-8bd1-4107-8258-075804cbc484" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.527222] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-825b0052-8bd1-4107-8258-075804cbc484 taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.527222] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-825b0052-8bd1-4107-8258-075804cbc484" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.527222] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-825b0052-8bd1-4107-8258-075804cbc484" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.527222] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-825b0052-8bd1-4107-8258-075804cbc484" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.527222] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.527427] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.527497] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.527664] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.527746] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.527874] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-825b0052-8bd1-4107-8258-075804cbc484" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.527985] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('825b0052-8bd1-4107-8258-075804cbc484',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 879.935439] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.935766] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.935895] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.936230] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.937748] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.937841] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Segment Port 5eea0488-f75f-4255-8704-5822a7456b75 not found, creating... [ 879.938064] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.938240] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.938359] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.938601] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.938850] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.939046] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.939442] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.939442] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.939571] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.939652] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.939868] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Resource: SegmentPort with ID: 5eea0488-f75f-4255-8704-5822a7456b75 is going to be created. [ 879.959623] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.959828] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.959950] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.960235] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.960542] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.960779] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "port-5eea0488-f75f-4255-8704-5822a7456b75" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.030599] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 825b0052-8bd1-4107-8258-075804cbc484: rpc.has_security_group_logging(os_id): False [ 880.058108] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.058108] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.058108] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.058108] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.058108] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.058108] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.058108] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.058108] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.058108] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.058108] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.058108] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.058108] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.058108] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.058108] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.058108] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.058837] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.058837] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.058837] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.058837] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.058837] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.058837] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 825b0052-8bd1-4107-8258-075804cbc484 is going to be created. [ 880.200582] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.200776] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.200863] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.201020] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.201235] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.217199] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 825b0052-8bd1-4107-8258-075804cbc484 in Status: IN_PROGRESS for 2s [ 880.671822] env[69980]: INFO networking_nsxv3.common.synchronization [req-127485d3-6d19-456d-adf8-f527d846e043 req-0497fe25-21db-48c8-92d0-a137380b16b4 service nova] Enqueued Resource ID: 0b52672e-87ad-43b6-b078-903b8601b014 with Priority: HIGHEST for action security_group_rules [ 880.672013] env[69980]: INFO networking_nsxv3.common.synchronization [req-127485d3-6d19-456d-adf8-f527d846e043 req-0497fe25-21db-48c8-92d0-a137380b16b4 service nova] Enqueued Resource ID: 0b52672e-87ad-43b6-b078-903b8601b014 with Priority: HIGHEST for action security_group_members [ 880.672156] env[69980]: INFO networking_nsxv3.common.synchronization [req-127485d3-6d19-456d-adf8-f527d846e043 req-0497fe25-21db-48c8-92d0-a137380b16b4 service nova] Enqueued Resource ID: 5eea0488-f75f-4255-8704-5822a7456b75 with Priority: HIGHEST for action port [ 880.672385] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0b52672e-87ad-43b6-b078-903b8601b014 with Priority: HIGHEST for action security_group_rules [ 880.672518] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0b52672e-87ad-43b6-b078-903b8601b014 with Priority: HIGHEST for action security_group_members [ 880.672615] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5eea0488-f75f-4255-8704-5822a7456b75 with Priority: HIGHEST for action port [ 880.677170] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0b52672e-87ad-43b6-b078-903b8601b014 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.677170] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0b52672e-87ad-43b6-b078-903b8601b014" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.677170] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0b52672e-87ad-43b6-b078-903b8601b014" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.677170] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0b52672e-87ad-43b6-b078-903b8601b014" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.677170] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0b52672e-87ad-43b6-b078-903b8601b014',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 880.677170] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-0b52672e-87ad-43b6-b078-903b8601b014 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.677170] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0b52672e-87ad-43b6-b078-903b8601b014" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.677170] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0b52672e-87ad-43b6-b078-903b8601b014" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.677170] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0b52672e-87ad-43b6-b078-903b8601b014" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.677170] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.677170] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.677170] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.677170] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.677170] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.677170] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0b52672e-87ad-43b6-b078-903b8601b014',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 880.677617] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock port-5eea0488-f75f-4255-8704-5822a7456b75 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.677617] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5eea0488-f75f-4255-8704-5822a7456b75" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.677617] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5eea0488-f75f-4255-8704-5822a7456b75" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.677617] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5eea0488-f75f-4255-8704-5822a7456b75" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.677617] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5eea0488-f75f-4255-8704-5822a7456b75',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 881.038974] env[69980]: INFO networking_nsxv3.common.synchronization [req-745e95d4-4769-41bf-8e04-75e2e6f526cd req-d32de522-e1ce-49a5-9498-27995b433dc3 tempest-ImagesTestJSON-600722714 tempest-ImagesTestJSON-600722714-project-member] Enqueued Resource ID: 80e3ea48-91a5-4863-b1c2-f3e887204e39 with Priority: HIGHEST for action security_group_members [ 881.041985] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 80e3ea48-91a5-4863-b1c2-f3e887204e39 with Priority: HIGHEST for action security_group_members [ 881.041985] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-80e3ea48-91a5-4863-b1c2-f3e887204e39 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.041985] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-80e3ea48-91a5-4863-b1c2-f3e887204e39" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.041985] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-80e3ea48-91a5-4863-b1c2-f3e887204e39" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.041985] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-80e3ea48-91a5-4863-b1c2-f3e887204e39" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.041985] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.041985] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.041985] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.041985] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.041985] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.041985] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('80e3ea48-91a5-4863-b1c2-f3e887204e39',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 881.180483] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-0b52672e-87ad-43b6-b078-903b8601b014 taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.180696] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0b52672e-87ad-43b6-b078-903b8601b014" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.180901] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0b52672e-87ad-43b6-b078-903b8601b014',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 881.181782] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 5eea0488-f75f-4255-8704-5822a7456b75 with status ACTIVE [ 881.181994] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.182142] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.182230] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.182436] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.182540] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.182714] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.182812] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.182874] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.183044] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.183167] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.183329] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.183420] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.183480] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.183705] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.183753] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.183828] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 5eea0488-f75f-4255-8704-5822a7456b75 is going to be updated. [ 881.204752] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.204912] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.204972] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.205348] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.205348] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.205505] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5eea0488-f75f-4255-8704-5822a7456b75" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.479128] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1340506f-247e-457d-b5d5-d9db4d9c0250 in Status: SUCCESS [ 881.479676] env[69980]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1340506f-247e-457d-b5d5-d9db4d9c0250 deletion is rescheduled due to dependency. [ 881.479676] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1340506f-247e-457d-b5d5-d9db4d9c0250" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.550315] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.550517] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.550578] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.550830] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.573553] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.573865] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.573992] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.574072] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.574290] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.574377] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.574470] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 80e3ea48-91a5-4863-b1c2-f3e887204e39 is going to be updated. [ 881.603471] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.603618] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.603791] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.604075] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.604248] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.615289] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 80e3ea48-91a5-4863-b1c2-f3e887204e39 in Status: IN_PROGRESS for 2s [ 881.686232] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0b52672e-87ad-43b6-b078-903b8601b014',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 881.892349] env[69980]: INFO networking_nsxv3.common.synchronization [req-020c68b7-570f-42c9-85a2-d9a95380d5bf req-a0f39c84-5e03-4284-9e38-38c206ef8ab5 tempest-ServersAdminNegativeTestJSON-1599780358 tempest-ServersAdminNegativeTestJSON-1599780358-project-member] Enqueued Resource ID: 2961e549-f7d2-46b0-a1f4-9365d96bb58a with Priority: HIGHEST for action security_group_members [ 881.892581] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2961e549-f7d2-46b0-a1f4-9365d96bb58a with Priority: HIGHEST for action security_group_members [ 881.892895] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-2961e549-f7d2-46b0-a1f4-9365d96bb58a taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.893030] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2961e549-f7d2-46b0-a1f4-9365d96bb58a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.898839] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2961e549-f7d2-46b0-a1f4-9365d96bb58a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.898839] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2961e549-f7d2-46b0-a1f4-9365d96bb58a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.898839] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.898839] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.898839] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.898839] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.898839] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.898839] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2961e549-f7d2-46b0-a1f4-9365d96bb58a',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 882.189085] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.189393] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.189393] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.189566] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.190175] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.190175] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0b52672e-87ad-43b6-b078-903b8601b014 is going to be created. [ 882.212942] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.213169] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.213233] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.213401] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.213568] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.225068] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0b52672e-87ad-43b6-b078-903b8601b014 in Status: UNINITIALIZED for 2s [ 882.229336] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 825b0052-8bd1-4107-8258-075804cbc484 in Status: SUCCESS [ 882.229634] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-825b0052-8bd1-4107-8258-075804cbc484" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.280532] env[69980]: INFO networking_nsxv3.common.synchronization [None req-97e31fb1-573b-433c-87d5-f1afda20c16a tempest-ImagesOneServerNegativeTestJSON-332667785 tempest-ImagesOneServerNegativeTestJSON-332667785-project-member] Enqueued Resource ID: 44326c43-2167-461b-82da-980d133cab8d with Priority: HIGHEST for action security_group_rules [ 882.280532] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 44326c43-2167-461b-82da-980d133cab8d with Priority: HIGHEST for action security_group_rules [ 882.280532] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock rules-44326c43-2167-461b-82da-980d133cab8d taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.280532] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-44326c43-2167-461b-82da-980d133cab8d" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.280532] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-44326c43-2167-461b-82da-980d133cab8d" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.280532] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-44326c43-2167-461b-82da-980d133cab8d" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.281027] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('44326c43-2167-461b-82da-980d133cab8d',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 882.380298] env[69980]: INFO networking_nsxv3.common.synchronization [None req-c90ab9b5-1f0f-44b0-a2ff-ebc996c2e383 tempest-ImagesOneServerNegativeTestJSON-332667785 tempest-ImagesOneServerNegativeTestJSON-332667785-project-member] Enqueued Resource ID: 44326c43-2167-461b-82da-980d133cab8d with Priority: HIGHEST for action security_group_rules [ 882.380868] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 44326c43-2167-461b-82da-980d133cab8d with Priority: HIGHEST for action security_group_rules [ 882.381179] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock rules-44326c43-2167-461b-82da-980d133cab8d taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.381279] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-44326c43-2167-461b-82da-980d133cab8d" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.398973] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2961e549-f7d2-46b0-a1f4-9365d96bb58a',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 882.803603] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.803824] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.803906] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.804144] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.804240] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.804337] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 44326c43-2167-461b-82da-980d133cab8d already deleted. [ 882.804421] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-44326c43-2167-461b-82da-980d133cab8d" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.804573] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-44326c43-2167-461b-82da-980d133cab8d" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.804732] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-44326c43-2167-461b-82da-980d133cab8d" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.804857] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('44326c43-2167-461b-82da-980d133cab8d',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 882.900888] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2961e549-f7d2-46b0-a1f4-9365d96bb58a',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 883.324197] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.324504] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.324504] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.324701] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.324804] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.324897] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 44326c43-2167-461b-82da-980d133cab8d already deleted. [ 883.324977] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-44326c43-2167-461b-82da-980d133cab8d" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.403596] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.404835] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.404835] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.404835] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.404835] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.404835] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2961e549-f7d2-46b0-a1f4-9365d96bb58a is going to be updated. [ 883.439096] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.439352] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.439352] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.439538] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.439673] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.449893] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2961e549-f7d2-46b0-a1f4-9365d96bb58a in Status: IN_PROGRESS for 2s [ 883.626059] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 80e3ea48-91a5-4863-b1c2-f3e887204e39 in Status: IN_PROGRESS for 4s [ 884.239225] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0b52672e-87ad-43b6-b078-903b8601b014 in Status: SUCCESS [ 884.239449] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0b52672e-87ad-43b6-b078-903b8601b014" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.240030] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0b52672e-87ad-43b6-b078-903b8601b014" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.240030] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0b52672e-87ad-43b6-b078-903b8601b014" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.240168] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.240228] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.240297] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.240507] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.240788] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.240877] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0b52672e-87ad-43b6-b078-903b8601b014" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.241029] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('0b52672e-87ad-43b6-b078-903b8601b014',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 884.743238] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-0b52672e-87ad-43b6-b078-903b8601b014 taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.743555] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0b52672e-87ad-43b6-b078-903b8601b014" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.743555] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0b52672e-87ad-43b6-b078-903b8601b014" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.744943] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0b52672e-87ad-43b6-b078-903b8601b014" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.744943] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.744943] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.744943] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.744943] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.744943] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.744943] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0b52672e-87ad-43b6-b078-903b8601b014" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.744943] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-0b52672e-87ad-43b6-b078-903b8601b014 taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.745560] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0b52672e-87ad-43b6-b078-903b8601b014" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.745560] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0b52672e-87ad-43b6-b078-903b8601b014" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.745560] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0b52672e-87ad-43b6-b078-903b8601b014" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.745560] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.745560] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.745560] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.745864] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.745864] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.745864] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0b52672e-87ad-43b6-b078-903b8601b014" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.745864] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('0b52672e-87ad-43b6-b078-903b8601b014',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 885.248428] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 0b52672e-87ad-43b6-b078-903b8601b014: rpc.has_security_group_logging(os_id): False [ 885.266794] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.266952] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.267033] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.267250] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.267343] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.267555] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.267653] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.267717] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.267867] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.267944] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.268136] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.268227] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.268287] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.268421] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.268493] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.268667] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.268758] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.268819] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.268949] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.269052] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.269145] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0b52672e-87ad-43b6-b078-903b8601b014 is going to be created. [ 885.351771] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.351911] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.351980] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.352209] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.352926] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.366569] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0b52672e-87ad-43b6-b078-903b8601b014 in Status: IN_PROGRESS for 2s [ 885.465010] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2961e549-f7d2-46b0-a1f4-9365d96bb58a in Status: SUCCESS [ 885.465010] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2961e549-f7d2-46b0-a1f4-9365d96bb58a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.636194] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 80e3ea48-91a5-4863-b1c2-f3e887204e39 in Status: SUCCESS [ 885.636463] env[69980]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 80e3ea48-91a5-4863-b1c2-f3e887204e39 deletion is rescheduled due to dependency. [ 885.636581] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-80e3ea48-91a5-4863-b1c2-f3e887204e39" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.872829] env[69980]: INFO networking_nsxv3.common.synchronization [req-e83dd006-3880-437a-9056-8dbc8b6ddb44 req-67397cef-c6e4-4667-ad93-708b1da2fd29 tempest-ServerDiskConfigTestJSON-214268531 tempest-ServerDiskConfigTestJSON-214268531-project-member] Enqueued Resource ID: 0dbf2bcd-0572-43ef-b18d-cc3cca7fcfd5 with Priority: HIGHEST for action security_group_members [ 885.873141] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0dbf2bcd-0572-43ef-b18d-cc3cca7fcfd5 with Priority: HIGHEST for action security_group_members [ 885.873439] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-0dbf2bcd-0572-43ef-b18d-cc3cca7fcfd5 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.873561] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0dbf2bcd-0572-43ef-b18d-cc3cca7fcfd5" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.873627] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0dbf2bcd-0572-43ef-b18d-cc3cca7fcfd5" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.873903] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0dbf2bcd-0572-43ef-b18d-cc3cca7fcfd5" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.874791] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.874791] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.874791] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.874791] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.874791] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.874791] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0dbf2bcd-0572-43ef-b18d-cc3cca7fcfd5',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 885.944207] env[69980]: INFO networking_nsxv3.common.synchronization [req-8a4847f2-134d-43c0-9d69-afebf33950c7 req-9dbfcc17-8092-49fb-bd28-9ed732a3e0ab tempest-InstanceActionsNegativeTestJSON-1747841294 tempest-InstanceActionsNegativeTestJSON-1747841294-project-member] Enqueued Resource ID: 825b0052-8bd1-4107-8258-075804cbc484 with Priority: HIGHEST for action security_group_members [ 885.944552] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 825b0052-8bd1-4107-8258-075804cbc484 with Priority: HIGHEST for action security_group_members [ 885.946959] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-825b0052-8bd1-4107-8258-075804cbc484 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.947264] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-825b0052-8bd1-4107-8258-075804cbc484" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.947434] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-825b0052-8bd1-4107-8258-075804cbc484" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.947825] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-825b0052-8bd1-4107-8258-075804cbc484" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.948181] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.948567] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.948717] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.948963] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.949350] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.949598] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('825b0052-8bd1-4107-8258-075804cbc484',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 886.379448] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.379648] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.379729] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.379988] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.380135] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.380367] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.380490] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.380573] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.380752] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.380858] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.380951] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0dbf2bcd-0572-43ef-b18d-cc3cca7fcfd5 is going to be updated. [ 886.416503] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.416715] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.416715] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.416930] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.417087] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.431044] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0dbf2bcd-0572-43ef-b18d-cc3cca7fcfd5 in Status: IN_PROGRESS for 2s [ 886.451661] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.451845] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.451917] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.452155] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.452253] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.452452] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.452551] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.452615] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.452768] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.452847] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.452933] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 825b0052-8bd1-4107-8258-075804cbc484 is going to be updated. [ 886.484370] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.484514] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.484588] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.484802] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.484936] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.496202] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 825b0052-8bd1-4107-8258-075804cbc484 in Status: IN_PROGRESS for 2s [ 886.880345] env[69980]: INFO networking_nsxv3.common.synchronization [req-127485d3-6d19-456d-adf8-f527d846e043 req-66238662-1ac5-4ebe-850b-078a0a15f809 tempest-ListServersNegativeTestJSON-1235469780 tempest-ListServersNegativeTestJSON-1235469780-project-member] Enqueued Resource ID: 0b52672e-87ad-43b6-b078-903b8601b014 with Priority: HIGHEST for action security_group_members [ 886.880345] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0b52672e-87ad-43b6-b078-903b8601b014 with Priority: HIGHEST for action security_group_members [ 886.880345] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-0b52672e-87ad-43b6-b078-903b8601b014 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.880345] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0b52672e-87ad-43b6-b078-903b8601b014" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.880345] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0b52672e-87ad-43b6-b078-903b8601b014" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.880345] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0b52672e-87ad-43b6-b078-903b8601b014" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.880767] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.880981] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.881172] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.881414] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.881590] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.881789] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0b52672e-87ad-43b6-b078-903b8601b014',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 887.215523] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock network-83 taken with stack trace [, , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.215750] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "network-83" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.215850] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "network-83" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.216136] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "network-83" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.217008] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.217008] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.217008] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.217008] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.217249] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.217384] env[69980]: DEBUG dogpile.cache.region [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] No value present for key: 'zone-id' {{(pid=69980) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 887.217495] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] NeedRegenerationException {{(pid=69980) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 887.217601] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] no value, waiting for create lock {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 887.217707] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] value creation lock acquired {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 887.218513] env[69980]: DEBUG dogpile.cache.region [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] No value present for key: 'zone-id' {{(pid=69980) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 887.218513] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Calling creation function for not-yet-present value {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 887.218513] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 887.240538] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 887.240710] env[69980]: DEBUG dogpile.cache.region [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=69980) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 887.240850] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Released creation lock {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 887.241093] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "network-83" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.242051] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock port-706392e2-0801-4251-9cea-b280d37ecbcb taken with stack trace [, , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.242051] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "port-706392e2-0801-4251-9cea-b280d37ecbcb" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.242051] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "port-706392e2-0801-4251-9cea-b280d37ecbcb" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.242364] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "port-706392e2-0801-4251-9cea-b280d37ecbcb" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.242584] env[69980]: DEBUG networking_nsxv3.api.rpc [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('706392e2-0801-4251-9cea-b280d37ecbcb',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 887.384161] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0b52672e-87ad-43b6-b078-903b8601b014',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 887.426573] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0b52672e-87ad-43b6-b078-903b8601b014 in Status: SUCCESS [ 887.426573] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0b52672e-87ad-43b6-b078-903b8601b014" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.746123] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.746249] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.746288] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.746547] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.746700] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.746880] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Segment Port 706392e2-0801-4251-9cea-b280d37ecbcb not found, creating... [ 887.747176] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.747402] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.747456] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.747664] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.747802] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.748101] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.748263] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.748383] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.748636] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.748719] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.748862] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Resource: SegmentPort with ID: 706392e2-0801-4251-9cea-b280d37ecbcb is going to be created. [ 887.789971] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.790210] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.790337] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.790587] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.790806] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.791069] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "port-706392e2-0801-4251-9cea-b280d37ecbcb" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.885927] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0b52672e-87ad-43b6-b078-903b8601b014',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 888.391255] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.391255] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.391255] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.391255] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.391255] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.391255] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0b52672e-87ad-43b6-b078-903b8601b014 is going to be updated. [ 888.421162] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.421162] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.421162] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.421162] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.421162] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.432229] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0b52672e-87ad-43b6-b078-903b8601b014 in Status: IN_PROGRESS for 2s [ 888.439597] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0dbf2bcd-0572-43ef-b18d-cc3cca7fcfd5 in Status: SUCCESS [ 888.439597] env[69980]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0dbf2bcd-0572-43ef-b18d-cc3cca7fcfd5 deletion is rescheduled due to dependency. [ 888.439597] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0dbf2bcd-0572-43ef-b18d-cc3cca7fcfd5" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.505733] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 825b0052-8bd1-4107-8258-075804cbc484 in Status: SUCCESS [ 888.505928] env[69980]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 825b0052-8bd1-4107-8258-075804cbc484 deletion is rescheduled due to dependency. [ 888.505928] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-825b0052-8bd1-4107-8258-075804cbc484" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.752018] env[69980]: INFO networking_nsxv3.common.synchronization [req-127485d3-6d19-456d-adf8-f527d846e043 req-86dc264c-1421-43cf-b412-00ac5ad36b28 service nova] Enqueued Resource ID: 0b52672e-87ad-43b6-b078-903b8601b014 with Priority: HIGHEST for action security_group_rules [ 888.752018] env[69980]: INFO networking_nsxv3.common.synchronization [req-127485d3-6d19-456d-adf8-f527d846e043 req-86dc264c-1421-43cf-b412-00ac5ad36b28 service nova] Enqueued Resource ID: 0b52672e-87ad-43b6-b078-903b8601b014 with Priority: HIGHEST for action security_group_members [ 888.752018] env[69980]: INFO networking_nsxv3.common.synchronization [req-127485d3-6d19-456d-adf8-f527d846e043 req-86dc264c-1421-43cf-b412-00ac5ad36b28 service nova] Enqueued Resource ID: 706392e2-0801-4251-9cea-b280d37ecbcb with Priority: HIGHEST for action port [ 888.752018] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0b52672e-87ad-43b6-b078-903b8601b014 with Priority: HIGHEST for action security_group_rules [ 888.752018] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0b52672e-87ad-43b6-b078-903b8601b014 with Priority: HIGHEST for action security_group_members [ 888.752018] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 706392e2-0801-4251-9cea-b280d37ecbcb with Priority: HIGHEST for action port [ 888.752934] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0b52672e-87ad-43b6-b078-903b8601b014 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.753528] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0b52672e-87ad-43b6-b078-903b8601b014" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.753528] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0b52672e-87ad-43b6-b078-903b8601b014" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.753528] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0b52672e-87ad-43b6-b078-903b8601b014" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.753528] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0b52672e-87ad-43b6-b078-903b8601b014',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 888.754411] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-0b52672e-87ad-43b6-b078-903b8601b014 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.754506] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0b52672e-87ad-43b6-b078-903b8601b014" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.754680] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock port-706392e2-0801-4251-9cea-b280d37ecbcb taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.755729] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-706392e2-0801-4251-9cea-b280d37ecbcb" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.755729] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-706392e2-0801-4251-9cea-b280d37ecbcb" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.755729] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-706392e2-0801-4251-9cea-b280d37ecbcb" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.755729] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('706392e2-0801-4251-9cea-b280d37ecbcb',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 889.257751] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-0b52672e-87ad-43b6-b078-903b8601b014 taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.257751] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0b52672e-87ad-43b6-b078-903b8601b014" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.257751] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 706392e2-0801-4251-9cea-b280d37ecbcb with status ACTIVE [ 889.257751] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.258385] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.258385] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.258385] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.258385] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.258555] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.258651] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.258715] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.258938] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.258938] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.259132] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.259221] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.259281] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.259418] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.259491] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.259573] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 706392e2-0801-4251-9cea-b280d37ecbcb is going to be updated. [ 889.282394] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.282582] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.283187] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.283187] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.283187] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.283291] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-706392e2-0801-4251-9cea-b280d37ecbcb" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.554865] env[69980]: INFO networking_nsxv3.common.synchronization [req-127485d3-6d19-456d-adf8-f527d846e043 req-d7323d29-fe00-4caf-8ad4-14259e37c867 tempest-ListServersNegativeTestJSON-1235469780 tempest-ListServersNegativeTestJSON-1235469780-project-member] Enqueued Resource ID: 0b52672e-87ad-43b6-b078-903b8601b014 with Priority: HIGHEST for action security_group_members [ 889.555553] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0b52672e-87ad-43b6-b078-903b8601b014 with Priority: HIGHEST for action security_group_members [ 889.555854] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-0b52672e-87ad-43b6-b078-903b8601b014 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.555953] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0b52672e-87ad-43b6-b078-903b8601b014" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.895644] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock network-83 taken with stack trace [, , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.895644] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "network-83" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.895762] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "network-83" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.896014] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "network-83" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.896278] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.896434] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.896552] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.896776] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.896925] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.897143] env[69980]: DEBUG dogpile.cache.region [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] No value present for key: 'zone-id' {{(pid=69980) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 889.897259] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] NeedRegenerationException {{(pid=69980) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 889.897366] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] no value, waiting for create lock {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 889.897489] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] value creation lock acquired {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 889.897573] env[69980]: DEBUG dogpile.cache.region [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] No value present for key: 'zone-id' {{(pid=69980) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 889.897677] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Calling creation function for not-yet-present value {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 889.897845] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 889.916074] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 889.916240] env[69980]: DEBUG dogpile.cache.region [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=69980) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 889.916376] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Released creation lock {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 889.916536] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "network-83" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.916877] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock port-ae872970-2c94-42c4-908d-34839f0f7c8a taken with stack trace [, , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.916957] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "port-ae872970-2c94-42c4-908d-34839f0f7c8a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.917089] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "port-ae872970-2c94-42c4-908d-34839f0f7c8a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.917384] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "port-ae872970-2c94-42c4-908d-34839f0f7c8a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.917522] env[69980]: DEBUG networking_nsxv3.api.rpc [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ae872970-2c94-42c4-908d-34839f0f7c8a',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 890.425855] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.426208] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.426273] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.426530] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.426686] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.426841] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Segment Port ae872970-2c94-42c4-908d-34839f0f7c8a not found, creating... [ 890.427125] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.427281] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.427399] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.427616] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.427756] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.428045] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.428203] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.428319] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.428522] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.428657] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.428796] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Resource: SegmentPort with ID: ae872970-2c94-42c4-908d-34839f0f7c8a is going to be created. [ 890.441651] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0b52672e-87ad-43b6-b078-903b8601b014 in Status: SUCCESS [ 890.441992] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0b52672e-87ad-43b6-b078-903b8601b014" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.442353] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0b52672e-87ad-43b6-b078-903b8601b014" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.442648] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0b52672e-87ad-43b6-b078-903b8601b014" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.442910] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.443104] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.443217] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.443487] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.443578] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.443734] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0b52672e-87ad-43b6-b078-903b8601b014',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 890.449804] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.450110] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.450294] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.450599] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.450890] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.451976] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "port-ae872970-2c94-42c4-908d-34839f0f7c8a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.946834] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0b52672e-87ad-43b6-b078-903b8601b014',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 891.204355] env[69980]: INFO networking_nsxv3.common.synchronization [req-127485d3-6d19-456d-adf8-f527d846e043 req-dcb25b2c-f6dc-4aa8-bfaf-75f64efbda44 service nova] Enqueued Resource ID: 0b52672e-87ad-43b6-b078-903b8601b014 with Priority: HIGHEST for action security_group_rules [ 891.204464] env[69980]: INFO networking_nsxv3.common.synchronization [req-127485d3-6d19-456d-adf8-f527d846e043 req-dcb25b2c-f6dc-4aa8-bfaf-75f64efbda44 service nova] Enqueued Resource ID: 0b52672e-87ad-43b6-b078-903b8601b014 with Priority: HIGHEST for action security_group_members [ 891.204608] env[69980]: INFO networking_nsxv3.common.synchronization [req-127485d3-6d19-456d-adf8-f527d846e043 req-dcb25b2c-f6dc-4aa8-bfaf-75f64efbda44 service nova] Enqueued Resource ID: ae872970-2c94-42c4-908d-34839f0f7c8a with Priority: HIGHEST for action port [ 891.204829] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0b52672e-87ad-43b6-b078-903b8601b014 with Priority: HIGHEST for action security_group_rules [ 891.204964] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0b52672e-87ad-43b6-b078-903b8601b014 with Priority: HIGHEST for action security_group_members [ 891.205074] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ae872970-2c94-42c4-908d-34839f0f7c8a with Priority: HIGHEST for action port [ 891.205594] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0b52672e-87ad-43b6-b078-903b8601b014 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.205699] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0b52672e-87ad-43b6-b078-903b8601b014" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.205886] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-0b52672e-87ad-43b6-b078-903b8601b014 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.205971] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0b52672e-87ad-43b6-b078-903b8601b014" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.206447] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock port-ae872970-2c94-42c4-908d-34839f0f7c8a taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.206559] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ae872970-2c94-42c4-908d-34839f0f7c8a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.206625] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ae872970-2c94-42c4-908d-34839f0f7c8a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.206820] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ae872970-2c94-42c4-908d-34839f0f7c8a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.206904] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ae872970-2c94-42c4-908d-34839f0f7c8a',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 891.448767] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0b52672e-87ad-43b6-b078-903b8601b014',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 891.710171] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port ae872970-2c94-42c4-908d-34839f0f7c8a with status ACTIVE [ 891.710171] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.710171] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.710171] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.710171] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.710171] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.710423] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.710423] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.710500] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.710614] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.710690] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.711077] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.711077] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.711077] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.711244] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.711244] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.711307] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: ae872970-2c94-42c4-908d-34839f0f7c8a is going to be updated. [ 891.744898] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.745046] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.745127] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.745321] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.745481] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.745598] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ae872970-2c94-42c4-908d-34839f0f7c8a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.956424] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.956424] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.956424] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.956424] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.956424] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.956424] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0b52672e-87ad-43b6-b078-903b8601b014 is going to be updated. [ 891.986748] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.986899] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.986970] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.987186] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.987329] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.998057] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0b52672e-87ad-43b6-b078-903b8601b014 in Status: IN_PROGRESS for 2s [ 894.010677] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0b52672e-87ad-43b6-b078-903b8601b014 in Status: SUCCESS [ 894.010963] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0b52672e-87ad-43b6-b078-903b8601b014" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.011059] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0b52672e-87ad-43b6-b078-903b8601b014" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.011268] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0b52672e-87ad-43b6-b078-903b8601b014" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.011457] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.011571] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.011636] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.011803] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.011891] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.011951] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0b52672e-87ad-43b6-b078-903b8601b014" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.012060] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('0b52672e-87ad-43b6-b078-903b8601b014',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 894.012833] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0b52672e-87ad-43b6-b078-903b8601b014" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.013016] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0b52672e-87ad-43b6-b078-903b8601b014" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.013166] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.013266] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.013328] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.013464] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.013541] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.013625] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0b52672e-87ad-43b6-b078-903b8601b014',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 894.515478] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-0b52672e-87ad-43b6-b078-903b8601b014 taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.515651] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0b52672e-87ad-43b6-b078-903b8601b014" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.515847] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0b52672e-87ad-43b6-b078-903b8601b014',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 895.017990] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0b52672e-87ad-43b6-b078-903b8601b014',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 895.522458] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.522458] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.522458] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.522458] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.522458] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.522458] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0b52672e-87ad-43b6-b078-903b8601b014 is going to be updated. [ 895.551243] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.551398] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.551492] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.551663] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.551808] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.561019] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0b52672e-87ad-43b6-b078-903b8601b014 in Status: IN_PROGRESS for 2s [ 896.206106] env[69980]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 896.206106] env[69980]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=4 [ 897.571749] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0b52672e-87ad-43b6-b078-903b8601b014 in Status: SUCCESS [ 897.572047] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0b52672e-87ad-43b6-b078-903b8601b014" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.572261] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0b52672e-87ad-43b6-b078-903b8601b014" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.572495] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0b52672e-87ad-43b6-b078-903b8601b014" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.572754] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.572903] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.572986] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.573193] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.573282] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.573423] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0b52672e-87ad-43b6-b078-903b8601b014',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 898.080407] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0b52672e-87ad-43b6-b078-903b8601b014',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 898.583234] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0b52672e-87ad-43b6-b078-903b8601b014',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 899.086054] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.086054] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.086054] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.086321] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.086418] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.086523] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0b52672e-87ad-43b6-b078-903b8601b014 is going to be updated. [ 899.137926] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.138145] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.138219] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.138506] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.138701] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.152182] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0b52672e-87ad-43b6-b078-903b8601b014 in Status: IN_PROGRESS for 2s [ 900.052128] env[69980]: INFO networking_nsxv3.common.synchronization [req-0afadbbd-ec4a-461c-93c5-c4291ca981ed req-e5e2f25e-772d-477d-b61a-f075e8ba81f9 tempest-ServersWithSpecificFlavorTestJSON-977701913 tempest-ServersWithSpecificFlavorTestJSON-977701913-project-member] Enqueued Resource ID: 3b94a139-70f4-4b1b-82e2-803c78f509bf with Priority: HIGHEST for action security_group_members [ 900.052688] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3b94a139-70f4-4b1b-82e2-803c78f509bf with Priority: HIGHEST for action security_group_members [ 900.052989] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-3b94a139-70f4-4b1b-82e2-803c78f509bf taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.053139] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3b94a139-70f4-4b1b-82e2-803c78f509bf" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.053207] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3b94a139-70f4-4b1b-82e2-803c78f509bf" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.053401] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3b94a139-70f4-4b1b-82e2-803c78f509bf" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.053560] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.053662] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.053724] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.053903] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.053990] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.057656] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3b94a139-70f4-4b1b-82e2-803c78f509bf',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 900.563180] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.563387] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.563487] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.563778] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.601491] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.601491] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.601491] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.601491] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.601812] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.601843] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.602038] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3b94a139-70f4-4b1b-82e2-803c78f509bf is going to be updated. [ 900.660824] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.660989] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.661077] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.661291] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.661456] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.670459] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3b94a139-70f4-4b1b-82e2-803c78f509bf in Status: IN_PROGRESS for 2s [ 900.832108] env[69980]: INFO networking_nsxv3.common.synchronization [req-ba6b1158-716e-4ecf-9029-032e28a8e45e req-4560f108-5436-4ce8-baad-5f8932214e2e tempest-ListServersNegativeTestJSON-1235469780 tempest-ListServersNegativeTestJSON-1235469780-project-member] Enqueued Resource ID: 0b52672e-87ad-43b6-b078-903b8601b014 with Priority: HIGHEST for action security_group_members [ 900.832959] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0b52672e-87ad-43b6-b078-903b8601b014 with Priority: HIGHEST for action security_group_members [ 900.833678] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-0b52672e-87ad-43b6-b078-903b8601b014 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.834084] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0b52672e-87ad-43b6-b078-903b8601b014" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.162835] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0b52672e-87ad-43b6-b078-903b8601b014 in Status: SUCCESS [ 901.163185] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0b52672e-87ad-43b6-b078-903b8601b014" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.163438] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0b52672e-87ad-43b6-b078-903b8601b014" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.163762] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0b52672e-87ad-43b6-b078-903b8601b014" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.164087] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.164315] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.164390] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.164674] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.164829] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.164975] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0b52672e-87ad-43b6-b078-903b8601b014" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.165278] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-0b52672e-87ad-43b6-b078-903b8601b014 taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.165437] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0b52672e-87ad-43b6-b078-903b8601b014" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.165555] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0b52672e-87ad-43b6-b078-903b8601b014" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.165836] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0b52672e-87ad-43b6-b078-903b8601b014" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.166068] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.166244] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.166345] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.166634] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.166771] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.166900] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0b52672e-87ad-43b6-b078-903b8601b014" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.167050] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('0b52672e-87ad-43b6-b078-903b8601b014',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 901.168176] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0b52672e-87ad-43b6-b078-903b8601b014" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.168406] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0b52672e-87ad-43b6-b078-903b8601b014" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.168628] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.168782] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.168887] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.169121] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.169248] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.169407] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0b52672e-87ad-43b6-b078-903b8601b014',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 901.672103] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 0b52672e-87ad-43b6-b078-903b8601b014: rpc.has_security_group_logging(os_id): False [ 901.673819] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0b52672e-87ad-43b6-b078-903b8601b014',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 901.696355] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.696556] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.696556] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.696792] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.696889] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.697131] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.697238] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.697302] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.697456] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.697535] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.697729] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.697825] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.697887] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.698039] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.698116] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.698294] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.698683] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.698774] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.698921] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.699012] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.699098] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0b52672e-87ad-43b6-b078-903b8601b014 is going to be updated. [ 901.768917] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.769109] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.769164] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.769365] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.769512] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.783015] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0b52672e-87ad-43b6-b078-903b8601b014 in Status: IN_PROGRESS for 2s [ 902.178087] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0b52672e-87ad-43b6-b078-903b8601b014',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 902.681031] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.681189] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.681266] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.681490] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.681584] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.681677] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0b52672e-87ad-43b6-b078-903b8601b014 is going to be updated. [ 902.683462] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3b94a139-70f4-4b1b-82e2-803c78f509bf in Status: SUCCESS [ 902.683632] env[69980]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3b94a139-70f4-4b1b-82e2-803c78f509bf deletion is rescheduled due to dependency. [ 902.683730] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3b94a139-70f4-4b1b-82e2-803c78f509bf" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.721164] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.721321] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.721363] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.721538] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.721679] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.734104] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0b52672e-87ad-43b6-b078-903b8601b014 in Status: IN_PROGRESS for 2s [ 903.140830] env[69980]: INFO networking_nsxv3.common.synchronization [req-1999f028-74b5-44b5-a2e5-cd3f70918841 req-f8c50d57-8efa-485e-9417-2bb4a7b6917f tempest-VolumesAdminNegativeTest-1476822754 tempest-VolumesAdminNegativeTest-1476822754-project-member] Enqueued Resource ID: 90ae0583-7d65-4cd4-8205-17d3726a65ac with Priority: HIGHEST for action security_group_members [ 903.141367] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 90ae0583-7d65-4cd4-8205-17d3726a65ac with Priority: HIGHEST for action security_group_members [ 903.141663] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-90ae0583-7d65-4cd4-8205-17d3726a65ac taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.141806] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-90ae0583-7d65-4cd4-8205-17d3726a65ac" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.141919] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-90ae0583-7d65-4cd4-8205-17d3726a65ac" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.142123] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-90ae0583-7d65-4cd4-8205-17d3726a65ac" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.142281] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.142380] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.142443] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.142594] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.142680] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.142774] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('90ae0583-7d65-4cd4-8205-17d3726a65ac',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 903.437193] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock network-131 taken with stack trace [, , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.437193] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "network-131" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.437193] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "network-131" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.437193] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "network-131" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.437193] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.437193] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.437193] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.437909] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.438219] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.441338] env[69980]: DEBUG dogpile.cache.region [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] No value present for key: 'zone-id' {{(pid=69980) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 903.441338] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] NeedRegenerationException {{(pid=69980) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 903.441338] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] no value, waiting for create lock {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 903.441338] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] value creation lock acquired {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 903.441338] env[69980]: DEBUG dogpile.cache.region [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] No value present for key: 'zone-id' {{(pid=69980) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 903.441338] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Calling creation function for not-yet-present value {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 903.441338] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 903.459872] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 903.459872] env[69980]: DEBUG dogpile.cache.region [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=69980) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 903.459872] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Released creation lock {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 903.459872] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "network-131" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.459872] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock port-1d8fe340-0e40-4d6e-8756-d6192f3394f8 taken with stack trace [, , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.459872] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "port-1d8fe340-0e40-4d6e-8756-d6192f3394f8" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.459872] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "port-1d8fe340-0e40-4d6e-8756-d6192f3394f8" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.459872] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "port-1d8fe340-0e40-4d6e-8756-d6192f3394f8" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.459872] env[69980]: DEBUG networking_nsxv3.api.rpc [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1d8fe340-0e40-4d6e-8756-d6192f3394f8',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 903.645524] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.645699] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.645775] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.646007] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.646116] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.646337] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.646432] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.646497] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.646648] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.646726] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.646810] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 90ae0583-7d65-4cd4-8205-17d3726a65ac already deleted. [ 903.646902] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-90ae0583-7d65-4cd4-8205-17d3726a65ac" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.795397] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0b52672e-87ad-43b6-b078-903b8601b014 in Status: SUCCESS [ 903.795626] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0b52672e-87ad-43b6-b078-903b8601b014" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.795799] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0b52672e-87ad-43b6-b078-903b8601b014" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.796030] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0b52672e-87ad-43b6-b078-903b8601b014" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.796125] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0b52672e-87ad-43b6-b078-903b8601b014',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 903.962046] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.962285] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.962413] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.962681] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.962826] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.963014] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Segment Port 1d8fe340-0e40-4d6e-8756-d6192f3394f8 not found, creating... [ 903.963249] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.963403] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.963517] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.963722] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.963855] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.964189] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.964345] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.964461] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.964665] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.964798] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.964951] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Resource: SegmentPort with ID: 1d8fe340-0e40-4d6e-8756-d6192f3394f8 is going to be created. [ 903.994424] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.994658] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.994788] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.995092] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.995315] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.995540] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "port-1d8fe340-0e40-4d6e-8756-d6192f3394f8" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.298818] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-0b52672e-87ad-43b6-b078-903b8601b014 taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.299047] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0b52672e-87ad-43b6-b078-903b8601b014" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.745296] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0b52672e-87ad-43b6-b078-903b8601b014 in Status: SUCCESS [ 904.745561] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0b52672e-87ad-43b6-b078-903b8601b014" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.745778] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0b52672e-87ad-43b6-b078-903b8601b014" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.746073] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0b52672e-87ad-43b6-b078-903b8601b014" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.746348] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.746529] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.746629] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.746858] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.746996] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.747160] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0b52672e-87ad-43b6-b078-903b8601b014" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.747307] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('0b52672e-87ad-43b6-b078-903b8601b014',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 904.763128] env[69980]: INFO networking_nsxv3.common.synchronization [req-1999f028-74b5-44b5-a2e5-cd3f70918841 req-740f0a0d-ddc3-4eef-b4eb-7cee30636b60 service nova] Enqueued Resource ID: 90ae0583-7d65-4cd4-8205-17d3726a65ac with Priority: HIGHEST for action security_group_rules [ 904.763364] env[69980]: INFO networking_nsxv3.common.synchronization [req-1999f028-74b5-44b5-a2e5-cd3f70918841 req-740f0a0d-ddc3-4eef-b4eb-7cee30636b60 service nova] Enqueued Resource ID: 90ae0583-7d65-4cd4-8205-17d3726a65ac with Priority: HIGHEST for action security_group_members [ 904.763512] env[69980]: INFO networking_nsxv3.common.synchronization [req-1999f028-74b5-44b5-a2e5-cd3f70918841 req-740f0a0d-ddc3-4eef-b4eb-7cee30636b60 service nova] Enqueued Resource ID: 1d8fe340-0e40-4d6e-8756-d6192f3394f8 with Priority: HIGHEST for action port [ 904.764057] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 90ae0583-7d65-4cd4-8205-17d3726a65ac with Priority: HIGHEST for action security_group_rules [ 904.764193] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 90ae0583-7d65-4cd4-8205-17d3726a65ac with Priority: HIGHEST for action security_group_members [ 904.764285] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1d8fe340-0e40-4d6e-8756-d6192f3394f8 with Priority: HIGHEST for action port [ 904.764784] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock rules-90ae0583-7d65-4cd4-8205-17d3726a65ac taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.764926] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-90ae0583-7d65-4cd4-8205-17d3726a65ac" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.764999] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-90ae0583-7d65-4cd4-8205-17d3726a65ac" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.765374] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-90ae0583-7d65-4cd4-8205-17d3726a65ac" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.765459] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('90ae0583-7d65-4cd4-8205-17d3726a65ac',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 904.766702] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-90ae0583-7d65-4cd4-8205-17d3726a65ac taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.766776] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-90ae0583-7d65-4cd4-8205-17d3726a65ac" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.766851] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-90ae0583-7d65-4cd4-8205-17d3726a65ac" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.767035] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-90ae0583-7d65-4cd4-8205-17d3726a65ac" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.767188] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.767286] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.767349] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.767502] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.767589] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.767681] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('90ae0583-7d65-4cd4-8205-17d3726a65ac',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 904.773309] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock port-1d8fe340-0e40-4d6e-8756-d6192f3394f8 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.773309] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1d8fe340-0e40-4d6e-8756-d6192f3394f8" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.773309] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1d8fe340-0e40-4d6e-8756-d6192f3394f8" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.773309] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1d8fe340-0e40-4d6e-8756-d6192f3394f8" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.773309] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1d8fe340-0e40-4d6e-8756-d6192f3394f8',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 905.252026] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-0b52672e-87ad-43b6-b078-903b8601b014 taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.252026] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0b52672e-87ad-43b6-b078-903b8601b014" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.252026] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0b52672e-87ad-43b6-b078-903b8601b014" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.252026] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0b52672e-87ad-43b6-b078-903b8601b014" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.252026] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.252305] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.252500] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.252758] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.252940] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.253144] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0b52672e-87ad-43b6-b078-903b8601b014" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.253391] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-0b52672e-87ad-43b6-b078-903b8601b014 taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.254032] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0b52672e-87ad-43b6-b078-903b8601b014" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.254032] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0b52672e-87ad-43b6-b078-903b8601b014" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.254032] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0b52672e-87ad-43b6-b078-903b8601b014" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.254032] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.254274] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.254274] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.254274] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.254416] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.254416] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0b52672e-87ad-43b6-b078-903b8601b014" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.254503] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('0b52672e-87ad-43b6-b078-903b8601b014',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 905.267731] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-90ae0583-7d65-4cd4-8205-17d3726a65ac taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.267854] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-90ae0583-7d65-4cd4-8205-17d3726a65ac" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.274676] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('90ae0583-7d65-4cd4-8205-17d3726a65ac',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 905.275522] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 1d8fe340-0e40-4d6e-8756-d6192f3394f8 with status ACTIVE [ 905.276639] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.276879] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.276999] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.278746] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.278746] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.278746] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.278746] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.278746] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.278746] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.278746] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.278746] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.278746] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.278746] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.279271] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.279271] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.279271] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 1d8fe340-0e40-4d6e-8756-d6192f3394f8 is going to be updated. [ 905.298703] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.298870] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.298908] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.299192] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.299249] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.299396] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1d8fe340-0e40-4d6e-8756-d6192f3394f8" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.759430] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 0b52672e-87ad-43b6-b078-903b8601b014: rpc.has_security_group_logging(os_id): False [ 905.775891] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.776056] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.776113] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.776336] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.776426] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.776635] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.776735] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.776793] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.776941] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.777036] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.777229] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.777332] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.777372] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.777511] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.777583] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.777756] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.777847] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.777904] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.778046] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.778122] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.778204] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0b52672e-87ad-43b6-b078-903b8601b014 is going to be updated. [ 905.780765] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('90ae0583-7d65-4cd4-8205-17d3726a65ac',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 905.840234] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.840383] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.840455] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.840657] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.840798] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.859938] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0b52672e-87ad-43b6-b078-903b8601b014 in Status: IN_PROGRESS for 2s [ 906.286541] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.286711] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.286783] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.286993] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.287110] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.287207] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 90ae0583-7d65-4cd4-8205-17d3726a65ac is going to be created. [ 906.308275] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.308416] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.308472] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.308680] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.308833] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.317383] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 90ae0583-7d65-4cd4-8205-17d3726a65ac in Status: UNINITIALIZED for 2s [ 906.444381] env[69980]: INFO networking_nsxv3.common.synchronization [req-8e4e5ebc-dba6-4b7f-be21-e052c2fe598d req-54b3b744-35c8-432f-9f02-a89a099442b9 tempest-SecurityGroupsTestJSON-1482814430 tempest-SecurityGroupsTestJSON-1482814430-project-member] Enqueued Resource ID: e2390617-a1da-45a2-94eb-d162a19e2fae with Priority: HIGHEST for action security_group_members [ 906.445328] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e2390617-a1da-45a2-94eb-d162a19e2fae with Priority: HIGHEST for action security_group_members [ 906.445381] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-e2390617-a1da-45a2-94eb-d162a19e2fae taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.448151] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e2390617-a1da-45a2-94eb-d162a19e2fae" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.448151] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e2390617-a1da-45a2-94eb-d162a19e2fae" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.448151] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e2390617-a1da-45a2-94eb-d162a19e2fae" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.448151] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.448151] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.448151] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.448151] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.448151] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.448151] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e2390617-a1da-45a2-94eb-d162a19e2fae',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 906.948954] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e2390617-a1da-45a2-94eb-d162a19e2fae',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 907.452252] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e2390617-a1da-45a2-94eb-d162a19e2fae',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 907.874947] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0b52672e-87ad-43b6-b078-903b8601b014 in Status: SUCCESS [ 907.875256] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0b52672e-87ad-43b6-b078-903b8601b014" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.936079] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock network-154 taken with stack trace [, , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.936289] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "network-154" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.936779] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "network-154" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.939832] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "network-154" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.940338] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.940525] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.940702] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.940971] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.941161] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.941397] env[69980]: DEBUG dogpile.cache.region [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] No value present for key: 'zone-id' {{(pid=69980) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 907.941528] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] NeedRegenerationException {{(pid=69980) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 907.941649] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] no value, waiting for create lock {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 907.941773] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] value creation lock acquired {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 907.941891] env[69980]: DEBUG dogpile.cache.region [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] No value present for key: 'zone-id' {{(pid=69980) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 907.942024] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Calling creation function for not-yet-present value {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 907.942190] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 907.955392] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.955664] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.955664] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.956563] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.956563] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.956563] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e2390617-a1da-45a2-94eb-d162a19e2fae is going to be updated. [ 907.964236] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 907.964366] env[69980]: DEBUG dogpile.cache.region [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=69980) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 907.964513] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Released creation lock {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 907.964671] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "network-154" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.964961] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock port-132c935b-20db-42bf-b112-71a29e4b953d taken with stack trace [, , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.965146] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "port-132c935b-20db-42bf-b112-71a29e4b953d" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.965266] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "port-132c935b-20db-42bf-b112-71a29e4b953d" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.965575] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "port-132c935b-20db-42bf-b112-71a29e4b953d" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.965937] env[69980]: DEBUG networking_nsxv3.api.rpc [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('132c935b-20db-42bf-b112-71a29e4b953d',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 907.986317] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.986473] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.986542] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.986739] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.987085] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.997017] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e2390617-a1da-45a2-94eb-d162a19e2fae in Status: IN_PROGRESS for 2s [ 908.326956] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 90ae0583-7d65-4cd4-8205-17d3726a65ac in Status: SUCCESS [ 908.326956] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-90ae0583-7d65-4cd4-8205-17d3726a65ac" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.326956] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-90ae0583-7d65-4cd4-8205-17d3726a65ac" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.326956] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-90ae0583-7d65-4cd4-8205-17d3726a65ac" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.326956] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.326956] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.326956] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.327324] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.327324] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.327324] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-90ae0583-7d65-4cd4-8205-17d3726a65ac" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.327324] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('90ae0583-7d65-4cd4-8205-17d3726a65ac',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 908.470118] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.470118] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.470118] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.470118] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.470118] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.475025] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Segment Port 132c935b-20db-42bf-b112-71a29e4b953d not found, creating... [ 908.475025] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.475025] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.475025] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.475025] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.475025] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.475662] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.475662] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.475662] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.475854] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.476540] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.476540] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Resource: SegmentPort with ID: 132c935b-20db-42bf-b112-71a29e4b953d is going to be created. [ 908.503837] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.505088] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.505088] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.505088] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.505339] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.505486] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "port-132c935b-20db-42bf-b112-71a29e4b953d" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.830153] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-90ae0583-7d65-4cd4-8205-17d3726a65ac taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.830326] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-90ae0583-7d65-4cd4-8205-17d3726a65ac" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.830399] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-90ae0583-7d65-4cd4-8205-17d3726a65ac" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.830618] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-90ae0583-7d65-4cd4-8205-17d3726a65ac" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.833129] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.833129] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.833129] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.833129] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.833129] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.833129] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-90ae0583-7d65-4cd4-8205-17d3726a65ac" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.833129] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-90ae0583-7d65-4cd4-8205-17d3726a65ac taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.833129] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-90ae0583-7d65-4cd4-8205-17d3726a65ac" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.833129] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-90ae0583-7d65-4cd4-8205-17d3726a65ac" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.833129] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-90ae0583-7d65-4cd4-8205-17d3726a65ac" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.833129] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.833129] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.833129] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.833129] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.833129] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.833129] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-90ae0583-7d65-4cd4-8205-17d3726a65ac" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.833129] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('90ae0583-7d65-4cd4-8205-17d3726a65ac',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 909.337483] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 90ae0583-7d65-4cd4-8205-17d3726a65ac: rpc.has_security_group_logging(os_id): False [ 909.355351] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.355491] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.355558] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.355918] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.355918] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.356463] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.356463] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.356463] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.356463] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.356463] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.356740] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.356740] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.356822] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.356899] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.356990] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.357186] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.357262] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.357348] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.357442] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.357507] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.357586] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 90ae0583-7d65-4cd4-8205-17d3726a65ac is going to be created. [ 909.412922] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.412922] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.412922] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.412922] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.412922] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.421741] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 90ae0583-7d65-4cd4-8205-17d3726a65ac in Status: IN_PROGRESS for 2s [ 909.462634] env[69980]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-977287c2-69f8-47e1-8dff-764e9cba9a38 None None] NSXv3 Agent Agent loop - iteration:0 completed [ 909.462634] env[69980]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-977287c2-69f8-47e1-8dff-764e9cba9a38 None None] NSXv3 Agent Agent loop - iteration:1 started [ 909.488971] env[69980]: INFO networking_nsxv3.common.synchronization [req-8e4e5ebc-dba6-4b7f-be21-e052c2fe598d req-f9d3d133-fc1a-4fe1-9084-287fc38fee2f service nova] Enqueued Resource ID: e2390617-a1da-45a2-94eb-d162a19e2fae with Priority: HIGHEST for action security_group_rules [ 909.488971] env[69980]: INFO networking_nsxv3.common.synchronization [req-8e4e5ebc-dba6-4b7f-be21-e052c2fe598d req-f9d3d133-fc1a-4fe1-9084-287fc38fee2f service nova] Enqueued Resource ID: e2390617-a1da-45a2-94eb-d162a19e2fae with Priority: HIGHEST for action security_group_members [ 909.488971] env[69980]: INFO networking_nsxv3.common.synchronization [req-8e4e5ebc-dba6-4b7f-be21-e052c2fe598d req-f9d3d133-fc1a-4fe1-9084-287fc38fee2f service nova] Enqueued Resource ID: 132c935b-20db-42bf-b112-71a29e4b953d with Priority: HIGHEST for action port [ 909.489333] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e2390617-a1da-45a2-94eb-d162a19e2fae with Priority: HIGHEST for action security_group_rules [ 909.489333] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e2390617-a1da-45a2-94eb-d162a19e2fae with Priority: HIGHEST for action security_group_members [ 909.489333] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 132c935b-20db-42bf-b112-71a29e4b953d with Priority: HIGHEST for action port [ 909.489889] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e2390617-a1da-45a2-94eb-d162a19e2fae taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.490284] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e2390617-a1da-45a2-94eb-d162a19e2fae" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.490284] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e2390617-a1da-45a2-94eb-d162a19e2fae" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.490557] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e2390617-a1da-45a2-94eb-d162a19e2fae" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.490557] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e2390617-a1da-45a2-94eb-d162a19e2fae',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 909.491496] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-e2390617-a1da-45a2-94eb-d162a19e2fae taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.491657] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e2390617-a1da-45a2-94eb-d162a19e2fae" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.491779] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock port-132c935b-20db-42bf-b112-71a29e4b953d taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.491895] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-132c935b-20db-42bf-b112-71a29e4b953d" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.491999] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-132c935b-20db-42bf-b112-71a29e4b953d" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.492199] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-132c935b-20db-42bf-b112-71a29e4b953d" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.493458] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('132c935b-20db-42bf-b112-71a29e4b953d',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 909.496192] env[69980]: INFO networking_nsxv3.common.synchronization [req-fb796fb0-286b-4514-b714-f9043b517231 req-64e9268e-29d8-4bc6-a975-32eff3b56523 tempest-ServersNegativeTestJSON-1861659283 tempest-ServersNegativeTestJSON-1861659283-project-member] Enqueued Resource ID: f44b2d06-c9ca-4621-a354-74c006769956 with Priority: HIGHEST for action security_group_members [ 909.496192] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f44b2d06-c9ca-4621-a354-74c006769956 with Priority: HIGHEST for action security_group_members [ 909.496192] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-f44b2d06-c9ca-4621-a354-74c006769956 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.496192] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f44b2d06-c9ca-4621-a354-74c006769956" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.496192] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f44b2d06-c9ca-4621-a354-74c006769956" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.496465] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f44b2d06-c9ca-4621-a354-74c006769956" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.496465] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.496547] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.496547] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.497335] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.497335] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.497335] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f44b2d06-c9ca-4621-a354-74c006769956',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 909.839325] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock network-278 taken with stack trace [, , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.839325] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "network-278" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.839325] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "network-278" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.839567] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "network-278" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.839819] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.839993] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.840579] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.840884] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.841071] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.841295] env[69980]: DEBUG dogpile.cache.region [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] No value present for key: 'zone-id' {{(pid=69980) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 909.841458] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] NeedRegenerationException {{(pid=69980) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 909.841596] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] no value, waiting for create lock {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 909.841728] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] value creation lock acquired {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 909.841886] env[69980]: DEBUG dogpile.cache.region [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] No value present for key: 'zone-id' {{(pid=69980) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 909.842057] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Calling creation function for not-yet-present value {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 909.842228] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 909.861975] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 909.861975] env[69980]: DEBUG dogpile.cache.region [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=69980) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 909.861975] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Released creation lock {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 909.861975] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "network-278" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.861975] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock port-0c48a182-eaef-4d86-8330-7f2f03619889 taken with stack trace [, , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.861975] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "port-0c48a182-eaef-4d86-8330-7f2f03619889" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.862289] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "port-0c48a182-eaef-4d86-8330-7f2f03619889" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.862546] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "port-0c48a182-eaef-4d86-8330-7f2f03619889" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.862678] env[69980]: DEBUG networking_nsxv3.api.rpc [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0c48a182-eaef-4d86-8330-7f2f03619889',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 909.993490] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-e2390617-a1da-45a2-94eb-d162a19e2fae taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.993659] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e2390617-a1da-45a2-94eb-d162a19e2fae" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.999714] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 132c935b-20db-42bf-b112-71a29e4b953d with status ACTIVE [ 909.999714] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.999714] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.999714] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.999714] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.999714] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.999714] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.999714] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.999714] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.999714] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.999714] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.999714] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.999714] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.999714] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.999714] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.001329] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.001329] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 132c935b-20db-42bf-b112-71a29e4b953d is going to be updated. [ 910.003016] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f44b2d06-c9ca-4621-a354-74c006769956',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 910.010864] env[69980]: INFO networking_nsxv3.common.synchronization [req-c2f83419-bd4c-4b9a-a0fb-8151c2e5fa3a req-c0c1ab2a-2e63-44d9-b2d0-32f2855748ed tempest-VolumesAssistedSnapshotsTest-973741720 tempest-VolumesAssistedSnapshotsTest-973741720-project-member] Enqueued Resource ID: 701c8f75-0059-44a8-ab17-fcd4ee6f9c0e with Priority: HIGHEST for action security_group_members [ 910.011895] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 701c8f75-0059-44a8-ab17-fcd4ee6f9c0e with Priority: HIGHEST for action security_group_members [ 910.012176] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-701c8f75-0059-44a8-ab17-fcd4ee6f9c0e taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.012355] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-701c8f75-0059-44a8-ab17-fcd4ee6f9c0e" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.012424] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-701c8f75-0059-44a8-ab17-fcd4ee6f9c0e" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.012632] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-701c8f75-0059-44a8-ab17-fcd4ee6f9c0e" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.012786] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.012887] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.012947] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.013165] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.014035] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.014035] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('701c8f75-0059-44a8-ab17-fcd4ee6f9c0e',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 910.015518] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e2390617-a1da-45a2-94eb-d162a19e2fae in Status: SUCCESS [ 910.019117] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e2390617-a1da-45a2-94eb-d162a19e2fae" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.019117] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e2390617-a1da-45a2-94eb-d162a19e2fae" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.019117] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e2390617-a1da-45a2-94eb-d162a19e2fae" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.019117] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.019117] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.019552] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.019734] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.020756] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.020862] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e2390617-a1da-45a2-94eb-d162a19e2fae',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 910.024568] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.024740] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.024818] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.025058] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.025230] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.025436] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-132c935b-20db-42bf-b112-71a29e4b953d" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.365947] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.366342] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.366388] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.367017] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.367207] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.367471] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Segment Port 0c48a182-eaef-4d86-8330-7f2f03619889 not found, creating... [ 910.367649] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.367811] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.367928] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.368180] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.368321] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.368616] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.369061] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.369270] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.369519] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.369668] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.369843] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Resource: SegmentPort with ID: 0c48a182-eaef-4d86-8330-7f2f03619889 is going to be created. [ 910.389548] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.389736] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.389858] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.395311] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.395311] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.395311] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "port-0c48a182-eaef-4d86-8330-7f2f03619889" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.511388] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f44b2d06-c9ca-4621-a354-74c006769956',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 910.524373] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.524544] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.524619] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.524843] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.526579] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e2390617-a1da-45a2-94eb-d162a19e2fae',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 910.562460] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.563141] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.563255] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.563326] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.563520] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.565342] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.565342] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 701c8f75-0059-44a8-ab17-fcd4ee6f9c0e is going to be updated. [ 910.604052] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.604052] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.604052] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.604860] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.605091] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.619031] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 701c8f75-0059-44a8-ab17-fcd4ee6f9c0e in Status: IN_PROGRESS for 2s [ 911.014474] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.014677] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.014777] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.015070] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.015217] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.015345] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f44b2d06-c9ca-4621-a354-74c006769956 is going to be updated. [ 911.030744] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e2390617-a1da-45a2-94eb-d162a19e2fae',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 911.041961] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.042140] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.042210] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.042418] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.042558] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.050979] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f44b2d06-c9ca-4621-a354-74c006769956 in Status: IN_PROGRESS for 2s [ 911.434403] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 90ae0583-7d65-4cd4-8205-17d3726a65ac in Status: SUCCESS [ 911.434403] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-90ae0583-7d65-4cd4-8205-17d3726a65ac" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.535350] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.535526] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.535600] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.535831] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.535934] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.536050] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e2390617-a1da-45a2-94eb-d162a19e2fae is going to be updated. [ 911.563008] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.563659] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.563659] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.563659] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.563659] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.572573] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e2390617-a1da-45a2-94eb-d162a19e2fae in Status: IN_PROGRESS for 2s [ 911.634873] env[69980]: INFO networking_nsxv3.common.synchronization [req-fb796fb0-286b-4514-b714-f9043b517231 req-e639d449-8ddf-4e05-968f-ca84061dbf74 service nova] Enqueued Resource ID: f44b2d06-c9ca-4621-a354-74c006769956 with Priority: HIGHEST for action security_group_rules [ 911.635103] env[69980]: INFO networking_nsxv3.common.synchronization [req-fb796fb0-286b-4514-b714-f9043b517231 req-e639d449-8ddf-4e05-968f-ca84061dbf74 service nova] Enqueued Resource ID: f44b2d06-c9ca-4621-a354-74c006769956 with Priority: HIGHEST for action security_group_members [ 911.635252] env[69980]: INFO networking_nsxv3.common.synchronization [req-fb796fb0-286b-4514-b714-f9043b517231 req-e639d449-8ddf-4e05-968f-ca84061dbf74 service nova] Enqueued Resource ID: 0c48a182-eaef-4d86-8330-7f2f03619889 with Priority: HIGHEST for action port [ 911.635479] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f44b2d06-c9ca-4621-a354-74c006769956 with Priority: HIGHEST for action security_group_rules [ 911.635607] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f44b2d06-c9ca-4621-a354-74c006769956 with Priority: HIGHEST for action security_group_members [ 911.635704] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0c48a182-eaef-4d86-8330-7f2f03619889 with Priority: HIGHEST for action port [ 911.636241] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f44b2d06-c9ca-4621-a354-74c006769956 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.639836] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f44b2d06-c9ca-4621-a354-74c006769956" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.639836] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f44b2d06-c9ca-4621-a354-74c006769956" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.639836] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f44b2d06-c9ca-4621-a354-74c006769956" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.639836] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f44b2d06-c9ca-4621-a354-74c006769956',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 911.640746] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-f44b2d06-c9ca-4621-a354-74c006769956 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.640997] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f44b2d06-c9ca-4621-a354-74c006769956" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.641250] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock port-0c48a182-eaef-4d86-8330-7f2f03619889 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.642066] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0c48a182-eaef-4d86-8330-7f2f03619889" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.642143] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0c48a182-eaef-4d86-8330-7f2f03619889" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.642511] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0c48a182-eaef-4d86-8330-7f2f03619889" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.642511] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0c48a182-eaef-4d86-8330-7f2f03619889',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 912.107175] env[69980]: INFO networking_nsxv3.common.synchronization [req-c141e2a3-22d4-4493-9382-6640620a6a58 req-d6da391e-fed1-4ffd-bbb8-d743f3d1c011 tempest-MultipleCreateTestJSON-827335919 tempest-MultipleCreateTestJSON-827335919-project-member] Enqueued Resource ID: 7bc12ce3-2b1a-439c-8e90-f01bd1033c9a with Priority: HIGHEST for action security_group_members [ 912.107783] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7bc12ce3-2b1a-439c-8e90-f01bd1033c9a with Priority: HIGHEST for action security_group_members [ 912.108023] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-7bc12ce3-2b1a-439c-8e90-f01bd1033c9a taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.108182] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7bc12ce3-2b1a-439c-8e90-f01bd1033c9a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.108182] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7bc12ce3-2b1a-439c-8e90-f01bd1033c9a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.111651] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7bc12ce3-2b1a-439c-8e90-f01bd1033c9a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.111996] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.112152] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.112221] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.112416] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.112624] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.112624] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7bc12ce3-2b1a-439c-8e90-f01bd1033c9a',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 912.145902] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-f44b2d06-c9ca-4621-a354-74c006769956 taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.146039] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f44b2d06-c9ca-4621-a354-74c006769956" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.151308] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 0c48a182-eaef-4d86-8330-7f2f03619889 with status ACTIVE [ 912.151617] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.151805] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.151917] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.152233] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.152376] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.152568] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.152793] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.152793] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.152911] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.152983] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.157167] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.157167] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.157167] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.157167] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.157167] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.157167] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 0c48a182-eaef-4d86-8330-7f2f03619889 is going to be updated. [ 912.178364] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.178364] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.178364] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.178364] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.178364] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.178364] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0c48a182-eaef-4d86-8330-7f2f03619889" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.231130] env[69980]: INFO networking_nsxv3.common.synchronization [None req-f17985c1-768b-4436-9eec-7d528a0ab94c None None] Enqueued Resource ID: db3f1633-6fb3-421d-8420-49edd023c4a1 with Priority: HIGHEST for action port [ 912.231130] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: db3f1633-6fb3-421d-8420-49edd023c4a1 with Priority: HIGHEST for action port [ 912.231130] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock port-db3f1633-6fb3-421d-8420-49edd023c4a1 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.231130] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-db3f1633-6fb3-421d-8420-49edd023c4a1" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.231518] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-db3f1633-6fb3-421d-8420-49edd023c4a1" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.232036] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-db3f1633-6fb3-421d-8420-49edd023c4a1" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.232332] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('db3f1633-6fb3-421d-8420-49edd023c4a1',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 912.266200] env[69980]: INFO networking_nsxv3.common.synchronization [req-173b486f-d26a-4d27-b942-b1bffef32cd0 req-f41f1900-b58d-4446-88d4-4987e153da15 tempest-ListImageFiltersTestJSON-1575668155 tempest-ListImageFiltersTestJSON-1575668155-project-member] Enqueued Resource ID: 241bcad9-5919-4c26-b0b9-beb6a98733bd with Priority: HIGHEST for action security_group_members [ 912.266200] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 241bcad9-5919-4c26-b0b9-beb6a98733bd with Priority: HIGHEST for action security_group_members [ 912.266200] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-241bcad9-5919-4c26-b0b9-beb6a98733bd taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.266200] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-241bcad9-5919-4c26-b0b9-beb6a98733bd" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.266200] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-241bcad9-5919-4c26-b0b9-beb6a98733bd" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.266200] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-241bcad9-5919-4c26-b0b9-beb6a98733bd" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.266200] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.266200] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.267121] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.267392] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.267523] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.267661] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('241bcad9-5919-4c26-b0b9-beb6a98733bd',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 912.447239] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock network-834 taken with stack trace [, , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.447563] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "network-834" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.447981] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "network-834" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.448874] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "network-834" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.448874] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.449206] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.449249] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.449932] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.449932] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.449932] env[69980]: DEBUG dogpile.cache.region [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] No value present for key: 'zone-id' {{(pid=69980) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 912.450151] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] NeedRegenerationException {{(pid=69980) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 912.450216] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] no value, waiting for create lock {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 912.450351] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] value creation lock acquired {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 912.450493] env[69980]: DEBUG dogpile.cache.region [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] No value present for key: 'zone-id' {{(pid=69980) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 912.450615] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Calling creation function for not-yet-present value {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 912.450755] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 912.469027] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 912.469233] env[69980]: DEBUG dogpile.cache.region [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=69980) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 912.469338] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Released creation lock {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 912.469527] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "network-834" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.469803] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock port-f854efd4-7622-4208-9fd0-899d36c04d10 taken with stack trace [, , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.470052] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "port-f854efd4-7622-4208-9fd0-899d36c04d10" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.470410] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "port-f854efd4-7622-4208-9fd0-899d36c04d10" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.470787] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "port-f854efd4-7622-4208-9fd0-899d36c04d10" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.470936] env[69980]: DEBUG networking_nsxv3.api.rpc [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f854efd4-7622-4208-9fd0-899d36c04d10',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 912.615823] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.615823] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.615823] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.616239] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.616239] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.616239] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.616428] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.617046] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.617046] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.617046] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.617205] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7bc12ce3-2b1a-439c-8e90-f01bd1033c9a already deleted. [ 912.617205] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7bc12ce3-2b1a-439c-8e90-f01bd1033c9a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.635025] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 701c8f75-0059-44a8-ab17-fcd4ee6f9c0e in Status: SUCCESS [ 912.635025] env[69980]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 701c8f75-0059-44a8-ab17-fcd4ee6f9c0e deletion is rescheduled due to dependency. [ 912.635025] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-701c8f75-0059-44a8-ab17-fcd4ee6f9c0e" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.657999] env[69980]: INFO networking_nsxv3.common.synchronization [None req-9e1696f4-c917-443c-bf11-477acf54f7d9 None None] Enqueued Resource ID: 5e8b982b-369d-44c1-a97d-27dcb60bbb06 with Priority: HIGHEST for action port [ 912.658490] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5e8b982b-369d-44c1-a97d-27dcb60bbb06 with Priority: HIGHEST for action port [ 912.658872] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock port-5e8b982b-369d-44c1-a97d-27dcb60bbb06 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.659990] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5e8b982b-369d-44c1-a97d-27dcb60bbb06" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.659990] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5e8b982b-369d-44c1-a97d-27dcb60bbb06" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.659990] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5e8b982b-369d-44c1-a97d-27dcb60bbb06" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.659990] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5e8b982b-369d-44c1-a97d-27dcb60bbb06',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 912.738424] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port db3f1633-6fb3-421d-8420-49edd023c4a1 [ 912.738648] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.738789] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.739187] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.739187] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.739187] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.739311] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:db3f1633-6fb3-421d-8420-49edd023c4a1 already deleted. [ 912.739311] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-db3f1633-6fb3-421d-8420-49edd023c4a1" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.774042] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.774042] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.774042] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.774042] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.794743] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.796612] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.797254] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.797382] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.797852] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.797945] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.798509] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 241bcad9-5919-4c26-b0b9-beb6a98733bd is going to be updated. [ 912.827010] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.827179] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.827239] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.827437] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.827578] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.837940] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 241bcad9-5919-4c26-b0b9-beb6a98733bd in Status: IN_PROGRESS for 2s [ 912.974010] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.974864] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.975056] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.975415] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.975607] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.975901] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Segment Port f854efd4-7622-4208-9fd0-899d36c04d10 not found, creating... [ 912.976086] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.976258] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.976377] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.976592] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.976731] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.977015] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.977254] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.977452] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.977717] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.977912] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.978088] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Resource: SegmentPort with ID: f854efd4-7622-4208-9fd0-899d36c04d10 is going to be created. [ 912.997464] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.997675] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.997802] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.998077] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.998324] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.998540] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "port-f854efd4-7622-4208-9fd0-899d36c04d10" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.063767] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f44b2d06-c9ca-4621-a354-74c006769956 in Status: SUCCESS [ 913.065018] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f44b2d06-c9ca-4621-a354-74c006769956" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.065018] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f44b2d06-c9ca-4621-a354-74c006769956" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.065018] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f44b2d06-c9ca-4621-a354-74c006769956" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.065018] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.065335] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.065335] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.065467] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.065598] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.065751] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f44b2d06-c9ca-4621-a354-74c006769956',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 913.162938] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 5e8b982b-369d-44c1-a97d-27dcb60bbb06 [ 913.163326] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.163436] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.163436] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.163731] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.163837] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.164421] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:5e8b982b-369d-44c1-a97d-27dcb60bbb06 already deleted. [ 913.164421] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5e8b982b-369d-44c1-a97d-27dcb60bbb06" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.569027] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f44b2d06-c9ca-4621-a354-74c006769956',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 913.582355] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e2390617-a1da-45a2-94eb-d162a19e2fae in Status: SUCCESS [ 913.582735] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e2390617-a1da-45a2-94eb-d162a19e2fae" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.583049] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e2390617-a1da-45a2-94eb-d162a19e2fae" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.583281] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e2390617-a1da-45a2-94eb-d162a19e2fae" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.583490] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.583617] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.583681] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.583853] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.583942] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.584056] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e2390617-a1da-45a2-94eb-d162a19e2fae" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.584151] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e2390617-a1da-45a2-94eb-d162a19e2fae',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 913.702727] env[69980]: INFO networking_nsxv3.common.synchronization [req-c141e2a3-22d4-4493-9382-6640620a6a58 req-d0a068ce-b10f-43fd-b855-efc088d77ac0 service nova] Enqueued Resource ID: 7bc12ce3-2b1a-439c-8e90-f01bd1033c9a with Priority: HIGHEST for action security_group_rules [ 913.702896] env[69980]: INFO networking_nsxv3.common.synchronization [req-c141e2a3-22d4-4493-9382-6640620a6a58 req-d0a068ce-b10f-43fd-b855-efc088d77ac0 service nova] Enqueued Resource ID: 7bc12ce3-2b1a-439c-8e90-f01bd1033c9a with Priority: HIGHEST for action security_group_members [ 913.703320] env[69980]: INFO networking_nsxv3.common.synchronization [req-c141e2a3-22d4-4493-9382-6640620a6a58 req-d0a068ce-b10f-43fd-b855-efc088d77ac0 service nova] Enqueued Resource ID: f854efd4-7622-4208-9fd0-899d36c04d10 with Priority: HIGHEST for action port [ 913.703320] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7bc12ce3-2b1a-439c-8e90-f01bd1033c9a with Priority: HIGHEST for action security_group_rules [ 913.703419] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7bc12ce3-2b1a-439c-8e90-f01bd1033c9a with Priority: HIGHEST for action security_group_members [ 913.703808] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f854efd4-7622-4208-9fd0-899d36c04d10 with Priority: HIGHEST for action port [ 913.704649] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7bc12ce3-2b1a-439c-8e90-f01bd1033c9a taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.704649] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7bc12ce3-2b1a-439c-8e90-f01bd1033c9a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.704649] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7bc12ce3-2b1a-439c-8e90-f01bd1033c9a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.705498] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7bc12ce3-2b1a-439c-8e90-f01bd1033c9a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.705498] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7bc12ce3-2b1a-439c-8e90-f01bd1033c9a',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 913.706857] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-7bc12ce3-2b1a-439c-8e90-f01bd1033c9a taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.706857] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7bc12ce3-2b1a-439c-8e90-f01bd1033c9a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.706857] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7bc12ce3-2b1a-439c-8e90-f01bd1033c9a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.706857] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7bc12ce3-2b1a-439c-8e90-f01bd1033c9a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.707371] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.707371] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.707504] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.707603] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.707712] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.707712] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7bc12ce3-2b1a-439c-8e90-f01bd1033c9a',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 913.710314] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock port-f854efd4-7622-4208-9fd0-899d36c04d10 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.710499] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f854efd4-7622-4208-9fd0-899d36c04d10" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.710499] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f854efd4-7622-4208-9fd0-899d36c04d10" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.710628] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f854efd4-7622-4208-9fd0-899d36c04d10" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.712937] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f854efd4-7622-4208-9fd0-899d36c04d10',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 914.071883] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f44b2d06-c9ca-4621-a354-74c006769956',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 914.087264] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-e2390617-a1da-45a2-94eb-d162a19e2fae taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.087264] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e2390617-a1da-45a2-94eb-d162a19e2fae" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.087264] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e2390617-a1da-45a2-94eb-d162a19e2fae" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.087264] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e2390617-a1da-45a2-94eb-d162a19e2fae" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.087264] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.087560] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.087560] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.087560] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.088662] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.088662] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e2390617-a1da-45a2-94eb-d162a19e2fae" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.088662] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-e2390617-a1da-45a2-94eb-d162a19e2fae taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.088662] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e2390617-a1da-45a2-94eb-d162a19e2fae" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.088662] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e2390617-a1da-45a2-94eb-d162a19e2fae" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.088662] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e2390617-a1da-45a2-94eb-d162a19e2fae" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.088877] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.088877] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.088877] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.088988] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.089073] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.089153] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e2390617-a1da-45a2-94eb-d162a19e2fae" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.089242] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e2390617-a1da-45a2-94eb-d162a19e2fae',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 914.208088] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-7bc12ce3-2b1a-439c-8e90-f01bd1033c9a taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.208231] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7bc12ce3-2b1a-439c-8e90-f01bd1033c9a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.210688] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7bc12ce3-2b1a-439c-8e90-f01bd1033c9a',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 914.215685] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f854efd4-7622-4208-9fd0-899d36c04d10 with status ACTIVE [ 914.215853] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.215995] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.216116] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.216287] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.216378] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.216562] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.216662] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.216719] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.216870] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.216944] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.217404] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.217404] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.217404] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.218249] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.218373] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.218485] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f854efd4-7622-4208-9fd0-899d36c04d10 is going to be updated. [ 914.237595] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.237595] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.237595] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.237595] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.237874] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.237874] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f854efd4-7622-4208-9fd0-899d36c04d10" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.543285] env[69980]: INFO networking_nsxv3.common.synchronization [None req-6ba4858d-21b9-4b09-8de0-f5e11cf55655 tempest-ServerActionsTestJSON-1479580870 tempest-ServerActionsTestJSON-1479580870-project-member] Enqueued Resource ID: 00f20236-2b69-46dc-a00f-0c4d6b93c17a with Priority: HIGHEST for action security_group_rules [ 914.544035] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 00f20236-2b69-46dc-a00f-0c4d6b93c17a with Priority: HIGHEST for action security_group_rules [ 914.544346] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock rules-00f20236-2b69-46dc-a00f-0c4d6b93c17a taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.544346] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-00f20236-2b69-46dc-a00f-0c4d6b93c17a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.544346] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-00f20236-2b69-46dc-a00f-0c4d6b93c17a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.544749] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-00f20236-2b69-46dc-a00f-0c4d6b93c17a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.544749] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('00f20236-2b69-46dc-a00f-0c4d6b93c17a',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 914.574807] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.575207] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.575207] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.575767] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.575767] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.575767] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f44b2d06-c9ca-4621-a354-74c006769956 is going to be updated. [ 914.593449] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e2390617-a1da-45a2-94eb-d162a19e2fae: rpc.has_security_group_logging(os_id): False [ 914.605459] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.605610] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.605682] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.605895] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.606051] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.607759] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.607872] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.607942] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.608512] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.617595] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f44b2d06-c9ca-4621-a354-74c006769956 in Status: IN_PROGRESS for 2s [ 914.671905] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.672249] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.672376] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.672440] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.672655] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.672905] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.672976] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.673062] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.673126] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.673278] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.673354] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.673536] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.673646] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.673699] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.673817] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.674388] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.674482] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e2390617-a1da-45a2-94eb-d162a19e2fae is going to be updated. [ 914.713492] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7bc12ce3-2b1a-439c-8e90-f01bd1033c9a',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 914.721289] env[69980]: INFO networking_nsxv3.common.synchronization [None req-6ad1f40b-85b2-4fe7-91af-1daad03f8fd8 tempest-ServerActionsTestJSON-1479580870 tempest-ServerActionsTestJSON-1479580870-project-member] Enqueued Resource ID: 00f20236-2b69-46dc-a00f-0c4d6b93c17a with Priority: HIGHEST for action security_group_rules [ 914.721959] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 00f20236-2b69-46dc-a00f-0c4d6b93c17a with Priority: HIGHEST for action security_group_rules [ 914.722271] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock rules-00f20236-2b69-46dc-a00f-0c4d6b93c17a taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.722378] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-00f20236-2b69-46dc-a00f-0c4d6b93c17a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.750800] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.750800] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.750800] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.750800] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.750800] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.770616] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e2390617-a1da-45a2-94eb-d162a19e2fae in Status: IN_PROGRESS for 2s [ 914.799705] env[69980]: INFO networking_nsxv3.common.synchronization [None req-908b0255-98f4-4780-b61f-c772095180d7 None None] Enqueued Resource ID: bf41c6a3-c4ba-40e8-84a8-d8c5950862c2 with Priority: HIGHEST for action port [ 914.800257] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bf41c6a3-c4ba-40e8-84a8-d8c5950862c2 with Priority: HIGHEST for action port [ 914.800761] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock port-bf41c6a3-c4ba-40e8-84a8-d8c5950862c2 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.800874] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-bf41c6a3-c4ba-40e8-84a8-d8c5950862c2" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.801037] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-bf41c6a3-c4ba-40e8-84a8-d8c5950862c2" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.801296] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-bf41c6a3-c4ba-40e8-84a8-d8c5950862c2" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.801376] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bf41c6a3-c4ba-40e8-84a8-d8c5950862c2',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 914.855148] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 241bcad9-5919-4c26-b0b9-beb6a98733bd in Status: SUCCESS [ 914.855233] env[69980]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 241bcad9-5919-4c26-b0b9-beb6a98733bd deletion is rescheduled due to dependency. [ 914.855389] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-241bcad9-5919-4c26-b0b9-beb6a98733bd" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.884630] env[69980]: INFO networking_nsxv3.common.synchronization [req-c141e2a3-22d4-4493-9382-6640620a6a58 req-9691ae69-8a44-40ee-bc4d-da4ae4e36e08 tempest-MultipleCreateTestJSON-827335919 tempest-MultipleCreateTestJSON-827335919-project-member] Enqueued Resource ID: 7bc12ce3-2b1a-439c-8e90-f01bd1033c9a with Priority: HIGHEST for action security_group_members [ 914.885373] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7bc12ce3-2b1a-439c-8e90-f01bd1033c9a with Priority: HIGHEST for action security_group_members [ 914.885695] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-7bc12ce3-2b1a-439c-8e90-f01bd1033c9a taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.885798] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7bc12ce3-2b1a-439c-8e90-f01bd1033c9a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.892764] env[69980]: INFO networking_nsxv3.common.synchronization [None req-8b913783-4d10-455a-b3b7-113aac777f78 None None] Enqueued Resource ID: 5676c30c-9da4-4e5e-9cfa-102adf3ef23c with Priority: HIGHEST for action port [ 914.893208] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5676c30c-9da4-4e5e-9cfa-102adf3ef23c with Priority: HIGHEST for action port [ 914.893773] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock port-5676c30c-9da4-4e5e-9cfa-102adf3ef23c taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.893840] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5676c30c-9da4-4e5e-9cfa-102adf3ef23c" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.893875] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5676c30c-9da4-4e5e-9cfa-102adf3ef23c" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.894163] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5676c30c-9da4-4e5e-9cfa-102adf3ef23c" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.894270] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5676c30c-9da4-4e5e-9cfa-102adf3ef23c',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 915.070184] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.070332] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.070406] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.070621] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.070711] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.070805] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 00f20236-2b69-46dc-a00f-0c4d6b93c17a already deleted. [ 915.070969] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-00f20236-2b69-46dc-a00f-0c4d6b93c17a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.071039] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-00f20236-2b69-46dc-a00f-0c4d6b93c17a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.071209] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-00f20236-2b69-46dc-a00f-0c4d6b93c17a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.071296] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('00f20236-2b69-46dc-a00f-0c4d6b93c17a',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 915.222403] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.222512] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.222619] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.222839] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.222947] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.223090] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7bc12ce3-2b1a-439c-8e90-f01bd1033c9a is going to be created. [ 915.307195] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port bf41c6a3-c4ba-40e8-84a8-d8c5950862c2 [ 915.307424] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.307642] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.307642] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.307814] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.307939] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.308055] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:bf41c6a3-c4ba-40e8-84a8-d8c5950862c2 already deleted. [ 915.308157] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-bf41c6a3-c4ba-40e8-84a8-d8c5950862c2" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.321985] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock network-834 taken with stack trace [, , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.323149] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "network-834" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.323149] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "network-834" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.323149] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "network-834" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.323149] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.323149] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.325091] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.325395] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.325994] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.325994] env[69980]: DEBUG dogpile.cache.region [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] No value present for key: 'zone-id' {{(pid=69980) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 915.325994] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] NeedRegenerationException {{(pid=69980) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 915.325994] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] no value, waiting for create lock {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 915.326287] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] value creation lock acquired {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 915.326287] env[69980]: DEBUG dogpile.cache.region [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] No value present for key: 'zone-id' {{(pid=69980) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 915.326369] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Calling creation function for not-yet-present value {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 915.326502] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 915.332158] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.332308] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.332379] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.332572] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.332748] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.341952] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7bc12ce3-2b1a-439c-8e90-f01bd1033c9a in Status: UNINITIALIZED for 2s [ 915.346711] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 915.346885] env[69980]: DEBUG dogpile.cache.region [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=69980) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 915.347046] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Released creation lock {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 915.347247] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "network-834" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.347563] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock port-d15d6ff2-bc69-4c3c-9936-4da07ccd1217 taken with stack trace [, , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.347734] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "port-d15d6ff2-bc69-4c3c-9936-4da07ccd1217" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.347900] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "port-d15d6ff2-bc69-4c3c-9936-4da07ccd1217" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.348202] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "port-d15d6ff2-bc69-4c3c-9936-4da07ccd1217" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.348343] env[69980]: DEBUG networking_nsxv3.api.rpc [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d15d6ff2-bc69-4c3c-9936-4da07ccd1217',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 915.396350] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 5676c30c-9da4-4e5e-9cfa-102adf3ef23c [ 915.396588] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.398553] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.399412] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.400028] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.400028] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.400028] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:5676c30c-9da4-4e5e-9cfa-102adf3ef23c already deleted. [ 915.400028] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5676c30c-9da4-4e5e-9cfa-102adf3ef23c" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.597646] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.597646] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.597646] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.597646] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.597646] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.597646] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 00f20236-2b69-46dc-a00f-0c4d6b93c17a already deleted. [ 915.597646] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-00f20236-2b69-46dc-a00f-0c4d6b93c17a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.851907] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.851907] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.851907] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.851907] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.851907] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.852427] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Segment Port d15d6ff2-bc69-4c3c-9936-4da07ccd1217 not found, creating... [ 915.852427] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.852427] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.852620] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.852698] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.852819] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.853095] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.853257] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.853376] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.853576] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.853706] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.853878] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Resource: SegmentPort with ID: d15d6ff2-bc69-4c3c-9936-4da07ccd1217 is going to be created. [ 915.873801] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.873925] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.875065] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.875647] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.875769] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.875907] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "port-d15d6ff2-bc69-4c3c-9936-4da07ccd1217" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.627143] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f44b2d06-c9ca-4621-a354-74c006769956 in Status: IN_PROGRESS for 4s [ 916.642657] env[69980]: INFO networking_nsxv3.common.synchronization [req-c141e2a3-22d4-4493-9382-6640620a6a58 req-79c0b10a-fe48-485d-85ba-dff2718484cd service nova] Enqueued Resource ID: 7bc12ce3-2b1a-439c-8e90-f01bd1033c9a with Priority: HIGHEST for action security_group_rules [ 916.642657] env[69980]: INFO networking_nsxv3.common.synchronization [req-c141e2a3-22d4-4493-9382-6640620a6a58 req-79c0b10a-fe48-485d-85ba-dff2718484cd service nova] Enqueued Resource ID: 7bc12ce3-2b1a-439c-8e90-f01bd1033c9a with Priority: HIGHEST for action security_group_members [ 916.642753] env[69980]: INFO networking_nsxv3.common.synchronization [req-c141e2a3-22d4-4493-9382-6640620a6a58 req-79c0b10a-fe48-485d-85ba-dff2718484cd service nova] Enqueued Resource ID: d15d6ff2-bc69-4c3c-9936-4da07ccd1217 with Priority: HIGHEST for action port [ 916.643114] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7bc12ce3-2b1a-439c-8e90-f01bd1033c9a with Priority: HIGHEST for action security_group_rules [ 916.643114] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7bc12ce3-2b1a-439c-8e90-f01bd1033c9a with Priority: HIGHEST for action security_group_members [ 916.643236] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d15d6ff2-bc69-4c3c-9936-4da07ccd1217 with Priority: HIGHEST for action port [ 916.643756] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7bc12ce3-2b1a-439c-8e90-f01bd1033c9a taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.643862] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7bc12ce3-2b1a-439c-8e90-f01bd1033c9a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.644157] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-7bc12ce3-2b1a-439c-8e90-f01bd1033c9a taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.644261] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7bc12ce3-2b1a-439c-8e90-f01bd1033c9a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.644456] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock port-d15d6ff2-bc69-4c3c-9936-4da07ccd1217 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.644558] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d15d6ff2-bc69-4c3c-9936-4da07ccd1217" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.644624] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d15d6ff2-bc69-4c3c-9936-4da07ccd1217" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.644820] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d15d6ff2-bc69-4c3c-9936-4da07ccd1217" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.644901] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d15d6ff2-bc69-4c3c-9936-4da07ccd1217',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 916.782709] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e2390617-a1da-45a2-94eb-d162a19e2fae in Status: SUCCESS [ 916.782929] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e2390617-a1da-45a2-94eb-d162a19e2fae" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.147394] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d15d6ff2-bc69-4c3c-9936-4da07ccd1217 with status ACTIVE [ 917.147674] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.147854] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.147928] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.148159] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.148247] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.148494] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.148604] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.148739] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.148858] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.148979] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.149191] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.149289] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.149393] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.149503] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.149577] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.149689] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d15d6ff2-bc69-4c3c-9936-4da07ccd1217 is going to be updated. [ 917.172259] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.172259] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.172259] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.172259] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.172259] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.172259] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d15d6ff2-bc69-4c3c-9936-4da07ccd1217" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.352429] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7bc12ce3-2b1a-439c-8e90-f01bd1033c9a in Status: SUCCESS [ 917.352657] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7bc12ce3-2b1a-439c-8e90-f01bd1033c9a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.352820] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7bc12ce3-2b1a-439c-8e90-f01bd1033c9a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.353045] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7bc12ce3-2b1a-439c-8e90-f01bd1033c9a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.353243] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.353359] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.353421] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.353609] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.353698] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.353785] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7bc12ce3-2b1a-439c-8e90-f01bd1033c9a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.353881] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7bc12ce3-2b1a-439c-8e90-f01bd1033c9a',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 917.354733] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7bc12ce3-2b1a-439c-8e90-f01bd1033c9a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.354893] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7bc12ce3-2b1a-439c-8e90-f01bd1033c9a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.355129] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.355227] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.355227] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.355371] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.355489] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.355530] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7bc12ce3-2b1a-439c-8e90-f01bd1033c9a',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 917.482205] env[69980]: INFO networking_nsxv3.common.synchronization [req-f49345bd-4f1e-4396-b792-2640a0f08455 req-a01d865f-4ec1-4e05-abd3-c88c3087d099 tempest-MigrationsAdminTest-1290478568 tempest-MigrationsAdminTest-1290478568-project-member] Enqueued Resource ID: 462431af-62e3-426c-a50e-a61604f20358 with Priority: HIGHEST for action security_group_members [ 917.482784] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 462431af-62e3-426c-a50e-a61604f20358 with Priority: HIGHEST for action security_group_members [ 917.483358] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-462431af-62e3-426c-a50e-a61604f20358 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.483506] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-462431af-62e3-426c-a50e-a61604f20358" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.483585] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-462431af-62e3-426c-a50e-a61604f20358" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.484139] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-462431af-62e3-426c-a50e-a61604f20358" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.484480] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.484598] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.484679] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.485088] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.485204] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.485307] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('462431af-62e3-426c-a50e-a61604f20358',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 917.857215] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-7bc12ce3-2b1a-439c-8e90-f01bd1033c9a taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.857215] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7bc12ce3-2b1a-439c-8e90-f01bd1033c9a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.859634] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7bc12ce3-2b1a-439c-8e90-f01bd1033c9a',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 917.988772] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('462431af-62e3-426c-a50e-a61604f20358',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 918.140244] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock network-557 taken with stack trace [, , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.140855] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "network-557" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.140855] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "network-557" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.140957] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "network-557" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.145499] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.145757] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.145895] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.146814] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.146814] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.146814] env[69980]: DEBUG dogpile.cache.region [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] No value present for key: 'zone-id' {{(pid=69980) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 918.146814] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] NeedRegenerationException {{(pid=69980) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 918.147014] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] no value, waiting for create lock {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 918.147014] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] value creation lock acquired {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 918.147104] env[69980]: DEBUG dogpile.cache.region [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] No value present for key: 'zone-id' {{(pid=69980) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 918.147234] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Calling creation function for not-yet-present value {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 918.147939] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 918.166980] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 918.166980] env[69980]: DEBUG dogpile.cache.region [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=69980) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 918.166980] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Released creation lock {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 918.167183] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "network-557" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.167532] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock port-f15883fd-4eb2-45e2-b642-378dc0f23f8c taken with stack trace [, , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.167744] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "port-f15883fd-4eb2-45e2-b642-378dc0f23f8c" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.167916] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "port-f15883fd-4eb2-45e2-b642-378dc0f23f8c" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.168205] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "port-f15883fd-4eb2-45e2-b642-378dc0f23f8c" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.169097] env[69980]: DEBUG networking_nsxv3.api.rpc [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f15883fd-4eb2-45e2-b642-378dc0f23f8c',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 918.365298] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7bc12ce3-2b1a-439c-8e90-f01bd1033c9a',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 918.398771] env[69980]: INFO networking_nsxv3.common.synchronization [req-77d4f109-2db5-4786-a690-01ce744350bb req-c2953c54-bee7-4371-beaa-e8008911dd14 tempest-SecurityGroupsTestJSON-1482814430 tempest-SecurityGroupsTestJSON-1482814430-project-member] Enqueued Resource ID: c0c7b91f-f336-4603-ad30-c4ec4ba4e8e1 with Priority: HIGHEST for action security_group_members [ 918.398981] env[69980]: INFO networking_nsxv3.common.synchronization [req-77d4f109-2db5-4786-a690-01ce744350bb req-c2953c54-bee7-4371-beaa-e8008911dd14 tempest-SecurityGroupsTestJSON-1482814430 tempest-SecurityGroupsTestJSON-1482814430-project-member] Enqueued Resource ID: e2390617-a1da-45a2-94eb-d162a19e2fae with Priority: HIGHEST for action security_group_members [ 918.399469] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c0c7b91f-f336-4603-ad30-c4ec4ba4e8e1 with Priority: HIGHEST for action security_group_members [ 918.399616] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e2390617-a1da-45a2-94eb-d162a19e2fae with Priority: HIGHEST for action security_group_members [ 918.399920] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-c0c7b91f-f336-4603-ad30-c4ec4ba4e8e1 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.399990] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c0c7b91f-f336-4603-ad30-c4ec4ba4e8e1" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.400681] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c0c7b91f-f336-4603-ad30-c4ec4ba4e8e1" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.400901] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c0c7b91f-f336-4603-ad30-c4ec4ba4e8e1" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.401702] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.401702] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.401906] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.402604] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.402604] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.402604] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c0c7b91f-f336-4603-ad30-c4ec4ba4e8e1',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 918.403262] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-e2390617-a1da-45a2-94eb-d162a19e2fae taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.403519] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e2390617-a1da-45a2-94eb-d162a19e2fae" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.403629] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e2390617-a1da-45a2-94eb-d162a19e2fae" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.403836] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e2390617-a1da-45a2-94eb-d162a19e2fae" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.404274] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.404274] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.404274] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.404782] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.404782] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.404782] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e2390617-a1da-45a2-94eb-d162a19e2fae',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 918.450783] env[69980]: INFO networking_nsxv3.common.synchronization [req-77d4f109-2db5-4786-a690-01ce744350bb req-c2953c54-bee7-4371-beaa-e8008911dd14 tempest-SecurityGroupsTestJSON-1482814430 tempest-SecurityGroupsTestJSON-1482814430-project-member] Enqueued Resource ID: c0c7b91f-f336-4603-ad30-c4ec4ba4e8e1 with Priority: HIGHEST for action security_group_rules [ 918.450783] env[69980]: INFO networking_nsxv3.common.synchronization [req-77d4f109-2db5-4786-a690-01ce744350bb req-c2953c54-bee7-4371-beaa-e8008911dd14 tempest-SecurityGroupsTestJSON-1482814430 tempest-SecurityGroupsTestJSON-1482814430-project-member] Enqueued Resource ID: c0c7b91f-f336-4603-ad30-c4ec4ba4e8e1 with Priority: HIGHEST for action security_group_members [ 918.450783] env[69980]: INFO networking_nsxv3.common.synchronization [req-77d4f109-2db5-4786-a690-01ce744350bb req-c2953c54-bee7-4371-beaa-e8008911dd14 tempest-SecurityGroupsTestJSON-1482814430 tempest-SecurityGroupsTestJSON-1482814430-project-member] Enqueued Resource ID: e2390617-a1da-45a2-94eb-d162a19e2fae with Priority: HIGHEST for action security_group_rules [ 918.450783] env[69980]: INFO networking_nsxv3.common.synchronization [req-77d4f109-2db5-4786-a690-01ce744350bb req-c2953c54-bee7-4371-beaa-e8008911dd14 tempest-SecurityGroupsTestJSON-1482814430 tempest-SecurityGroupsTestJSON-1482814430-project-member] Enqueued Resource ID: e2390617-a1da-45a2-94eb-d162a19e2fae with Priority: HIGHEST for action security_group_members [ 918.450783] env[69980]: INFO networking_nsxv3.common.synchronization [req-77d4f109-2db5-4786-a690-01ce744350bb req-c2953c54-bee7-4371-beaa-e8008911dd14 tempest-SecurityGroupsTestJSON-1482814430 tempest-SecurityGroupsTestJSON-1482814430-project-member] Enqueued Resource ID: 132c935b-20db-42bf-b112-71a29e4b953d with Priority: HIGHEST for action port [ 918.450783] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c0c7b91f-f336-4603-ad30-c4ec4ba4e8e1 with Priority: HIGHEST for action security_group_rules [ 918.450783] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e2390617-a1da-45a2-94eb-d162a19e2fae with Priority: HIGHEST for action security_group_rules [ 918.450783] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 132c935b-20db-42bf-b112-71a29e4b953d with Priority: HIGHEST for action port [ 918.450783] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c0c7b91f-f336-4603-ad30-c4ec4ba4e8e1 with Priority: HIGHEST for action security_group_members [ 918.450783] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e2390617-a1da-45a2-94eb-d162a19e2fae with Priority: HIGHEST for action security_group_members [ 918.451192] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c0c7b91f-f336-4603-ad30-c4ec4ba4e8e1 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.451192] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c0c7b91f-f336-4603-ad30-c4ec4ba4e8e1" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.451293] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c0c7b91f-f336-4603-ad30-c4ec4ba4e8e1" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.451511] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c0c7b91f-f336-4603-ad30-c4ec4ba4e8e1" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.451619] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c0c7b91f-f336-4603-ad30-c4ec4ba4e8e1',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 918.452906] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e2390617-a1da-45a2-94eb-d162a19e2fae taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.453121] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e2390617-a1da-45a2-94eb-d162a19e2fae" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.453356] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e2390617-a1da-45a2-94eb-d162a19e2fae" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.453484] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e2390617-a1da-45a2-94eb-d162a19e2fae" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.453587] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e2390617-a1da-45a2-94eb-d162a19e2fae',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 918.454391] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock port-132c935b-20db-42bf-b112-71a29e4b953d taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.455144] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-132c935b-20db-42bf-b112-71a29e4b953d" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.455144] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-132c935b-20db-42bf-b112-71a29e4b953d" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.455144] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-132c935b-20db-42bf-b112-71a29e4b953d" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.455144] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('132c935b-20db-42bf-b112-71a29e4b953d',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 918.455816] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-c0c7b91f-f336-4603-ad30-c4ec4ba4e8e1 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.455997] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c0c7b91f-f336-4603-ad30-c4ec4ba4e8e1" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.456231] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-e2390617-a1da-45a2-94eb-d162a19e2fae taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.456362] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e2390617-a1da-45a2-94eb-d162a19e2fae" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.495304] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('462431af-62e3-426c-a50e-a61604f20358',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 918.636320] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f44b2d06-c9ca-4621-a354-74c006769956 in Status: SUCCESS [ 918.636448] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f44b2d06-c9ca-4621-a354-74c006769956" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.636631] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f44b2d06-c9ca-4621-a354-74c006769956" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.636868] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f44b2d06-c9ca-4621-a354-74c006769956" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.636997] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.637136] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.637224] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.637438] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.637527] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.637616] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f44b2d06-c9ca-4621-a354-74c006769956" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.637762] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f44b2d06-c9ca-4621-a354-74c006769956',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 918.674225] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.674225] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.674225] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.674225] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.674225] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.674225] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Segment Port f15883fd-4eb2-45e2-b642-378dc0f23f8c not found, creating... [ 918.674225] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.674225] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.674225] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.674225] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.674225] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.674643] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.674643] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.674643] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.674643] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.674643] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.674643] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Resource: SegmentPort with ID: f15883fd-4eb2-45e2-b642-378dc0f23f8c is going to be created. [ 918.693433] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.693737] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.693785] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.694088] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.694376] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.694610] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "port-f15883fd-4eb2-45e2-b642-378dc0f23f8c" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.822095] env[69980]: INFO networking_nsxv3.common.synchronization [req-46a64ab3-3237-43c2-8072-33f566aa45b9 req-c5d12f13-de6f-4bda-a1e9-8948cc2a2db3 tempest-VolumesAdminNegativeTest-1476822754 tempest-VolumesAdminNegativeTest-1476822754-project-member] Enqueued Resource ID: 90ae0583-7d65-4cd4-8205-17d3726a65ac with Priority: HIGHEST for action security_group_members [ 918.822623] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 90ae0583-7d65-4cd4-8205-17d3726a65ac with Priority: HIGHEST for action security_group_members [ 918.822994] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-90ae0583-7d65-4cd4-8205-17d3726a65ac taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.823206] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-90ae0583-7d65-4cd4-8205-17d3726a65ac" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.823259] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-90ae0583-7d65-4cd4-8205-17d3726a65ac" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.823458] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-90ae0583-7d65-4cd4-8205-17d3726a65ac" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.825017] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.825017] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.825017] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.825017] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.825017] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.825017] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('90ae0583-7d65-4cd4-8205-17d3726a65ac',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 918.869243] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.869243] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.869243] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.869243] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.869243] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.869243] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7bc12ce3-2b1a-439c-8e90-f01bd1033c9a is going to be updated. [ 918.906581] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.906930] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.907024] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.907262] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.907385] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.908912] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c0c7b91f-f336-4603-ad30-c4ec4ba4e8e1',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 918.910296] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e2390617-a1da-45a2-94eb-d162a19e2fae',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 918.921288] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7bc12ce3-2b1a-439c-8e90-f01bd1033c9a in Status: IN_PROGRESS for 2s [ 918.962020] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-c0c7b91f-f336-4603-ad30-c4ec4ba4e8e1 taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.962020] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c0c7b91f-f336-4603-ad30-c4ec4ba4e8e1" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.962020] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-e2390617-a1da-45a2-94eb-d162a19e2fae taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.962020] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e2390617-a1da-45a2-94eb-d162a19e2fae" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.962020] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 132c935b-20db-42bf-b112-71a29e4b953d with status ACTIVE [ 918.962020] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.962020] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.962020] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.962020] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.962020] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.962020] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.962020] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.962020] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.962020] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.962020] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.963172] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.963172] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.963172] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.963172] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.963172] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.963172] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 132c935b-20db-42bf-b112-71a29e4b953d is going to be updated. [ 918.993818] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.993818] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.993818] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.993818] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.993818] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.993818] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-132c935b-20db-42bf-b112-71a29e4b953d" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.998084] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.998230] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.998299] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.998498] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.998587] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.998679] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 462431af-62e3-426c-a50e-a61604f20358 is going to be updated. [ 919.052430] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.052430] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.052430] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.052430] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.052430] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.059820] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 462431af-62e3-426c-a50e-a61604f20358 in Status: IN_PROGRESS for 2s [ 919.141209] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-f44b2d06-c9ca-4621-a354-74c006769956 taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.141209] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f44b2d06-c9ca-4621-a354-74c006769956" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.141209] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f44b2d06-c9ca-4621-a354-74c006769956" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.143304] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f44b2d06-c9ca-4621-a354-74c006769956" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.143304] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.143304] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.143304] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.144127] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.144127] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.144127] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f44b2d06-c9ca-4621-a354-74c006769956" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.144743] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-f44b2d06-c9ca-4621-a354-74c006769956 taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.144743] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f44b2d06-c9ca-4621-a354-74c006769956" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.144743] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f44b2d06-c9ca-4621-a354-74c006769956" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.144743] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f44b2d06-c9ca-4621-a354-74c006769956" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.144743] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.144743] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.145935] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.145935] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.145935] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.145935] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f44b2d06-c9ca-4621-a354-74c006769956" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.145935] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f44b2d06-c9ca-4621-a354-74c006769956',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 919.328628] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.328811] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.328886] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.329462] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.329462] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.329613] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.329719] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.329776] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.329944] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.330032] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.330122] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 90ae0583-7d65-4cd4-8205-17d3726a65ac is going to be updated. [ 919.355859] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.359143] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.359143] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.359143] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.359143] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.368038] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 90ae0583-7d65-4cd4-8205-17d3726a65ac in Status: IN_PROGRESS for 2s [ 919.412421] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c0c7b91f-f336-4603-ad30-c4ec4ba4e8e1',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 919.416621] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e2390617-a1da-45a2-94eb-d162a19e2fae',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 919.650776] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f44b2d06-c9ca-4621-a354-74c006769956: rpc.has_security_group_logging(os_id): False [ 919.689053] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.689053] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.689053] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.689053] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.718021] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.718021] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.718021] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.718021] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.718021] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.718021] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.718021] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.718021] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.718021] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.718021] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.718021] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.718021] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.718021] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.718021] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.718723] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.718723] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.718723] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f44b2d06-c9ca-4621-a354-74c006769956 is going to be updated. [ 919.783838] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.783838] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.783838] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.783838] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.783838] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.800128] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f44b2d06-c9ca-4621-a354-74c006769956 in Status: IN_PROGRESS for 2s [ 919.915946] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.915946] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.915946] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.916252] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.916252] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.916252] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c0c7b91f-f336-4603-ad30-c4ec4ba4e8e1 is going to be created. [ 919.920629] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.920629] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.920754] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.920919] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.920991] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.921053] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e2390617-a1da-45a2-94eb-d162a19e2fae is going to be updated. [ 919.930213] env[69980]: INFO networking_nsxv3.common.synchronization [req-f49345bd-4f1e-4396-b792-2640a0f08455 req-16715873-d87c-46e6-85fe-e0c3a3b075dd service nova] Enqueued Resource ID: 462431af-62e3-426c-a50e-a61604f20358 with Priority: HIGHEST for action security_group_rules [ 919.930436] env[69980]: INFO networking_nsxv3.common.synchronization [req-f49345bd-4f1e-4396-b792-2640a0f08455 req-16715873-d87c-46e6-85fe-e0c3a3b075dd service nova] Enqueued Resource ID: 462431af-62e3-426c-a50e-a61604f20358 with Priority: HIGHEST for action security_group_members [ 919.930574] env[69980]: INFO networking_nsxv3.common.synchronization [req-f49345bd-4f1e-4396-b792-2640a0f08455 req-16715873-d87c-46e6-85fe-e0c3a3b075dd service nova] Enqueued Resource ID: f15883fd-4eb2-45e2-b642-378dc0f23f8c with Priority: HIGHEST for action port [ 919.931563] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 462431af-62e3-426c-a50e-a61604f20358 with Priority: HIGHEST for action security_group_rules [ 919.931717] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 462431af-62e3-426c-a50e-a61604f20358 with Priority: HIGHEST for action security_group_members [ 919.931819] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f15883fd-4eb2-45e2-b642-378dc0f23f8c with Priority: HIGHEST for action port [ 919.932163] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock rules-462431af-62e3-426c-a50e-a61604f20358 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.932321] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-462431af-62e3-426c-a50e-a61604f20358" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.932379] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-462431af-62e3-426c-a50e-a61604f20358" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.932544] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-462431af-62e3-426c-a50e-a61604f20358" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.932725] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('462431af-62e3-426c-a50e-a61604f20358',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 919.933478] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-462431af-62e3-426c-a50e-a61604f20358 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.933585] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-462431af-62e3-426c-a50e-a61604f20358" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.937019] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock port-f15883fd-4eb2-45e2-b642-378dc0f23f8c taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.937019] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f15883fd-4eb2-45e2-b642-378dc0f23f8c" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.937019] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f15883fd-4eb2-45e2-b642-378dc0f23f8c" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.937019] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f15883fd-4eb2-45e2-b642-378dc0f23f8c" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.937019] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f15883fd-4eb2-45e2-b642-378dc0f23f8c',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 919.951198] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.951198] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.951198] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.951198] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.951198] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.959737] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.959839] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.959897] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.960113] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.960287] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.966565] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c0c7b91f-f336-4603-ad30-c4ec4ba4e8e1 in Status: UNINITIALIZED for 2s [ 919.979446] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e2390617-a1da-45a2-94eb-d162a19e2fae in Status: IN_PROGRESS for 2s [ 920.438075] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-462431af-62e3-426c-a50e-a61604f20358 taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.438075] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-462431af-62e3-426c-a50e-a61604f20358" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.442023] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f15883fd-4eb2-45e2-b642-378dc0f23f8c with status ACTIVE [ 920.442023] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.442023] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.442023] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.442023] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.442023] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.442023] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.442023] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.442023] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.442023] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.442023] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.442023] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.442023] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.442023] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.442023] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.442023] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.442023] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f15883fd-4eb2-45e2-b642-378dc0f23f8c is going to be updated. [ 920.466514] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.467380] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.467653] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.467988] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.468305] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.468664] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f15883fd-4eb2-45e2-b642-378dc0f23f8c" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.864944] env[69980]: INFO networking_nsxv3.common.synchronization [None req-b0ca3deb-2c0a-45e0-976b-2983ae5233a6 None None] Enqueued Resource ID: 2af0fd0f-55e5-4c0b-8f95-4a3833cf099e with Priority: HIGHEST for action port [ 920.865497] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2af0fd0f-55e5-4c0b-8f95-4a3833cf099e with Priority: HIGHEST for action port [ 920.865782] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock port-2af0fd0f-55e5-4c0b-8f95-4a3833cf099e taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.865965] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2af0fd0f-55e5-4c0b-8f95-4a3833cf099e" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.865965] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2af0fd0f-55e5-4c0b-8f95-4a3833cf099e" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.868563] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2af0fd0f-55e5-4c0b-8f95-4a3833cf099e" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.868654] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2af0fd0f-55e5-4c0b-8f95-4a3833cf099e',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 920.931645] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7bc12ce3-2b1a-439c-8e90-f01bd1033c9a in Status: SUCCESS [ 920.931943] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7bc12ce3-2b1a-439c-8e90-f01bd1033c9a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.932035] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7bc12ce3-2b1a-439c-8e90-f01bd1033c9a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.932380] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7bc12ce3-2b1a-439c-8e90-f01bd1033c9a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.932453] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.932546] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.932609] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.932760] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.932841] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.932935] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7bc12ce3-2b1a-439c-8e90-f01bd1033c9a',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 921.070129] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 462431af-62e3-426c-a50e-a61604f20358 in Status: SUCCESS [ 921.070358] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-462431af-62e3-426c-a50e-a61604f20358" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.070527] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-462431af-62e3-426c-a50e-a61604f20358" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.070747] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-462431af-62e3-426c-a50e-a61604f20358" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.070934] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.071071] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.071137] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.071286] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.071369] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.071459] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('462431af-62e3-426c-a50e-a61604f20358',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 921.371765] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 2af0fd0f-55e5-4c0b-8f95-4a3833cf099e [ 921.371765] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.371765] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.371765] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.373395] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.373583] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.373746] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:2af0fd0f-55e5-4c0b-8f95-4a3833cf099e already deleted. [ 921.373985] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2af0fd0f-55e5-4c0b-8f95-4a3833cf099e" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.380731] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 90ae0583-7d65-4cd4-8205-17d3726a65ac in Status: SUCCESS [ 921.380935] env[69980]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 90ae0583-7d65-4cd4-8205-17d3726a65ac deletion is rescheduled due to dependency. [ 921.381066] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-90ae0583-7d65-4cd4-8205-17d3726a65ac" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.440342] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7bc12ce3-2b1a-439c-8e90-f01bd1033c9a',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 921.568336] env[69980]: INFO networking_nsxv3.common.synchronization [req-e7e18e1a-33c5-4f84-a5b0-94bc17542b9a req-f14078cc-3606-437c-9eab-77832ff76593 tempest-ServersAdminNegativeTestJSON-1599780358 tempest-ServersAdminNegativeTestJSON-1599780358-project-member] Enqueued Resource ID: 2961e549-f7d2-46b0-a1f4-9365d96bb58a with Priority: HIGHEST for action security_group_members [ 921.568626] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2961e549-f7d2-46b0-a1f4-9365d96bb58a with Priority: HIGHEST for action security_group_members [ 921.568940] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-2961e549-f7d2-46b0-a1f4-9365d96bb58a taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.569445] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2961e549-f7d2-46b0-a1f4-9365d96bb58a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.569445] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2961e549-f7d2-46b0-a1f4-9365d96bb58a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.569445] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2961e549-f7d2-46b0-a1f4-9365d96bb58a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.569619] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.569980] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.570080] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.570237] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.570391] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.570453] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2961e549-f7d2-46b0-a1f4-9365d96bb58a',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 921.574408] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('462431af-62e3-426c-a50e-a61604f20358',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 921.777793] env[69980]: INFO networking_nsxv3.common.synchronization [req-1706102d-a393-41bf-86f4-3338ce53441f req-8a931626-cbc9-41ad-a748-91aafa948fec tempest-DeleteServersTestJSON-1084822395 tempest-DeleteServersTestJSON-1084822395-project-member] Enqueued Resource ID: d0e04be7-8718-489c-8ceb-fe661da4855a with Priority: HIGHEST for action security_group_members [ 921.778359] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d0e04be7-8718-489c-8ceb-fe661da4855a with Priority: HIGHEST for action security_group_members [ 921.778668] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-d0e04be7-8718-489c-8ceb-fe661da4855a taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.778796] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d0e04be7-8718-489c-8ceb-fe661da4855a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.778867] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d0e04be7-8718-489c-8ceb-fe661da4855a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.780071] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d0e04be7-8718-489c-8ceb-fe661da4855a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.780071] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.780071] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.780071] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.780071] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.780071] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.780335] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d0e04be7-8718-489c-8ceb-fe661da4855a',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 921.812659] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f44b2d06-c9ca-4621-a354-74c006769956 in Status: SUCCESS [ 921.812879] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f44b2d06-c9ca-4621-a354-74c006769956" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.945953] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7bc12ce3-2b1a-439c-8e90-f01bd1033c9a',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 921.976933] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c0c7b91f-f336-4603-ad30-c4ec4ba4e8e1 in Status: SUCCESS [ 921.977137] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c0c7b91f-f336-4603-ad30-c4ec4ba4e8e1" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.977245] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c0c7b91f-f336-4603-ad30-c4ec4ba4e8e1" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.977423] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c0c7b91f-f336-4603-ad30-c4ec4ba4e8e1" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.977706] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.977706] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.977897] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.977897] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.978249] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.978320] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c0c7b91f-f336-4603-ad30-c4ec4ba4e8e1',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 921.986070] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e2390617-a1da-45a2-94eb-d162a19e2fae in Status: SUCCESS [ 921.987132] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e2390617-a1da-45a2-94eb-d162a19e2fae" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.987132] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e2390617-a1da-45a2-94eb-d162a19e2fae" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.987132] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e2390617-a1da-45a2-94eb-d162a19e2fae" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.987132] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.987132] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.987132] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.987539] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.987539] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.987539] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e2390617-a1da-45a2-94eb-d162a19e2fae',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 922.073234] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.073537] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.073658] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.073915] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.075229] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.075514] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.075676] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.075802] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.076319] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.076319] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.076319] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2961e549-f7d2-46b0-a1f4-9365d96bb58a is going to be updated. [ 922.077760] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('462431af-62e3-426c-a50e-a61604f20358',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 922.105954] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.105954] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.105954] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.105954] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.105954] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.127844] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2961e549-f7d2-46b0-a1f4-9365d96bb58a in Status: IN_PROGRESS for 2s [ 922.282990] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.282990] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.282990] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.282990] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.282990] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.282990] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.283614] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.283614] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.283614] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.283614] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.283614] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d0e04be7-8718-489c-8ceb-fe661da4855a already deleted. [ 922.283614] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d0e04be7-8718-489c-8ceb-fe661da4855a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.310449] env[69980]: INFO networking_nsxv3.common.synchronization [None req-c0862f01-400b-4ed5-8239-f567cf637fed tempest-ServerActionsTestOtherB-1413576659 tempest-ServerActionsTestOtherB-1413576659-project-member] Enqueued Resource ID: 72f0fad5-906a-4ed9-a922-fdb13010a34d with Priority: HIGHEST for action security_group_rules [ 922.311023] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 72f0fad5-906a-4ed9-a922-fdb13010a34d with Priority: HIGHEST for action security_group_rules [ 922.311556] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock rules-72f0fad5-906a-4ed9-a922-fdb13010a34d taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.311556] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-72f0fad5-906a-4ed9-a922-fdb13010a34d" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.311556] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-72f0fad5-906a-4ed9-a922-fdb13010a34d" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.311799] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-72f0fad5-906a-4ed9-a922-fdb13010a34d" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.311848] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('72f0fad5-906a-4ed9-a922-fdb13010a34d',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 922.401724] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock network-478 taken with stack trace [, , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.401919] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "network-478" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.402110] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "network-478" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.402461] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "network-478" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.402741] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.402897] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.403033] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.403800] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.403953] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.405478] env[69980]: DEBUG dogpile.cache.region [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] No value present for key: 'zone-id' {{(pid=69980) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 922.405478] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] NeedRegenerationException {{(pid=69980) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 922.405478] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] no value, waiting for create lock {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 922.405478] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] value creation lock acquired {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 922.405478] env[69980]: DEBUG dogpile.cache.region [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] No value present for key: 'zone-id' {{(pid=69980) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 922.405478] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Calling creation function for not-yet-present value {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 922.405478] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 922.425053] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 922.425663] env[69980]: DEBUG dogpile.cache.region [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=69980) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 922.425890] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Released creation lock {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 922.426139] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "network-478" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.427430] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock port-d3299229-b795-4738-aee3-cec19d91de34 taken with stack trace [, , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.427724] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "port-d3299229-b795-4738-aee3-cec19d91de34" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.427857] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "port-d3299229-b795-4738-aee3-cec19d91de34" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.428224] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "port-d3299229-b795-4738-aee3-cec19d91de34" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.428347] env[69980]: DEBUG networking_nsxv3.api.rpc [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d3299229-b795-4738-aee3-cec19d91de34',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 922.453842] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.453842] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.453842] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.453842] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.453842] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.453842] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7bc12ce3-2b1a-439c-8e90-f01bd1033c9a is going to be updated. [ 922.480254] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c0c7b91f-f336-4603-ad30-c4ec4ba4e8e1',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 922.482192] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.482417] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.482534] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.483114] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.483114] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.491740] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7bc12ce3-2b1a-439c-8e90-f01bd1033c9a in Status: IN_PROGRESS for 2s [ 922.495800] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e2390617-a1da-45a2-94eb-d162a19e2fae',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 922.582880] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.582880] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.582880] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.582880] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.582880] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.582880] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 462431af-62e3-426c-a50e-a61604f20358 is going to be updated. [ 922.609954] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.609954] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.609954] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.609954] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.609954] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.619160] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 462431af-62e3-426c-a50e-a61604f20358 in Status: IN_PROGRESS for 2s [ 922.771779] env[69980]: INFO networking_nsxv3.common.synchronization [None req-f9e6772a-bb1f-47ed-86eb-f19f659966e6 tempest-ServerActionsTestOtherB-1413576659 tempest-ServerActionsTestOtherB-1413576659-project-member] Enqueued Resource ID: 72f0fad5-906a-4ed9-a922-fdb13010a34d with Priority: HIGHEST for action security_group_rules [ 922.772851] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 72f0fad5-906a-4ed9-a922-fdb13010a34d with Priority: HIGHEST for action security_group_rules [ 922.772851] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock rules-72f0fad5-906a-4ed9-a922-fdb13010a34d taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.773537] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-72f0fad5-906a-4ed9-a922-fdb13010a34d" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.838326] env[69980]: INFO networking_nsxv3.common.synchronization [req-2a536e32-00da-48ba-8a4a-5e5d4fda7ce8 req-8ecc45f1-7880-404f-a935-645a8ee602cc tempest-ServersNegativeTestJSON-1861659283 tempest-ServersNegativeTestJSON-1861659283-project-member] Enqueued Resource ID: f44b2d06-c9ca-4621-a354-74c006769956 with Priority: HIGHEST for action security_group_members [ 922.839372] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.839493] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.839554] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.839743] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.839826] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.843022] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 72f0fad5-906a-4ed9-a922-fdb13010a34d already deleted. [ 922.843022] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-72f0fad5-906a-4ed9-a922-fdb13010a34d" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.843022] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f44b2d06-c9ca-4621-a354-74c006769956 with Priority: HIGHEST for action security_group_members [ 922.843022] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-72f0fad5-906a-4ed9-a922-fdb13010a34d" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.843022] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-72f0fad5-906a-4ed9-a922-fdb13010a34d" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.843022] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('72f0fad5-906a-4ed9-a922-fdb13010a34d',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 922.843022] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-f44b2d06-c9ca-4621-a354-74c006769956 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.843022] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f44b2d06-c9ca-4621-a354-74c006769956" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.843022] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f44b2d06-c9ca-4621-a354-74c006769956" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.843022] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f44b2d06-c9ca-4621-a354-74c006769956" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.843022] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.843022] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.843022] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.843022] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.843022] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.843022] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f44b2d06-c9ca-4621-a354-74c006769956',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 922.930312] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.930569] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.930708] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.931011] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.931196] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.931368] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Segment Port d3299229-b795-4738-aee3-cec19d91de34 not found, creating... [ 922.931657] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.931820] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.931952] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.932236] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.932394] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.932690] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.932855] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.932986] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.933375] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.933511] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.933681] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Resource: SegmentPort with ID: d3299229-b795-4738-aee3-cec19d91de34 is going to be created. [ 922.954481] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.954820] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.954820] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.959017] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.959017] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.959017] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "port-d3299229-b795-4738-aee3-cec19d91de34" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.985836] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c0c7b91f-f336-4603-ad30-c4ec4ba4e8e1',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 922.999238] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e2390617-a1da-45a2-94eb-d162a19e2fae',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 923.332189] env[69980]: INFO networking_nsxv3.common.synchronization [None req-c31bf28c-5e90-4a00-adb6-07af5eae4232 None None] Enqueued Resource ID: 45d75232-8f02-4104-ae83-91b5653af95b with Priority: HIGHEST for action port [ 923.332189] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 45d75232-8f02-4104-ae83-91b5653af95b with Priority: HIGHEST for action port [ 923.332189] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock port-45d75232-8f02-4104-ae83-91b5653af95b taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.332189] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-45d75232-8f02-4104-ae83-91b5653af95b" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.332189] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-45d75232-8f02-4104-ae83-91b5653af95b" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.332879] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-45d75232-8f02-4104-ae83-91b5653af95b" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.333119] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('45d75232-8f02-4104-ae83-91b5653af95b',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 923.347742] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f44b2d06-c9ca-4621-a354-74c006769956',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 923.362443] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.362882] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.363087] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.363473] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.364163] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.364163] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 72f0fad5-906a-4ed9-a922-fdb13010a34d already deleted. [ 923.364163] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-72f0fad5-906a-4ed9-a922-fdb13010a34d" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.491187] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.491355] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.491429] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.491637] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.491728] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.491828] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c0c7b91f-f336-4603-ad30-c4ec4ba4e8e1 is going to be updated. [ 923.505293] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.505293] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.505293] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.505293] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.505293] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.505293] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e2390617-a1da-45a2-94eb-d162a19e2fae is going to be updated. [ 923.522790] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.522941] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.523027] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.523252] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.523399] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.530768] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c0c7b91f-f336-4603-ad30-c4ec4ba4e8e1 in Status: IN_PROGRESS for 2s [ 923.541621] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.541621] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.541621] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.541621] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.541621] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.553378] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e2390617-a1da-45a2-94eb-d162a19e2fae in Status: IN_PROGRESS for 2s [ 923.836762] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 45d75232-8f02-4104-ae83-91b5653af95b [ 923.837073] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.837270] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.837352] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.837598] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.837695] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.837791] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:45d75232-8f02-4104-ae83-91b5653af95b already deleted. [ 923.837882] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-45d75232-8f02-4104-ae83-91b5653af95b" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.847331] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f44b2d06-c9ca-4621-a354-74c006769956',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 923.988960] env[69980]: INFO networking_nsxv3.common.synchronization [req-1706102d-a393-41bf-86f4-3338ce53441f req-24f19202-e247-487e-a7d1-bbe864119287 service nova] Enqueued Resource ID: d0e04be7-8718-489c-8ceb-fe661da4855a with Priority: HIGHEST for action security_group_rules [ 923.989279] env[69980]: INFO networking_nsxv3.common.synchronization [req-1706102d-a393-41bf-86f4-3338ce53441f req-24f19202-e247-487e-a7d1-bbe864119287 service nova] Enqueued Resource ID: d0e04be7-8718-489c-8ceb-fe661da4855a with Priority: HIGHEST for action security_group_members [ 923.989499] env[69980]: INFO networking_nsxv3.common.synchronization [req-1706102d-a393-41bf-86f4-3338ce53441f req-24f19202-e247-487e-a7d1-bbe864119287 service nova] Enqueued Resource ID: d3299229-b795-4738-aee3-cec19d91de34 with Priority: HIGHEST for action port [ 923.993312] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d0e04be7-8718-489c-8ceb-fe661da4855a with Priority: HIGHEST for action security_group_rules [ 923.993312] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d0e04be7-8718-489c-8ceb-fe661da4855a with Priority: HIGHEST for action security_group_members [ 923.993312] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d3299229-b795-4738-aee3-cec19d91de34 with Priority: HIGHEST for action port [ 923.994694] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d0e04be7-8718-489c-8ceb-fe661da4855a taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.995323] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d0e04be7-8718-489c-8ceb-fe661da4855a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.995323] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d0e04be7-8718-489c-8ceb-fe661da4855a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.995668] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d0e04be7-8718-489c-8ceb-fe661da4855a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.995800] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d0e04be7-8718-489c-8ceb-fe661da4855a',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 923.999057] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-d0e04be7-8718-489c-8ceb-fe661da4855a taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.999057] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d0e04be7-8718-489c-8ceb-fe661da4855a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.999057] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d0e04be7-8718-489c-8ceb-fe661da4855a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.999057] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d0e04be7-8718-489c-8ceb-fe661da4855a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.999057] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.999057] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.999057] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.999057] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.999057] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.999057] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d0e04be7-8718-489c-8ceb-fe661da4855a',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 923.999057] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock port-d3299229-b795-4738-aee3-cec19d91de34 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.999057] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d3299229-b795-4738-aee3-cec19d91de34" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.999057] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d3299229-b795-4738-aee3-cec19d91de34" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.999057] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d3299229-b795-4738-aee3-cec19d91de34" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.999057] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d3299229-b795-4738-aee3-cec19d91de34',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 924.139391] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2961e549-f7d2-46b0-a1f4-9365d96bb58a in Status: SUCCESS [ 924.139609] env[69980]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2961e549-f7d2-46b0-a1f4-9365d96bb58a deletion is rescheduled due to dependency. [ 924.139702] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2961e549-f7d2-46b0-a1f4-9365d96bb58a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.314598] env[69980]: INFO networking_nsxv3.common.synchronization [req-3719a7e8-748b-4eaf-93d3-a838e1cf7e05 req-59bba249-d86f-495e-ba8d-ee827b377f86 tempest-AttachInterfacesTestJSON-1782090316 tempest-AttachInterfacesTestJSON-1782090316-project-member] Enqueued Resource ID: 7f2e833b-9263-48ef-ba09-f0afee0fa4af with Priority: HIGHEST for action security_group_members [ 924.315483] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7f2e833b-9263-48ef-ba09-f0afee0fa4af with Priority: HIGHEST for action security_group_members [ 924.315582] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-7f2e833b-9263-48ef-ba09-f0afee0fa4af taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.316216] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7f2e833b-9263-48ef-ba09-f0afee0fa4af" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.316216] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7f2e833b-9263-48ef-ba09-f0afee0fa4af" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.316216] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7f2e833b-9263-48ef-ba09-f0afee0fa4af" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.316454] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.316454] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.316561] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.317669] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.317669] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.317669] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7f2e833b-9263-48ef-ba09-f0afee0fa4af',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 924.351570] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.351718] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.351788] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.352160] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.352278] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.352384] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f44b2d06-c9ca-4621-a354-74c006769956 is going to be updated. [ 924.379124] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.379265] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.379333] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.379540] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.379677] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.389644] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f44b2d06-c9ca-4621-a354-74c006769956 in Status: IN_PROGRESS for 2s [ 924.504018] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-d0e04be7-8718-489c-8ceb-fe661da4855a taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.504018] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d0e04be7-8718-489c-8ceb-fe661da4855a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.504018] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d3299229-b795-4738-aee3-cec19d91de34 with status ACTIVE [ 924.504018] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.504018] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.504018] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.504018] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.504018] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.504018] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.504018] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.504018] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.504018] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.504018] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.504018] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.504740] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.504740] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.504740] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.504740] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.504740] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d3299229-b795-4738-aee3-cec19d91de34 is going to be updated. [ 924.505235] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d0e04be7-8718-489c-8ceb-fe661da4855a',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 924.514918] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7bc12ce3-2b1a-439c-8e90-f01bd1033c9a in Status: SUCCESS [ 924.515402] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7bc12ce3-2b1a-439c-8e90-f01bd1033c9a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.515659] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7bc12ce3-2b1a-439c-8e90-f01bd1033c9a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.516037] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7bc12ce3-2b1a-439c-8e90-f01bd1033c9a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.516343] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.516611] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.516766] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.517279] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.517526] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.517738] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7bc12ce3-2b1a-439c-8e90-f01bd1033c9a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.518294] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-7bc12ce3-2b1a-439c-8e90-f01bd1033c9a taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.519015] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7bc12ce3-2b1a-439c-8e90-f01bd1033c9a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.519015] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7bc12ce3-2b1a-439c-8e90-f01bd1033c9a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.519015] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7bc12ce3-2b1a-439c-8e90-f01bd1033c9a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.519015] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.521674] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.521674] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.521674] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.521674] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.521674] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7bc12ce3-2b1a-439c-8e90-f01bd1033c9a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.521674] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7bc12ce3-2b1a-439c-8e90-f01bd1033c9a',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 924.525273] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.527750] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.527750] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.527750] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.527750] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.527750] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d3299229-b795-4738-aee3-cec19d91de34" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.628759] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 462431af-62e3-426c-a50e-a61604f20358 in Status: IN_PROGRESS for 4s [ 924.823223] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.823223] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.823223] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.823223] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.823223] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.823223] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.823223] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.823223] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.823223] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.823223] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.823223] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7f2e833b-9263-48ef-ba09-f0afee0fa4af already deleted. [ 924.823223] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7f2e833b-9263-48ef-ba09-f0afee0fa4af" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.838053] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock network-762 taken with stack trace [, , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.838053] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "network-762" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.838053] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "network-762" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.838053] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "network-762" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.838053] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.838053] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.838053] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.838053] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.838053] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.840525] env[69980]: DEBUG dogpile.cache.region [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] No value present for key: 'zone-id' {{(pid=69980) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 924.840848] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] NeedRegenerationException {{(pid=69980) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 924.841270] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] no value, waiting for create lock {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 924.841523] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] value creation lock acquired {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 924.841747] env[69980]: DEBUG dogpile.cache.region [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] No value present for key: 'zone-id' {{(pid=69980) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 924.842164] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Calling creation function for not-yet-present value {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 924.842430] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 924.864114] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 924.864448] env[69980]: DEBUG dogpile.cache.region [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=69980) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 924.864694] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Released creation lock {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 924.864962] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "network-762" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.865456] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock port-ca7ae93b-3381-40dc-b8d8-fb59df25598f taken with stack trace [, , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.865775] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "port-ca7ae93b-3381-40dc-b8d8-fb59df25598f" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.866028] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "port-ca7ae93b-3381-40dc-b8d8-fb59df25598f" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.866418] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "port-ca7ae93b-3381-40dc-b8d8-fb59df25598f" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.866669] env[69980]: DEBUG networking_nsxv3.api.rpc [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ca7ae93b-3381-40dc-b8d8-fb59df25598f',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 924.886647] env[69980]: INFO networking_nsxv3.common.synchronization [req-9ede74ae-b40a-4cd7-b82f-08797dbc183f req-9113f156-cb75-4bf2-b6a7-b0783f757bd0 tempest-SecurityGroupsTestJSON-1482814430 tempest-SecurityGroupsTestJSON-1482814430-project-member] Enqueued Resource ID: e2390617-a1da-45a2-94eb-d162a19e2fae with Priority: HIGHEST for action security_group_members [ 924.886647] env[69980]: INFO networking_nsxv3.common.synchronization [req-9ede74ae-b40a-4cd7-b82f-08797dbc183f req-9113f156-cb75-4bf2-b6a7-b0783f757bd0 tempest-SecurityGroupsTestJSON-1482814430 tempest-SecurityGroupsTestJSON-1482814430-project-member] Enqueued Resource ID: 22fc6fbb-1b17-4fd0-be2f-fa94d76ac770 with Priority: HIGHEST for action security_group_members [ 924.886647] env[69980]: INFO networking_nsxv3.common.synchronization [req-9ede74ae-b40a-4cd7-b82f-08797dbc183f req-9113f156-cb75-4bf2-b6a7-b0783f757bd0 tempest-SecurityGroupsTestJSON-1482814430 tempest-SecurityGroupsTestJSON-1482814430-project-member] Enqueued Resource ID: c0c7b91f-f336-4603-ad30-c4ec4ba4e8e1 with Priority: HIGHEST for action security_group_members [ 924.886647] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e2390617-a1da-45a2-94eb-d162a19e2fae with Priority: HIGHEST for action security_group_members [ 924.886647] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 22fc6fbb-1b17-4fd0-be2f-fa94d76ac770 with Priority: HIGHEST for action security_group_members [ 924.886647] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c0c7b91f-f336-4603-ad30-c4ec4ba4e8e1 with Priority: HIGHEST for action security_group_members [ 924.887368] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-e2390617-a1da-45a2-94eb-d162a19e2fae taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.887592] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e2390617-a1da-45a2-94eb-d162a19e2fae" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.887878] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-22fc6fbb-1b17-4fd0-be2f-fa94d76ac770 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.888367] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-22fc6fbb-1b17-4fd0-be2f-fa94d76ac770" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.888518] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-22fc6fbb-1b17-4fd0-be2f-fa94d76ac770" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.888836] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-22fc6fbb-1b17-4fd0-be2f-fa94d76ac770" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.889094] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.889321] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.889469] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.889715] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.889889] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.890075] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('22fc6fbb-1b17-4fd0-be2f-fa94d76ac770',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 924.891311] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-c0c7b91f-f336-4603-ad30-c4ec4ba4e8e1 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.891538] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c0c7b91f-f336-4603-ad30-c4ec4ba4e8e1" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.943421] env[69980]: INFO networking_nsxv3.common.synchronization [req-9ede74ae-b40a-4cd7-b82f-08797dbc183f req-9113f156-cb75-4bf2-b6a7-b0783f757bd0 tempest-SecurityGroupsTestJSON-1482814430 tempest-SecurityGroupsTestJSON-1482814430-project-member] Enqueued Resource ID: 22fc6fbb-1b17-4fd0-be2f-fa94d76ac770 with Priority: HIGHEST for action security_group_rules [ 924.944441] env[69980]: INFO networking_nsxv3.common.synchronization [req-9ede74ae-b40a-4cd7-b82f-08797dbc183f req-9113f156-cb75-4bf2-b6a7-b0783f757bd0 tempest-SecurityGroupsTestJSON-1482814430 tempest-SecurityGroupsTestJSON-1482814430-project-member] Enqueued Resource ID: 22fc6fbb-1b17-4fd0-be2f-fa94d76ac770 with Priority: HIGHEST for action security_group_members [ 924.944731] env[69980]: INFO networking_nsxv3.common.synchronization [req-9ede74ae-b40a-4cd7-b82f-08797dbc183f req-9113f156-cb75-4bf2-b6a7-b0783f757bd0 tempest-SecurityGroupsTestJSON-1482814430 tempest-SecurityGroupsTestJSON-1482814430-project-member] Enqueued Resource ID: c0c7b91f-f336-4603-ad30-c4ec4ba4e8e1 with Priority: HIGHEST for action security_group_rules [ 924.944993] env[69980]: INFO networking_nsxv3.common.synchronization [req-9ede74ae-b40a-4cd7-b82f-08797dbc183f req-9113f156-cb75-4bf2-b6a7-b0783f757bd0 tempest-SecurityGroupsTestJSON-1482814430 tempest-SecurityGroupsTestJSON-1482814430-project-member] Enqueued Resource ID: c0c7b91f-f336-4603-ad30-c4ec4ba4e8e1 with Priority: HIGHEST for action security_group_members [ 924.945748] env[69980]: INFO networking_nsxv3.common.synchronization [req-9ede74ae-b40a-4cd7-b82f-08797dbc183f req-9113f156-cb75-4bf2-b6a7-b0783f757bd0 tempest-SecurityGroupsTestJSON-1482814430 tempest-SecurityGroupsTestJSON-1482814430-project-member] Enqueued Resource ID: e2390617-a1da-45a2-94eb-d162a19e2fae with Priority: HIGHEST for action security_group_rules [ 924.946460] env[69980]: INFO networking_nsxv3.common.synchronization [req-9ede74ae-b40a-4cd7-b82f-08797dbc183f req-9113f156-cb75-4bf2-b6a7-b0783f757bd0 tempest-SecurityGroupsTestJSON-1482814430 tempest-SecurityGroupsTestJSON-1482814430-project-member] Enqueued Resource ID: e2390617-a1da-45a2-94eb-d162a19e2fae with Priority: HIGHEST for action security_group_members [ 924.949018] env[69980]: INFO networking_nsxv3.common.synchronization [req-9ede74ae-b40a-4cd7-b82f-08797dbc183f req-9113f156-cb75-4bf2-b6a7-b0783f757bd0 tempest-SecurityGroupsTestJSON-1482814430 tempest-SecurityGroupsTestJSON-1482814430-project-member] Enqueued Resource ID: 132c935b-20db-42bf-b112-71a29e4b953d with Priority: HIGHEST for action port [ 924.949018] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 22fc6fbb-1b17-4fd0-be2f-fa94d76ac770 with Priority: HIGHEST for action security_group_rules [ 924.949018] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c0c7b91f-f336-4603-ad30-c4ec4ba4e8e1 with Priority: HIGHEST for action security_group_rules [ 924.949018] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e2390617-a1da-45a2-94eb-d162a19e2fae with Priority: HIGHEST for action security_group_members [ 924.949018] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 132c935b-20db-42bf-b112-71a29e4b953d with Priority: HIGHEST for action port [ 924.949018] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e2390617-a1da-45a2-94eb-d162a19e2fae with Priority: HIGHEST for action security_group_rules [ 924.949018] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 22fc6fbb-1b17-4fd0-be2f-fa94d76ac770 with Priority: HIGHEST for action security_group_members [ 924.949018] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c0c7b91f-f336-4603-ad30-c4ec4ba4e8e1 with Priority: HIGHEST for action security_group_members [ 924.949018] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock rules-22fc6fbb-1b17-4fd0-be2f-fa94d76ac770 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.949018] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-22fc6fbb-1b17-4fd0-be2f-fa94d76ac770" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.949018] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-22fc6fbb-1b17-4fd0-be2f-fa94d76ac770" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.949829] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-22fc6fbb-1b17-4fd0-be2f-fa94d76ac770" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.950059] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('22fc6fbb-1b17-4fd0-be2f-fa94d76ac770',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 924.951099] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c0c7b91f-f336-4603-ad30-c4ec4ba4e8e1 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.951337] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c0c7b91f-f336-4603-ad30-c4ec4ba4e8e1" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.951660] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-e2390617-a1da-45a2-94eb-d162a19e2fae taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.952241] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e2390617-a1da-45a2-94eb-d162a19e2fae" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.952816] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock port-132c935b-20db-42bf-b112-71a29e4b953d taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.953188] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-132c935b-20db-42bf-b112-71a29e4b953d" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.954031] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-132c935b-20db-42bf-b112-71a29e4b953d" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.954031] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-132c935b-20db-42bf-b112-71a29e4b953d" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.954031] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('132c935b-20db-42bf-b112-71a29e4b953d',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 924.954725] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e2390617-a1da-45a2-94eb-d162a19e2fae taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.954935] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e2390617-a1da-45a2-94eb-d162a19e2fae" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.955404] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-22fc6fbb-1b17-4fd0-be2f-fa94d76ac770 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.955591] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-22fc6fbb-1b17-4fd0-be2f-fa94d76ac770" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.956667] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-c0c7b91f-f336-4603-ad30-c4ec4ba4e8e1 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.956667] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c0c7b91f-f336-4603-ad30-c4ec4ba4e8e1" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.011201] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d0e04be7-8718-489c-8ceb-fe661da4855a',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 925.025053] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7bc12ce3-2b1a-439c-8e90-f01bd1033c9a: rpc.has_security_group_logging(os_id): False [ 925.042656] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.042845] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.042845] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.043025] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.043118] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.043358] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.043463] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.043530] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.043691] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.043770] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.043946] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.044059] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.044138] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.044292] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.044369] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.046635] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.047171] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.047272] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.047837] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.047963] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.049052] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7bc12ce3-2b1a-439c-8e90-f01bd1033c9a is going to be created. [ 925.122401] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.122401] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.122401] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.122401] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.122401] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.149671] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7bc12ce3-2b1a-439c-8e90-f01bd1033c9a in Status: IN_PROGRESS for 2s [ 925.369908] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.370049] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.370239] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.370492] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.371386] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.371386] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Segment Port ca7ae93b-3381-40dc-b8d8-fb59df25598f not found, creating... [ 925.371386] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.371625] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.372652] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.372652] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.372652] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.372880] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.372880] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.373062] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.373183] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.373527] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.373527] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Resource: SegmentPort with ID: ca7ae93b-3381-40dc-b8d8-fb59df25598f is going to be created. [ 925.392628] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.392875] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.392968] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.393325] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.393594] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.393784] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "port-ca7ae93b-3381-40dc-b8d8-fb59df25598f" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.394889] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('22fc6fbb-1b17-4fd0-be2f-fa94d76ac770',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 925.458969] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 132c935b-20db-42bf-b112-71a29e4b953d with status ACTIVE [ 925.458969] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.458969] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.458969] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.460025] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.460025] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.460025] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.460025] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.460025] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.460025] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.460327] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.460584] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.460723] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.460834] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.461076] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.461174] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.461266] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 132c935b-20db-42bf-b112-71a29e4b953d is going to be updated. [ 925.463306] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-22fc6fbb-1b17-4fd0-be2f-fa94d76ac770 taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.463507] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-22fc6fbb-1b17-4fd0-be2f-fa94d76ac770" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.489464] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.490151] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.490151] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.490151] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.490151] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.490763] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-132c935b-20db-42bf-b112-71a29e4b953d" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.517336] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.517336] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.517336] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.517336] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.517336] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.517336] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d0e04be7-8718-489c-8ceb-fe661da4855a is going to be created. [ 925.539857] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.539996] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.540077] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.540318] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.540512] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.544433] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c0c7b91f-f336-4603-ad30-c4ec4ba4e8e1 in Status: SUCCESS [ 925.544433] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c0c7b91f-f336-4603-ad30-c4ec4ba4e8e1" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.544433] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c0c7b91f-f336-4603-ad30-c4ec4ba4e8e1" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.544433] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c0c7b91f-f336-4603-ad30-c4ec4ba4e8e1" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.544433] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.544734] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.544801] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.546093] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.546359] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.546953] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c0c7b91f-f336-4603-ad30-c4ec4ba4e8e1" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.547134] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c0c7b91f-f336-4603-ad30-c4ec4ba4e8e1',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 925.548055] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c0c7b91f-f336-4603-ad30-c4ec4ba4e8e1" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.548483] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c0c7b91f-f336-4603-ad30-c4ec4ba4e8e1" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.548693] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.548832] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.548921] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.549117] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.549228] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.549344] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c0c7b91f-f336-4603-ad30-c4ec4ba4e8e1',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 925.569254] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e2390617-a1da-45a2-94eb-d162a19e2fae in Status: SUCCESS [ 925.569523] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e2390617-a1da-45a2-94eb-d162a19e2fae" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.569885] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e2390617-a1da-45a2-94eb-d162a19e2fae" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.570172] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e2390617-a1da-45a2-94eb-d162a19e2fae" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.570440] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.570563] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.570621] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.570809] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.570893] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.570977] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e2390617-a1da-45a2-94eb-d162a19e2fae" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.571085] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e2390617-a1da-45a2-94eb-d162a19e2fae',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 925.573555] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d0e04be7-8718-489c-8ceb-fe661da4855a in Status: UNINITIALIZED for 2s [ 925.573671] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e2390617-a1da-45a2-94eb-d162a19e2fae" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.573837] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e2390617-a1da-45a2-94eb-d162a19e2fae" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.574017] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.574185] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.574245] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.574386] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.574461] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.574557] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e2390617-a1da-45a2-94eb-d162a19e2fae',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 925.897613] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('22fc6fbb-1b17-4fd0-be2f-fa94d76ac770',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 926.051026] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c0c7b91f-f336-4603-ad30-c4ec4ba4e8e1',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 926.052287] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c0c7b91f-f336-4603-ad30-c4ec4ba4e8e1',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 926.076392] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-e2390617-a1da-45a2-94eb-d162a19e2fae taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.076587] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e2390617-a1da-45a2-94eb-d162a19e2fae" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.076702] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e2390617-a1da-45a2-94eb-d162a19e2fae',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 926.406149] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f44b2d06-c9ca-4621-a354-74c006769956 in Status: SUCCESS [ 926.406423] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f44b2d06-c9ca-4621-a354-74c006769956" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.408302] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.408493] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.408560] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.408762] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.408840] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.409106] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 22fc6fbb-1b17-4fd0-be2f-fa94d76ac770 is going to be created. [ 926.430792] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.430961] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.431051] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.431344] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.431744] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.442607] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 22fc6fbb-1b17-4fd0-be2f-fa94d76ac770 in Status: UNINITIALIZED for 2s [ 926.539542] env[69980]: INFO networking_nsxv3.common.synchronization [req-3719a7e8-748b-4eaf-93d3-a838e1cf7e05 req-e0536188-bf3b-4c1b-9943-b54e0d0c0248 service nova] Enqueued Resource ID: 7f2e833b-9263-48ef-ba09-f0afee0fa4af with Priority: HIGHEST for action security_group_rules [ 926.539542] env[69980]: INFO networking_nsxv3.common.synchronization [req-3719a7e8-748b-4eaf-93d3-a838e1cf7e05 req-e0536188-bf3b-4c1b-9943-b54e0d0c0248 service nova] Enqueued Resource ID: 7f2e833b-9263-48ef-ba09-f0afee0fa4af with Priority: HIGHEST for action security_group_members [ 926.539542] env[69980]: INFO networking_nsxv3.common.synchronization [req-3719a7e8-748b-4eaf-93d3-a838e1cf7e05 req-e0536188-bf3b-4c1b-9943-b54e0d0c0248 service nova] Enqueued Resource ID: ca7ae93b-3381-40dc-b8d8-fb59df25598f with Priority: HIGHEST for action port [ 926.539542] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7f2e833b-9263-48ef-ba09-f0afee0fa4af with Priority: HIGHEST for action security_group_rules [ 926.539542] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7f2e833b-9263-48ef-ba09-f0afee0fa4af with Priority: HIGHEST for action security_group_members [ 926.539542] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ca7ae93b-3381-40dc-b8d8-fb59df25598f with Priority: HIGHEST for action port [ 926.539542] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7f2e833b-9263-48ef-ba09-f0afee0fa4af taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.540322] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7f2e833b-9263-48ef-ba09-f0afee0fa4af" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.540680] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7f2e833b-9263-48ef-ba09-f0afee0fa4af" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.541109] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7f2e833b-9263-48ef-ba09-f0afee0fa4af" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.541309] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7f2e833b-9263-48ef-ba09-f0afee0fa4af',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 926.542680] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-7f2e833b-9263-48ef-ba09-f0afee0fa4af taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.542970] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7f2e833b-9263-48ef-ba09-f0afee0fa4af" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.543162] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7f2e833b-9263-48ef-ba09-f0afee0fa4af" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.543645] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7f2e833b-9263-48ef-ba09-f0afee0fa4af" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.544045] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.544337] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.545135] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.545135] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.545135] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.545135] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7f2e833b-9263-48ef-ba09-f0afee0fa4af',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 926.546256] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock port-ca7ae93b-3381-40dc-b8d8-fb59df25598f taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.546536] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ca7ae93b-3381-40dc-b8d8-fb59df25598f" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.546920] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ca7ae93b-3381-40dc-b8d8-fb59df25598f" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.548776] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ca7ae93b-3381-40dc-b8d8-fb59df25598f" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.548776] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ca7ae93b-3381-40dc-b8d8-fb59df25598f',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 926.554077] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c0c7b91f-f336-4603-ad30-c4ec4ba4e8e1: rpc.has_security_group_logging(os_id): False [ 926.556535] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c0c7b91f-f336-4603-ad30-c4ec4ba4e8e1',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 926.576278] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.576278] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.576278] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.576278] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.576278] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.576278] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.576278] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.576278] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.576278] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.576278] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.576278] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c0c7b91f-f336-4603-ad30-c4ec4ba4e8e1 is going to be created. [ 926.578881] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e2390617-a1da-45a2-94eb-d162a19e2fae',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 926.609511] env[69980]: INFO networking_nsxv3.common.synchronization [None req-594ddd4a-3973-4594-a370-e381b242c350 None None] Enqueued Resource ID: 7b9ad180-8a13-4fea-bba0-44a41d22d7d2 with Priority: HIGHEST for action port [ 926.610023] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7b9ad180-8a13-4fea-bba0-44a41d22d7d2 with Priority: HIGHEST for action port [ 926.610511] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock port-7b9ad180-8a13-4fea-bba0-44a41d22d7d2 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.610731] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7b9ad180-8a13-4fea-bba0-44a41d22d7d2" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.610731] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7b9ad180-8a13-4fea-bba0-44a41d22d7d2" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.610952] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7b9ad180-8a13-4fea-bba0-44a41d22d7d2" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.611250] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7b9ad180-8a13-4fea-bba0-44a41d22d7d2',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 926.633016] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.633510] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.633593] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.633780] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.633951] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.639716] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 462431af-62e3-426c-a50e-a61604f20358 in Status: SUCCESS [ 926.639914] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-462431af-62e3-426c-a50e-a61604f20358" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.640085] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-462431af-62e3-426c-a50e-a61604f20358" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.640281] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-462431af-62e3-426c-a50e-a61604f20358" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.640463] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.640576] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.640633] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.640784] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.640899] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.641052] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-462431af-62e3-426c-a50e-a61604f20358" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.641153] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('462431af-62e3-426c-a50e-a61604f20358',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 926.645300] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c0c7b91f-f336-4603-ad30-c4ec4ba4e8e1 in Status: IN_PROGRESS for 2s [ 926.965454] env[69980]: INFO networking_nsxv3.common.synchronization [req-50923bc2-2a15-45cd-ba8e-28b9dd626347 req-6544ccfd-d77b-4d86-bfce-861a30eaf5be tempest-ServersNegativeTestMultiTenantJSON-449274158 tempest-ServersNegativeTestMultiTenantJSON-449274158-project-member] Enqueued Resource ID: 30a735ee-d68e-4b01-87b7-59775ace11cc with Priority: HIGHEST for action security_group_members [ 926.965960] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 30a735ee-d68e-4b01-87b7-59775ace11cc with Priority: HIGHEST for action security_group_members [ 926.966272] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-30a735ee-d68e-4b01-87b7-59775ace11cc taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.966397] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-30a735ee-d68e-4b01-87b7-59775ace11cc" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.966461] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-30a735ee-d68e-4b01-87b7-59775ace11cc" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.966707] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-30a735ee-d68e-4b01-87b7-59775ace11cc" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.966868] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.966964] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.969477] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.969684] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.969782] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.969891] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('30a735ee-d68e-4b01-87b7-59775ace11cc',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 927.049883] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-7f2e833b-9263-48ef-ba09-f0afee0fa4af taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.050041] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7f2e833b-9263-48ef-ba09-f0afee0fa4af" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.050673] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7f2e833b-9263-48ef-ba09-f0afee0fa4af',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 927.052397] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port ca7ae93b-3381-40dc-b8d8-fb59df25598f with status ACTIVE [ 927.052397] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.052697] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.052697] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.052772] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.052969] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.053066] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.053146] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.053259] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.053319] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.053385] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.053681] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.053681] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.053681] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.053850] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.053899] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.053947] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: ca7ae93b-3381-40dc-b8d8-fb59df25598f is going to be updated. [ 927.062849] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.062849] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.062849] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.062849] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.063140] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.063140] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c0c7b91f-f336-4603-ad30-c4ec4ba4e8e1 is going to be updated. [ 927.082929] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.083115] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.083191] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.083398] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.083491] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.083622] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e2390617-a1da-45a2-94eb-d162a19e2fae is going to be updated. [ 927.086768] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.086893] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.086952] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.087180] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.087352] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.087552] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ca7ae93b-3381-40dc-b8d8-fb59df25598f" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.088632] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.088796] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.088938] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.089154] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.089272] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.100912] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c0c7b91f-f336-4603-ad30-c4ec4ba4e8e1 in Status: IN_PROGRESS for 2s [ 927.114553] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 7b9ad180-8a13-4fea-bba0-44a41d22d7d2 [ 927.114553] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.114553] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.114553] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.114553] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.114856] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.114856] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:7b9ad180-8a13-4fea-bba0-44a41d22d7d2 already deleted. [ 927.114856] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7b9ad180-8a13-4fea-bba0-44a41d22d7d2" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.130312] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.130470] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.130534] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.130735] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.130874] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.140448] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e2390617-a1da-45a2-94eb-d162a19e2fae in Status: IN_PROGRESS for 2s [ 927.146024] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-462431af-62e3-426c-a50e-a61604f20358 taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.146024] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-462431af-62e3-426c-a50e-a61604f20358" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.146024] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-462431af-62e3-426c-a50e-a61604f20358" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.146024] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-462431af-62e3-426c-a50e-a61604f20358" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.146024] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.146024] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.146024] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.146024] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.146528] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.146528] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-462431af-62e3-426c-a50e-a61604f20358" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.146528] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-462431af-62e3-426c-a50e-a61604f20358 taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.146528] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-462431af-62e3-426c-a50e-a61604f20358" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.146528] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-462431af-62e3-426c-a50e-a61604f20358" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.146689] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-462431af-62e3-426c-a50e-a61604f20358" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.146802] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.146955] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.146955] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.147143] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.147186] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.147729] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-462431af-62e3-426c-a50e-a61604f20358" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.147729] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('462431af-62e3-426c-a50e-a61604f20358',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 927.163382] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7bc12ce3-2b1a-439c-8e90-f01bd1033c9a in Status: SUCCESS [ 927.163640] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7bc12ce3-2b1a-439c-8e90-f01bd1033c9a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.164177] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7bc12ce3-2b1a-439c-8e90-f01bd1033c9a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.164413] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7bc12ce3-2b1a-439c-8e90-f01bd1033c9a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.164512] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7bc12ce3-2b1a-439c-8e90-f01bd1033c9a',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 927.472447] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.472621] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.472696] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.472917] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.473024] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.473221] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.473321] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.473384] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.473533] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.473608] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.473693] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 30a735ee-d68e-4b01-87b7-59775ace11cc already deleted. [ 927.473779] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-30a735ee-d68e-4b01-87b7-59775ace11cc" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.554497] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock network-93 taken with stack trace [, , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.554733] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "network-93" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.554817] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "network-93" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.555197] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "network-93" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.555516] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.555680] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.555791] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.556020] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.556545] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.559023] env[69980]: DEBUG dogpile.cache.region [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] No value present for key: 'zone-id' {{(pid=69980) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 927.559023] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] NeedRegenerationException {{(pid=69980) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 927.559023] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] no value, waiting for create lock {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 927.559023] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] value creation lock acquired {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 927.559023] env[69980]: DEBUG dogpile.cache.region [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] No value present for key: 'zone-id' {{(pid=69980) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 927.559023] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Calling creation function for not-yet-present value {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 927.559023] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 927.560325] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7f2e833b-9263-48ef-ba09-f0afee0fa4af',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 927.577860] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 927.578023] env[69980]: DEBUG dogpile.cache.region [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=69980) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 927.578782] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Released creation lock {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 927.579019] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "network-93" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.579359] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock port-0c347af3-0382-472f-8053-534cef8ccad7 taken with stack trace [, , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.579535] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "port-0c347af3-0382-472f-8053-534cef8ccad7" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.579656] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "port-0c347af3-0382-472f-8053-534cef8ccad7" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.579991] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "port-0c347af3-0382-472f-8053-534cef8ccad7" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.581033] env[69980]: DEBUG networking_nsxv3.api.rpc [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0c347af3-0382-472f-8053-534cef8ccad7',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 927.593180] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d0e04be7-8718-489c-8ceb-fe661da4855a in Status: SUCCESS [ 927.593288] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d0e04be7-8718-489c-8ceb-fe661da4855a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.593843] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d0e04be7-8718-489c-8ceb-fe661da4855a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.594073] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d0e04be7-8718-489c-8ceb-fe661da4855a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.594289] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.594401] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.594463] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.594618] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.594697] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.594777] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d0e04be7-8718-489c-8ceb-fe661da4855a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.594867] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d0e04be7-8718-489c-8ceb-fe661da4855a',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 927.650207] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 462431af-62e3-426c-a50e-a61604f20358: rpc.has_security_group_logging(os_id): False [ 927.667688] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-7bc12ce3-2b1a-439c-8e90-f01bd1033c9a taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.667921] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7bc12ce3-2b1a-439c-8e90-f01bd1033c9a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.668010] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7bc12ce3-2b1a-439c-8e90-f01bd1033c9a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.668231] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7bc12ce3-2b1a-439c-8e90-f01bd1033c9a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.668471] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.668603] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.668687] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.668848] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.668960] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.669081] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7bc12ce3-2b1a-439c-8e90-f01bd1033c9a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.669172] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7bc12ce3-2b1a-439c-8e90-f01bd1033c9a',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 927.670847] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.670965] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.671318] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.671516] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.691720] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.692016] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.692195] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.692279] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.692479] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.692564] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.692763] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.692868] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.692921] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.693077] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.693155] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.693334] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.693438] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.693496] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.693665] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.693705] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.693783] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 462431af-62e3-426c-a50e-a61604f20358 is going to be updated. [ 927.787518] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.787667] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.787772] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.787932] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.788177] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.801143] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 462431af-62e3-426c-a50e-a61604f20358 in Status: IN_PROGRESS for 2s [ 927.809018] env[69980]: INFO networking_nsxv3.common.synchronization [req-175ca233-c26b-4631-8a84-b90748de50da req-c854c519-fee9-4684-b757-24d3cdf2ddfb tempest-SecurityGroupsTestJSON-1482814430 tempest-SecurityGroupsTestJSON-1482814430-project-member] Enqueued Resource ID: 22fc6fbb-1b17-4fd0-be2f-fa94d76ac770 with Priority: HIGHEST for action security_group_members [ 927.809206] env[69980]: INFO networking_nsxv3.common.synchronization [req-175ca233-c26b-4631-8a84-b90748de50da req-c854c519-fee9-4684-b757-24d3cdf2ddfb tempest-SecurityGroupsTestJSON-1482814430 tempest-SecurityGroupsTestJSON-1482814430-project-member] Enqueued Resource ID: c0c7b91f-f336-4603-ad30-c4ec4ba4e8e1 with Priority: HIGHEST for action security_group_members [ 927.809340] env[69980]: INFO networking_nsxv3.common.synchronization [req-175ca233-c26b-4631-8a84-b90748de50da req-c854c519-fee9-4684-b757-24d3cdf2ddfb tempest-SecurityGroupsTestJSON-1482814430 tempest-SecurityGroupsTestJSON-1482814430-project-member] Enqueued Resource ID: e2390617-a1da-45a2-94eb-d162a19e2fae with Priority: HIGHEST for action security_group_members [ 927.809864] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 22fc6fbb-1b17-4fd0-be2f-fa94d76ac770 with Priority: HIGHEST for action security_group_members [ 927.809997] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c0c7b91f-f336-4603-ad30-c4ec4ba4e8e1 with Priority: HIGHEST for action security_group_members [ 927.810122] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e2390617-a1da-45a2-94eb-d162a19e2fae with Priority: HIGHEST for action security_group_members [ 927.810393] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-22fc6fbb-1b17-4fd0-be2f-fa94d76ac770 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.810517] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-22fc6fbb-1b17-4fd0-be2f-fa94d76ac770" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.810745] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-c0c7b91f-f336-4603-ad30-c4ec4ba4e8e1 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.810847] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c0c7b91f-f336-4603-ad30-c4ec4ba4e8e1" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.811818] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-e2390617-a1da-45a2-94eb-d162a19e2fae taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.811918] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e2390617-a1da-45a2-94eb-d162a19e2fae" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.063110] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.064702] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.064702] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.064702] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.064702] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.064702] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7f2e833b-9263-48ef-ba09-f0afee0fa4af is going to be created. [ 928.084063] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.084312] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.084439] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.084706] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.084874] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.085666] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Segment Port 0c347af3-0382-472f-8053-534cef8ccad7 not found, creating... [ 928.085666] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.085666] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.085666] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.085883] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.085971] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.086258] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.086419] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.086533] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.086738] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.086873] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.087018] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Resource: SegmentPort with ID: 0c347af3-0382-472f-8053-534cef8ccad7 is going to be created. [ 928.088923] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.088923] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.089078] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.089127] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.089280] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.097705] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-d0e04be7-8718-489c-8ceb-fe661da4855a taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.097862] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d0e04be7-8718-489c-8ceb-fe661da4855a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.097936] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d0e04be7-8718-489c-8ceb-fe661da4855a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.098170] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d0e04be7-8718-489c-8ceb-fe661da4855a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.098334] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.098437] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.098620] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.098702] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.098743] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.098799] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d0e04be7-8718-489c-8ceb-fe661da4855a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.098946] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-d0e04be7-8718-489c-8ceb-fe661da4855a taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.099049] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d0e04be7-8718-489c-8ceb-fe661da4855a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.099112] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d0e04be7-8718-489c-8ceb-fe661da4855a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.099252] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d0e04be7-8718-489c-8ceb-fe661da4855a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.099391] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.099482] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.099544] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.099736] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.099736] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.099860] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d0e04be7-8718-489c-8ceb-fe661da4855a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.099898] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d0e04be7-8718-489c-8ceb-fe661da4855a',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 928.104022] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7f2e833b-9263-48ef-ba09-f0afee0fa4af in Status: UNINITIALIZED for 2s [ 928.111395] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.111395] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.111395] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.111621] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.111952] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.112571] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "port-0c347af3-0382-472f-8053-534cef8ccad7" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.174182] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-7bc12ce3-2b1a-439c-8e90-f01bd1033c9a taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.174381] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7bc12ce3-2b1a-439c-8e90-f01bd1033c9a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.174459] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7bc12ce3-2b1a-439c-8e90-f01bd1033c9a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.174701] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7bc12ce3-2b1a-439c-8e90-f01bd1033c9a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.174925] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.175099] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.175187] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.175322] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.175415] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.175506] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7bc12ce3-2b1a-439c-8e90-f01bd1033c9a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.175697] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-7bc12ce3-2b1a-439c-8e90-f01bd1033c9a taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.175800] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7bc12ce3-2b1a-439c-8e90-f01bd1033c9a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.175878] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7bc12ce3-2b1a-439c-8e90-f01bd1033c9a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.176047] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7bc12ce3-2b1a-439c-8e90-f01bd1033c9a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.176214] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.176318] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.176455] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.176650] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.176910] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.176910] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7bc12ce3-2b1a-439c-8e90-f01bd1033c9a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.176986] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7bc12ce3-2b1a-439c-8e90-f01bd1033c9a',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 928.420532] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.420735] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.420792] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.421113] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.421228] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 928.452874] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 22fc6fbb-1b17-4fd0-be2f-fa94d76ac770 in Status: SUCCESS [ 928.453129] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-22fc6fbb-1b17-4fd0-be2f-fa94d76ac770" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.453652] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-22fc6fbb-1b17-4fd0-be2f-fa94d76ac770" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.453867] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-22fc6fbb-1b17-4fd0-be2f-fa94d76ac770" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.454068] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.454210] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.454279] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.454437] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.454518] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.454613] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('22fc6fbb-1b17-4fd0-be2f-fa94d76ac770',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 928.591020] env[69980]: INFO networking_nsxv3.common.synchronization [None req-eaa64c66-7d30-4877-9850-6ec97059c70e None None] Enqueued Resource ID: 850f5e0b-b4b0-46d1-9a68-7a0d6b01d19a with Priority: HIGHEST for action port [ 928.591020] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 850f5e0b-b4b0-46d1-9a68-7a0d6b01d19a with Priority: HIGHEST for action port [ 928.591932] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock port-850f5e0b-b4b0-46d1-9a68-7a0d6b01d19a taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.592350] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-850f5e0b-b4b0-46d1-9a68-7a0d6b01d19a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.592548] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-850f5e0b-b4b0-46d1-9a68-7a0d6b01d19a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.593011] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-850f5e0b-b4b0-46d1-9a68-7a0d6b01d19a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.594335] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('850f5e0b-b4b0-46d1-9a68-7a0d6b01d19a',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 928.605361] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d0e04be7-8718-489c-8ceb-fe661da4855a: rpc.has_security_group_logging(os_id): False [ 928.622620] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.622620] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.622620] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.622620] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.622620] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.623680] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.623680] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.623680] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.624101] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.624101] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.624442] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.624512] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.624600] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.624785] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.624895] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.625178] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.625264] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.625332] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.625479] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.625565] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.625663] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d0e04be7-8718-489c-8ceb-fe661da4855a is going to be created. [ 928.658546] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c0c7b91f-f336-4603-ad30-c4ec4ba4e8e1 in Status: SUCCESS [ 928.658777] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c0c7b91f-f336-4603-ad30-c4ec4ba4e8e1" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.658949] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c0c7b91f-f336-4603-ad30-c4ec4ba4e8e1" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.659181] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c0c7b91f-f336-4603-ad30-c4ec4ba4e8e1" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.659271] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c0c7b91f-f336-4603-ad30-c4ec4ba4e8e1',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 928.682016] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7bc12ce3-2b1a-439c-8e90-f01bd1033c9a: rpc.has_security_group_logging(os_id): False [ 928.719539] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.720084] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.720322] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.722903] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.722903] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.722903] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.722903] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.722903] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.722903] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.722903] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.722903] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.722903] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.722903] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.722903] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.725302] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.725302] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.725302] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.725302] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.725302] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.725302] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.725302] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7bc12ce3-2b1a-439c-8e90-f01bd1033c9a is going to be updated. [ 928.734723] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.734862] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.734941] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.735136] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.735376] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.763303] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d0e04be7-8718-489c-8ceb-fe661da4855a in Status: IN_PROGRESS for 2s [ 928.841317] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.841317] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.841317] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.841317] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.841317] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.864464] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7bc12ce3-2b1a-439c-8e90-f01bd1033c9a in Status: IN_PROGRESS for 2s [ 928.927029] env[69980]: INFO networking_nsxv3.common.synchronization [req-50923bc2-2a15-45cd-ba8e-28b9dd626347 req-c14a8932-4d7d-478b-b8c4-c9c793b88e9e service nova] Enqueued Resource ID: 30a735ee-d68e-4b01-87b7-59775ace11cc with Priority: HIGHEST for action security_group_rules [ 928.927029] env[69980]: INFO networking_nsxv3.common.synchronization [req-50923bc2-2a15-45cd-ba8e-28b9dd626347 req-c14a8932-4d7d-478b-b8c4-c9c793b88e9e service nova] Enqueued Resource ID: 30a735ee-d68e-4b01-87b7-59775ace11cc with Priority: HIGHEST for action security_group_members [ 928.927029] env[69980]: INFO networking_nsxv3.common.synchronization [req-50923bc2-2a15-45cd-ba8e-28b9dd626347 req-c14a8932-4d7d-478b-b8c4-c9c793b88e9e service nova] Enqueued Resource ID: 0c347af3-0382-472f-8053-534cef8ccad7 with Priority: HIGHEST for action port [ 928.927029] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 30a735ee-d68e-4b01-87b7-59775ace11cc with Priority: HIGHEST for action security_group_rules [ 928.927029] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 30a735ee-d68e-4b01-87b7-59775ace11cc with Priority: HIGHEST for action security_group_members [ 928.927552] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0c347af3-0382-472f-8053-534cef8ccad7 with Priority: HIGHEST for action port [ 928.927552] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 928.928712] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock rules-30a735ee-d68e-4b01-87b7-59775ace11cc taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.928884] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-30a735ee-d68e-4b01-87b7-59775ace11cc" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.928956] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-30a735ee-d68e-4b01-87b7-59775ace11cc" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.929207] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-30a735ee-d68e-4b01-87b7-59775ace11cc" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.929292] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('30a735ee-d68e-4b01-87b7-59775ace11cc',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 928.930293] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-30a735ee-d68e-4b01-87b7-59775ace11cc taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.930293] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-30a735ee-d68e-4b01-87b7-59775ace11cc" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.930293] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-30a735ee-d68e-4b01-87b7-59775ace11cc" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.930488] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-30a735ee-d68e-4b01-87b7-59775ace11cc" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.931101] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.931101] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.931101] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.931101] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.931101] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.931101] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('30a735ee-d68e-4b01-87b7-59775ace11cc',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 928.932537] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock port-0c347af3-0382-472f-8053-534cef8ccad7 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.932537] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0c347af3-0382-472f-8053-534cef8ccad7" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.932537] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0c347af3-0382-472f-8053-534cef8ccad7" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.932537] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0c347af3-0382-472f-8053-534cef8ccad7" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.932537] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0c347af3-0382-472f-8053-534cef8ccad7',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 928.959903] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.959903] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.959903] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.959903] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.959903] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.959903] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.959903] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.960514] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.960514] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.960514] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.960514] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 22fc6fbb-1b17-4fd0-be2f-fa94d76ac770 is going to be deleted. [ 929.023368] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.023534] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.023577] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.023824] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.023915] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.024024] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-22fc6fbb-1b17-4fd0-be2f-fa94d76ac770" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.024261] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-22fc6fbb-1b17-4fd0-be2f-fa94d76ac770" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.024440] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-22fc6fbb-1b17-4fd0-be2f-fa94d76ac770" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.024619] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.024716] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.024773] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.024912] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.024986] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.025092] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('22fc6fbb-1b17-4fd0-be2f-fa94d76ac770',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 929.095668] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 850f5e0b-b4b0-46d1-9a68-7a0d6b01d19a [ 929.096290] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.096290] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.096290] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.096290] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.096484] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.096484] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:850f5e0b-b4b0-46d1-9a68-7a0d6b01d19a already deleted. [ 929.096558] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-850f5e0b-b4b0-46d1-9a68-7a0d6b01d19a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.116202] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c0c7b91f-f336-4603-ad30-c4ec4ba4e8e1 in Status: SUCCESS [ 929.120142] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c0c7b91f-f336-4603-ad30-c4ec4ba4e8e1" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.120142] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c0c7b91f-f336-4603-ad30-c4ec4ba4e8e1" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.120142] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c0c7b91f-f336-4603-ad30-c4ec4ba4e8e1" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.120495] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.120495] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.120495] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.120624] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.120657] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.120740] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c0c7b91f-f336-4603-ad30-c4ec4ba4e8e1',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 929.152010] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e2390617-a1da-45a2-94eb-d162a19e2fae in Status: SUCCESS [ 929.152010] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e2390617-a1da-45a2-94eb-d162a19e2fae" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.152581] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e2390617-a1da-45a2-94eb-d162a19e2fae" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.152845] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e2390617-a1da-45a2-94eb-d162a19e2fae" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.153074] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.153228] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.153304] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.154025] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.154025] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.154025] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e2390617-a1da-45a2-94eb-d162a19e2fae',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 929.183933] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.184143] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.184246] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.184462] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.184585] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.184702] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c0c7b91f-f336-4603-ad30-c4ec4ba4e8e1 is going to be deleted. [ 929.244880] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.245076] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.245151] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.245383] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.245575] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.245640] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c0c7b91f-f336-4603-ad30-c4ec4ba4e8e1" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.434618] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-30a735ee-d68e-4b01-87b7-59775ace11cc taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.434768] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-30a735ee-d68e-4b01-87b7-59775ace11cc" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.434962] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 929.435887] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('30a735ee-d68e-4b01-87b7-59775ace11cc',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 929.444123] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 0c347af3-0382-472f-8053-534cef8ccad7 with status ACTIVE [ 929.444370] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.444504] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.444571] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.444786] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.444874] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.445067] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.445191] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.445255] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.445406] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.445480] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.445661] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.445749] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.445807] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.445941] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.446023] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.446105] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 0c347af3-0382-472f-8053-534cef8ccad7 is going to be updated. [ 929.456246] env[69980]: INFO networking_nsxv3.common.synchronization [req-3436cd94-85ff-4da4-9c03-bd5b59b6a08f req-3752a593-aa28-428b-8ee8-2a50ee82edd7 tempest-ServersAdminTestJSON-1581544378 tempest-ServersAdminTestJSON-1581544378-project-member] Enqueued Resource ID: 700dc02a-f3c2-4363-9a0e-d7cdcb13a5b8 with Priority: HIGHEST for action security_group_members [ 929.456759] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 700dc02a-f3c2-4363-9a0e-d7cdcb13a5b8 with Priority: HIGHEST for action security_group_members [ 929.458944] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-700dc02a-f3c2-4363-9a0e-d7cdcb13a5b8 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.458944] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-700dc02a-f3c2-4363-9a0e-d7cdcb13a5b8" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.458944] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-700dc02a-f3c2-4363-9a0e-d7cdcb13a5b8" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.458944] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-700dc02a-f3c2-4363-9a0e-d7cdcb13a5b8" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.458944] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.459316] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.459316] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.459316] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.459316] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.459507] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('700dc02a-f3c2-4363-9a0e-d7cdcb13a5b8',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 929.465784] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.466132] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.466530] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.466530] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.466678] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.466809] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0c347af3-0382-472f-8053-534cef8ccad7" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.532527] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.532527] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.532527] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.532527] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.532527] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.532527] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.532527] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.532527] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.532527] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.532527] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.532527] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 22fc6fbb-1b17-4fd0-be2f-fa94d76ac770 already deleted. [ 929.532527] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-22fc6fbb-1b17-4fd0-be2f-fa94d76ac770" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.533059] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('22fc6fbb-1b17-4fd0-be2f-fa94d76ac770',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 929.533407] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-22fc6fbb-1b17-4fd0-be2f-fa94d76ac770" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.533565] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-22fc6fbb-1b17-4fd0-be2f-fa94d76ac770" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.533711] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.533807] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.533866] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.534010] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.534192] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.534280] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('22fc6fbb-1b17-4fd0-be2f-fa94d76ac770',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 929.626064] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.626220] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.626291] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.626534] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.626623] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.626820] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.626917] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.626978] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.627146] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.627215] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.627354] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c0c7b91f-f336-4603-ad30-c4ec4ba4e8e1 is going to be deleted. [ 929.656898] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e2390617-a1da-45a2-94eb-d162a19e2fae',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 929.662650] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.663021] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.663098] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.663492] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.663590] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.663692] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c0c7b91f-f336-4603-ad30-c4ec4ba4e8e1" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.663839] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c0c7b91f-f336-4603-ad30-c4ec4ba4e8e1" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.663996] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c0c7b91f-f336-4603-ad30-c4ec4ba4e8e1" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.664204] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.664307] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.664372] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.664515] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.664596] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.664690] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c0c7b91f-f336-4603-ad30-c4ec4ba4e8e1',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 929.813505] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 462431af-62e3-426c-a50e-a61604f20358 in Status: SUCCESS [ 929.813756] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-462431af-62e3-426c-a50e-a61604f20358" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.871698] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock network-504 taken with stack trace [, , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.871915] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "network-504" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.872056] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "network-504" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.873207] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "network-504" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.873207] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.873207] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.873207] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.873207] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.873454] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.873521] env[69980]: DEBUG dogpile.cache.region [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] No value present for key: 'zone-id' {{(pid=69980) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 929.873629] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] NeedRegenerationException {{(pid=69980) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 929.873733] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] no value, waiting for create lock {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 929.873836] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] value creation lock acquired {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 929.873939] env[69980]: DEBUG dogpile.cache.region [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] No value present for key: 'zone-id' {{(pid=69980) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 929.874054] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Calling creation function for not-yet-present value {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 929.874226] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 929.891774] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 929.891987] env[69980]: DEBUG dogpile.cache.region [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=69980) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 929.892180] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Released creation lock {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 929.892360] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "network-504" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.892668] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock port-535a5a02-eb2a-4fe4-b461-9b488aa3b6f1 taken with stack trace [, , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.892839] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "port-535a5a02-eb2a-4fe4-b461-9b488aa3b6f1" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.892957] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "port-535a5a02-eb2a-4fe4-b461-9b488aa3b6f1" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.893284] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "port-535a5a02-eb2a-4fe4-b461-9b488aa3b6f1" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.893422] env[69980]: DEBUG networking_nsxv3.api.rpc [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('535a5a02-eb2a-4fe4-b461-9b488aa3b6f1',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 929.939849] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 929.940041] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 929.941017] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('30a735ee-d68e-4b01-87b7-59775ace11cc',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 929.961728] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('700dc02a-f3c2-4363-9a0e-d7cdcb13a5b8',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 930.038684] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('22fc6fbb-1b17-4fd0-be2f-fa94d76ac770',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 930.038684] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.038684] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.038684] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.038684] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.038684] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.038684] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.038684] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.038684] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.038684] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.038684] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.038684] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 22fc6fbb-1b17-4fd0-be2f-fa94d76ac770 already deleted. [ 930.038684] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-22fc6fbb-1b17-4fd0-be2f-fa94d76ac770" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.109933] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7f2e833b-9263-48ef-ba09-f0afee0fa4af in Status: SUCCESS [ 930.110257] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7f2e833b-9263-48ef-ba09-f0afee0fa4af" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.110257] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7f2e833b-9263-48ef-ba09-f0afee0fa4af" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.110724] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7f2e833b-9263-48ef-ba09-f0afee0fa4af" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.110724] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.110724] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.110897] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.110934] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.111280] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.111280] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7f2e833b-9263-48ef-ba09-f0afee0fa4af" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.111280] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7f2e833b-9263-48ef-ba09-f0afee0fa4af',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 930.160083] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e2390617-a1da-45a2-94eb-d162a19e2fae',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 930.169185] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.169185] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.169185] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.169185] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.169185] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.169185] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.169185] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.169185] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.169185] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.169185] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.169185] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c0c7b91f-f336-4603-ad30-c4ec4ba4e8e1 already deleted. [ 930.169185] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c0c7b91f-f336-4603-ad30-c4ec4ba4e8e1" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.184526] env[69980]: INFO networking_nsxv3.common.synchronization [req-996fab81-b131-4a59-8c78-4f4b6b4eb335 req-b573989c-e0ec-4120-b63e-b535141933e0 tempest-MultipleCreateTestJSON-827335919 tempest-MultipleCreateTestJSON-827335919-project-member] Enqueued Resource ID: 7bc12ce3-2b1a-439c-8e90-f01bd1033c9a with Priority: HIGHEST for action security_group_members [ 930.185044] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7bc12ce3-2b1a-439c-8e90-f01bd1033c9a with Priority: HIGHEST for action security_group_members [ 930.185845] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-7bc12ce3-2b1a-439c-8e90-f01bd1033c9a taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.185845] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7bc12ce3-2b1a-439c-8e90-f01bd1033c9a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.185845] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7bc12ce3-2b1a-439c-8e90-f01bd1033c9a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.185845] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7bc12ce3-2b1a-439c-8e90-f01bd1033c9a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.186236] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.186236] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.186236] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.186236] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.186470] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.186470] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7bc12ce3-2b1a-439c-8e90-f01bd1033c9a',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 930.399805] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.399805] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.399805] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.399805] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.399805] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.399805] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Segment Port 535a5a02-eb2a-4fe4-b461-9b488aa3b6f1 not found, creating... [ 930.399805] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.399805] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.399805] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.399805] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.399805] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.400353] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.400353] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.400353] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.400353] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.400817] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.401413] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Resource: SegmentPort with ID: 535a5a02-eb2a-4fe4-b461-9b488aa3b6f1 is going to be created. [ 930.422181] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.423317] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.425060] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.425060] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.425060] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.425060] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "port-535a5a02-eb2a-4fe4-b461-9b488aa3b6f1" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.444674] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.444674] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.444674] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.444674] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.444674] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.444674] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 30a735ee-d68e-4b01-87b7-59775ace11cc is going to be created. [ 930.465425] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('700dc02a-f3c2-4363-9a0e-d7cdcb13a5b8',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 930.477416] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.477600] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.477646] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.477832] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.478027] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.490876] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 30a735ee-d68e-4b01-87b7-59775ace11cc in Status: UNINITIALIZED for 2s [ 930.546024] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 22fc6fbb-1b17-4fd0-be2f-fa94d76ac770: rpc.has_security_group_logging(os_id): False [ 930.568508] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.568730] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.568730] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.569069] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.569440] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.569727] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.570103] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.570103] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.570299] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.570299] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.570604] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 22fc6fbb-1b17-4fd0-be2f-fa94d76ac770 is going to be created. [ 930.594209] env[69980]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [-] Warning Code=404 Message=b'{\n "httpStatus" : "NOT_FOUND",\n "error_code" : 500232,\n "module_name" : "Policy",\n "error_message" : "Following dependent objects, used in path=[/infra/domains/default/security-policies/22fc6fbb-1b17-4fd0-be2f-fa94d76ac770], does not exist path=[/infra/domains/default/groups/22fc6fbb-1b17-4fd0-be2f-fa94d76ac770]."\n}' [ 930.594209] env[69980]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 22fc6fbb-1b17-4fd0-be2f-fa94d76ac770 failed to be updated, retrying after metadata refresh: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/22fc6fbb-1b17-4fd0-be2f-fa94d76ac770 [ 930.594209] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 930.616858] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7f2e833b-9263-48ef-ba09-f0afee0fa4af',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 930.632116] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.632116] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.632116] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.632531] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.636925] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.636925] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.636925] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.636925] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.636925] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.636925] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.636925] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.636925] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.636925] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.636925] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.637385] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.637385] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 22fc6fbb-1b17-4fd0-be2f-fa94d76ac770 is going to be created. [ 930.643161] env[69980]: INFO networking_nsxv3.common.synchronization [req-d5e6a8bd-a4ab-4586-a3ab-7dbe4913004b req-7f860b9e-064b-4c4e-8793-1544e5c55ee3 tempest-MultipleCreateTestJSON-827335919 tempest-MultipleCreateTestJSON-827335919-project-member] Enqueued Resource ID: 7bc12ce3-2b1a-439c-8e90-f01bd1033c9a with Priority: HIGHEST for action security_group_members [ 930.643391] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7bc12ce3-2b1a-439c-8e90-f01bd1033c9a with Priority: HIGHEST for action security_group_members [ 930.643668] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-7bc12ce3-2b1a-439c-8e90-f01bd1033c9a taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.643808] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7bc12ce3-2b1a-439c-8e90-f01bd1033c9a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.659182] env[69980]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [-] Warning Code=404 Message=b'{\n "httpStatus" : "NOT_FOUND",\n "error_code" : 500232,\n "module_name" : "Policy",\n "error_message" : "Following dependent objects, used in path=[/infra/domains/default/security-policies/22fc6fbb-1b17-4fd0-be2f-fa94d76ac770], does not exist path=[/infra/domains/default/groups/22fc6fbb-1b17-4fd0-be2f-fa94d76ac770]."\n}': requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/22fc6fbb-1b17-4fd0-be2f-fa94d76ac770 [ 930.659182] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-22fc6fbb-1b17-4fd0-be2f-fa94d76ac770" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.659182] env[69980]: Traceback (most recent call last): [ 930.659182] env[69980]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 36, in wrapper [ 930.659182] env[69980]: return func(*args, **kwargs) [ 930.659182] env[69980]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 786, in _realize [ 930.659182] env[69980]: res.raise_for_status() [ 930.659182] env[69980]: File "/opt/stack/data/venv/lib/python3.10/site-packages/requests/models.py", line 1024, in raise_for_status [ 930.659182] env[69980]: raise HTTPError(http_error_msg, response=self) [ 930.659182] env[69980]: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/22fc6fbb-1b17-4fd0-be2f-fa94d76ac770 [ 930.659182] env[69980]: During handling of the above exception, another exception occurred: [ 930.659182] env[69980]: Traceback (most recent call last): [ 930.659182] env[69980]: File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/hubs/poll.py", line 111, in wait [ 930.659182] env[69980]: listener.cb(fileno) [ 930.659182] env[69980]: File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py", line 272, in main [ 930.659182] env[69980]: result = function(*args, **kwargs) [ 930.659182] env[69980]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py", line 210, in security_group_rules [ 930.659182] env[69980]: self.nsx_provider.sg_rules_realize(os_sg, logged=logged) [ 930.659182] env[69980]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 1012, in sg_rules_realize [ 930.659182] env[69980]: return self._realize(Provider.SG_RULES, delete, self.payload.sg_rules_container, os_sg, provider_sg) [ 930.659182] env[69980]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 45, in wrapper [ 930.659182] env[69980]: return func(self, resource_type, delete, self.payload.sg_rules_container, os_obj, provider_sg) [ 930.659182] env[69980]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 786, in _realize [ 930.659182] env[69980]: res.raise_for_status() [ 930.659182] env[69980]: File "/opt/stack/data/venv/lib/python3.10/site-packages/requests/models.py", line 1024, in raise_for_status [ 930.659182] env[69980]: raise HTTPError(http_error_msg, response=self) [ 930.659182] env[69980]: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/22fc6fbb-1b17-4fd0-be2f-fa94d76ac770 [ 930.659182] env[69980]: Removing descriptor: 31 [ 930.663644] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.663644] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.663644] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.663832] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.663911] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.664028] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e2390617-a1da-45a2-94eb-d162a19e2fae is going to be updated. [ 930.688697] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7bc12ce3-2b1a-439c-8e90-f01bd1033c9a',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 930.732135] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.732281] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.732357] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.732725] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.732725] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.745466] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e2390617-a1da-45a2-94eb-d162a19e2fae in Status: IN_PROGRESS for 2s [ 930.772983] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d0e04be7-8718-489c-8ceb-fe661da4855a in Status: SUCCESS [ 930.773256] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d0e04be7-8718-489c-8ceb-fe661da4855a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.838028] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.838028] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.838028] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.838028] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.848869] env[69980]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 930.849827] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.851079] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 930.885035] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.885035] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.885035] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.885035] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.891592] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.892135] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 930.892232] env[69980]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=69980) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 930.892346] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 930.893879] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7bc12ce3-2b1a-439c-8e90-f01bd1033c9a in Status: SUCCESS [ 930.894515] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7bc12ce3-2b1a-439c-8e90-f01bd1033c9a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.925410] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.925502] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.925502] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.926318] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.927232] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.927232] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 930.968959] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.969134] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.969202] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.969429] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.969507] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.969616] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 700dc02a-f3c2-4363-9a0e-d7cdcb13a5b8 is going to be updated. [ 930.981982] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.982208] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.982323] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.982483] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.982689] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.982897] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 930.994989] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.995148] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.995221] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.995422] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.995560] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.002412] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 700dc02a-f3c2-4363-9a0e-d7cdcb13a5b8 in Status: IN_PROGRESS for 2s [ 931.033308] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.033502] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.033576] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.033968] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.034644] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.034978] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:32. [ 931.035152] env[69980]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:{'90ae0583-7d65-4cd4-8205-17d3726a65ac', '701c8f75-0059-44a8-ab17-fcd4ee6f9c0e', 'e2390617-a1da-45a2-94eb-d162a19e2fae', 'd0e04be7-8718-489c-8ceb-fe661da4855a', 'f9bdd708-8cea-4b45-818f-2a931611c895', 'd53aff15-d6ed-495c-9f29-fdc03bd13622', '75895721-8b52-47a4-a352-95fd377b4204', '186800b9-4416-4ee9-97e6-a0aa4cad729b', 'f44b2d06-c9ca-4621-a354-74c006769956', '1340506f-247e-457d-b5d5-d9db4d9c0250', '3b94a139-70f4-4b1b-82e2-803c78f509bf', '0dbf2bcd-0572-43ef-b18d-cc3cca7fcfd5', '7bc12ce3-2b1a-439c-8e90-f01bd1033c9a', '100806a5-6fdb-4512-83e3-fc77cac134dd', 'c3e6d316-0225-4e87-99d5-6c58ff0694cb', 'bf060907-afd6-4dc2-b6bb-9fd99f7f9dad', '80e3ea48-91a5-4863-b1c2-f3e887204e39', 'cdebe06d-8b9c-47c7-bf4d-f0246381eb14', '61b51096-066e-4c5d-b696-b9c061599dcc', '0b52672e-87ad-43b6-b078-903b8601b014', '07d8236a-b9f2-429a-9942-e7cb46920213', 'f2b778ac-011d-472f-9220-d8d50a881380', '162065c3-9db0-41c8-9437-c51716e30968', 'b472d7ce-a3a7-4859-8fa3-f222ee058e66', '2961e549-f7d2-46b0-a1f4-9365d96bb58a', '48dd2a84-68ac-43c8-a7e2-4cb28bb82546', '825b0052-8bd1-4107-8258-075804cbc484', '6719a83d-3363-4339-a277-6e1ec27ec7bc', '462431af-62e3-426c-a50e-a61604f20358', '700dc02a-f3c2-4363-9a0e-d7cdcb13a5b8', '241bcad9-5919-4c26-b0b9-beb6a98733bd', 'd696a1d3-1fa9-4790-b673-19d262f97699'} {{(pid=69980) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 931.035294] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 931.052991] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.053182] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.053230] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.053439] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.053555] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.053783] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 931.053912] env[69980]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=69980) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 931.054067] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 931.110599] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.110599] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.110599] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.110599] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.111739] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.111739] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 931.111739] env[69980]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=69980) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 931.111739] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 931.112096] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 931.112096] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 20/32 resources of Type:Security Group Rules [ 931.112220] env[69980]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 90ae0583-7d65-4cd4-8205-17d3726a65ac with Priority: HIGH for action security_group_rules [ 931.112252] env[69980]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 701c8f75-0059-44a8-ab17-fcd4ee6f9c0e with Priority: HIGH for action security_group_rules [ 931.112321] env[69980]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: e2390617-a1da-45a2-94eb-d162a19e2fae with Priority: HIGH for action security_group_rules [ 931.112403] env[69980]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: d0e04be7-8718-489c-8ceb-fe661da4855a with Priority: HIGH for action security_group_rules [ 931.112483] env[69980]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: f9bdd708-8cea-4b45-818f-2a931611c895 with Priority: HIGH for action security_group_rules [ 931.112517] env[69980]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: d53aff15-d6ed-495c-9f29-fdc03bd13622 with Priority: HIGH for action security_group_rules [ 931.112550] env[69980]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 75895721-8b52-47a4-a352-95fd377b4204 with Priority: HIGH for action security_group_rules [ 931.112606] env[69980]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 186800b9-4416-4ee9-97e6-a0aa4cad729b with Priority: HIGH for action security_group_rules [ 931.112699] env[69980]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: f44b2d06-c9ca-4621-a354-74c006769956 with Priority: HIGH for action security_group_rules [ 931.112838] env[69980]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 1340506f-247e-457d-b5d5-d9db4d9c0250 with Priority: HIGH for action security_group_rules [ 931.113612] env[69980]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 3b94a139-70f4-4b1b-82e2-803c78f509bf with Priority: HIGH for action security_group_rules [ 931.113612] env[69980]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 0dbf2bcd-0572-43ef-b18d-cc3cca7fcfd5 with Priority: HIGH for action security_group_rules [ 931.113612] env[69980]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 7bc12ce3-2b1a-439c-8e90-f01bd1033c9a with Priority: HIGH for action security_group_rules [ 931.113612] env[69980]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 100806a5-6fdb-4512-83e3-fc77cac134dd with Priority: HIGH for action security_group_rules [ 931.113612] env[69980]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: c3e6d316-0225-4e87-99d5-6c58ff0694cb with Priority: HIGH for action security_group_rules [ 931.114068] env[69980]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: bf060907-afd6-4dc2-b6bb-9fd99f7f9dad with Priority: HIGH for action security_group_rules [ 931.114068] env[69980]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 80e3ea48-91a5-4863-b1c2-f3e887204e39 with Priority: HIGH for action security_group_rules [ 931.114068] env[69980]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: cdebe06d-8b9c-47c7-bf4d-f0246381eb14 with Priority: HIGH for action security_group_rules [ 931.114068] env[69980]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 61b51096-066e-4c5d-b696-b9c061599dcc with Priority: HIGH for action security_group_rules [ 931.114068] env[69980]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 0b52672e-87ad-43b6-b078-903b8601b014 with Priority: HIGH for action security_group_rules [ 931.114274] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.118734] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7f2e833b-9263-48ef-ba09-f0afee0fa4af: rpc.has_security_group_logging(os_id): False [ 931.139319] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.139319] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.139319] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.139319] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.139319] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.139319] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.139319] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.139319] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.139319] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.139319] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.139319] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7f2e833b-9263-48ef-ba09-f0afee0fa4af is going to be created. [ 931.191246] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7bc12ce3-2b1a-439c-8e90-f01bd1033c9a',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 931.198014] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.198014] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.198014] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.198213] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.198352] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.207760] env[69980]: INFO networking_nsxv3.common.synchronization [req-3436cd94-85ff-4da4-9c03-bd5b59b6a08f req-4e5f7a76-ee2c-45cd-a9c3-1ab996a4a0d3 service nova] Enqueued Resource ID: 700dc02a-f3c2-4363-9a0e-d7cdcb13a5b8 with Priority: HIGHEST for action security_group_rules [ 931.209913] env[69980]: INFO networking_nsxv3.common.synchronization [req-3436cd94-85ff-4da4-9c03-bd5b59b6a08f req-4e5f7a76-ee2c-45cd-a9c3-1ab996a4a0d3 service nova] Enqueued Resource ID: 700dc02a-f3c2-4363-9a0e-d7cdcb13a5b8 with Priority: HIGHEST for action security_group_members [ 931.209913] env[69980]: INFO networking_nsxv3.common.synchronization [req-3436cd94-85ff-4da4-9c03-bd5b59b6a08f req-4e5f7a76-ee2c-45cd-a9c3-1ab996a4a0d3 service nova] Enqueued Resource ID: 535a5a02-eb2a-4fe4-b461-9b488aa3b6f1 with Priority: HIGHEST for action port [ 931.210158] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7f2e833b-9263-48ef-ba09-f0afee0fa4af in Status: IN_PROGRESS for 2s [ 931.210724] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 700dc02a-f3c2-4363-9a0e-d7cdcb13a5b8 with Priority: HIGHEST for action security_group_rules [ 931.210724] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 700dc02a-f3c2-4363-9a0e-d7cdcb13a5b8 with Priority: HIGHEST for action security_group_members [ 931.210724] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 535a5a02-eb2a-4fe4-b461-9b488aa3b6f1 with Priority: HIGHEST for action port [ 931.211025] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 90ae0583-7d65-4cd4-8205-17d3726a65ac with Priority: HIGH for action security_group_rules [ 931.211131] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e2390617-a1da-45a2-94eb-d162a19e2fae with Priority: HIGH for action security_group_rules [ 931.211233] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 75895721-8b52-47a4-a352-95fd377b4204 with Priority: HIGH for action security_group_rules [ 931.211382] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c3e6d316-0225-4e87-99d5-6c58ff0694cb with Priority: HIGH for action security_group_rules [ 931.211435] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0b52672e-87ad-43b6-b078-903b8601b014 with Priority: HIGH for action security_group_rules [ 931.211484] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 61b51096-066e-4c5d-b696-b9c061599dcc with Priority: HIGH for action security_group_rules [ 931.211572] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cdebe06d-8b9c-47c7-bf4d-f0246381eb14 with Priority: HIGH for action security_group_rules [ 931.211661] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 80e3ea48-91a5-4863-b1c2-f3e887204e39 with Priority: HIGH for action security_group_rules [ 931.211760] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 100806a5-6fdb-4512-83e3-fc77cac134dd with Priority: HIGH for action security_group_rules [ 931.211830] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bf060907-afd6-4dc2-b6bb-9fd99f7f9dad with Priority: HIGH for action security_group_rules [ 931.211914] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7bc12ce3-2b1a-439c-8e90-f01bd1033c9a with Priority: HIGH for action security_group_rules [ 931.212015] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0dbf2bcd-0572-43ef-b18d-cc3cca7fcfd5 with Priority: HIGH for action security_group_rules [ 931.212218] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3b94a139-70f4-4b1b-82e2-803c78f509bf with Priority: HIGH for action security_group_rules [ 931.212315] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1340506f-247e-457d-b5d5-d9db4d9c0250 with Priority: HIGH for action security_group_rules [ 931.212403] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f44b2d06-c9ca-4621-a354-74c006769956 with Priority: HIGH for action security_group_rules [ 931.212488] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d53aff15-d6ed-495c-9f29-fdc03bd13622 with Priority: HIGH for action security_group_rules [ 931.212576] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 186800b9-4416-4ee9-97e6-a0aa4cad729b with Priority: HIGH for action security_group_rules [ 931.212669] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f9bdd708-8cea-4b45-818f-2a931611c895 with Priority: HIGH for action security_group_rules [ 931.212740] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 701c8f75-0059-44a8-ab17-fcd4ee6f9c0e with Priority: HIGH for action security_group_rules [ 931.212819] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d0e04be7-8718-489c-8ceb-fe661da4855a with Priority: HIGH for action security_group_rules [ 931.213144] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock rules-700dc02a-f3c2-4363-9a0e-d7cdcb13a5b8 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.213265] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-700dc02a-f3c2-4363-9a0e-d7cdcb13a5b8" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.213336] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-700dc02a-f3c2-4363-9a0e-d7cdcb13a5b8" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.213932] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-700dc02a-f3c2-4363-9a0e-d7cdcb13a5b8" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.213932] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('700dc02a-f3c2-4363-9a0e-d7cdcb13a5b8',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 931.214774] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-700dc02a-f3c2-4363-9a0e-d7cdcb13a5b8 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.214919] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-700dc02a-f3c2-4363-9a0e-d7cdcb13a5b8" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.215261] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock port-535a5a02-eb2a-4fe4-b461-9b488aa3b6f1 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.215350] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-535a5a02-eb2a-4fe4-b461-9b488aa3b6f1" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.215350] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-535a5a02-eb2a-4fe4-b461-9b488aa3b6f1" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.215510] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-535a5a02-eb2a-4fe4-b461-9b488aa3b6f1" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.215586] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('535a5a02-eb2a-4fe4-b461-9b488aa3b6f1',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 931.217055] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock rules-90ae0583-7d65-4cd4-8205-17d3726a65ac taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.217180] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-90ae0583-7d65-4cd4-8205-17d3726a65ac" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.221438] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-90ae0583-7d65-4cd4-8205-17d3726a65ac" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.221438] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-90ae0583-7d65-4cd4-8205-17d3726a65ac" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.221438] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('90ae0583-7d65-4cd4-8205-17d3726a65ac',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 931.221438] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e2390617-a1da-45a2-94eb-d162a19e2fae taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.221438] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e2390617-a1da-45a2-94eb-d162a19e2fae" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.221789] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock rules-75895721-8b52-47a4-a352-95fd377b4204 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.221892] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-75895721-8b52-47a4-a352-95fd377b4204" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.221953] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-75895721-8b52-47a4-a352-95fd377b4204" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.222221] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-75895721-8b52-47a4-a352-95fd377b4204" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.223226] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('75895721-8b52-47a4-a352-95fd377b4204',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 931.223226] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c3e6d316-0225-4e87-99d5-6c58ff0694cb taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.223226] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c3e6d316-0225-4e87-99d5-6c58ff0694cb" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.223226] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c3e6d316-0225-4e87-99d5-6c58ff0694cb" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.223618] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c3e6d316-0225-4e87-99d5-6c58ff0694cb" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.223618] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c3e6d316-0225-4e87-99d5-6c58ff0694cb',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 931.224457] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0b52672e-87ad-43b6-b078-903b8601b014 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.224610] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0b52672e-87ad-43b6-b078-903b8601b014" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.224610] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0b52672e-87ad-43b6-b078-903b8601b014" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.225050] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0b52672e-87ad-43b6-b078-903b8601b014" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.225050] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0b52672e-87ad-43b6-b078-903b8601b014',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 931.226091] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock rules-61b51096-066e-4c5d-b696-b9c061599dcc taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.226204] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-61b51096-066e-4c5d-b696-b9c061599dcc" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.226204] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-61b51096-066e-4c5d-b696-b9c061599dcc" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.226926] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-61b51096-066e-4c5d-b696-b9c061599dcc" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.226926] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('61b51096-066e-4c5d-b696-b9c061599dcc',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 931.227656] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cdebe06d-8b9c-47c7-bf4d-f0246381eb14 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.227656] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cdebe06d-8b9c-47c7-bf4d-f0246381eb14" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.227656] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cdebe06d-8b9c-47c7-bf4d-f0246381eb14" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.227965] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cdebe06d-8b9c-47c7-bf4d-f0246381eb14" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.228132] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cdebe06d-8b9c-47c7-bf4d-f0246381eb14',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 931.228971] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock rules-80e3ea48-91a5-4863-b1c2-f3e887204e39 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.229123] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-80e3ea48-91a5-4863-b1c2-f3e887204e39" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.229123] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-80e3ea48-91a5-4863-b1c2-f3e887204e39" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.229264] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-80e3ea48-91a5-4863-b1c2-f3e887204e39" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.229833] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('80e3ea48-91a5-4863-b1c2-f3e887204e39',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 931.231039] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock rules-100806a5-6fdb-4512-83e3-fc77cac134dd taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.231039] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-100806a5-6fdb-4512-83e3-fc77cac134dd" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.231039] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-100806a5-6fdb-4512-83e3-fc77cac134dd" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.231258] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-100806a5-6fdb-4512-83e3-fc77cac134dd" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.231318] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('100806a5-6fdb-4512-83e3-fc77cac134dd',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 931.231670] env[69980]: WARNING oslo_messaging._drivers.amqpdriver [-] Number of call queues is 11, greater than warning threshold: 10. There could be a leak. Increasing threshold to: 20 [ 931.232487] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock rules-bf060907-afd6-4dc2-b6bb-9fd99f7f9dad taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.232598] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-bf060907-afd6-4dc2-b6bb-9fd99f7f9dad" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.232640] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-bf060907-afd6-4dc2-b6bb-9fd99f7f9dad" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.232929] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-bf060907-afd6-4dc2-b6bb-9fd99f7f9dad" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.233045] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('bf060907-afd6-4dc2-b6bb-9fd99f7f9dad',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 931.234477] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7bc12ce3-2b1a-439c-8e90-f01bd1033c9a taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.234602] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7bc12ce3-2b1a-439c-8e90-f01bd1033c9a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.234799] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7bc12ce3-2b1a-439c-8e90-f01bd1033c9a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.235027] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7bc12ce3-2b1a-439c-8e90-f01bd1033c9a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.235108] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7bc12ce3-2b1a-439c-8e90-f01bd1033c9a',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 931.236157] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0dbf2bcd-0572-43ef-b18d-cc3cca7fcfd5 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.236303] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0dbf2bcd-0572-43ef-b18d-cc3cca7fcfd5" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.236369] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0dbf2bcd-0572-43ef-b18d-cc3cca7fcfd5" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.236638] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0dbf2bcd-0572-43ef-b18d-cc3cca7fcfd5" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.236638] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0dbf2bcd-0572-43ef-b18d-cc3cca7fcfd5',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 931.237630] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3b94a139-70f4-4b1b-82e2-803c78f509bf taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.237771] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3b94a139-70f4-4b1b-82e2-803c78f509bf" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.237841] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3b94a139-70f4-4b1b-82e2-803c78f509bf" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.238025] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3b94a139-70f4-4b1b-82e2-803c78f509bf" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.238131] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3b94a139-70f4-4b1b-82e2-803c78f509bf',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 931.241382] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1340506f-247e-457d-b5d5-d9db4d9c0250 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.241382] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1340506f-247e-457d-b5d5-d9db4d9c0250" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.241382] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1340506f-247e-457d-b5d5-d9db4d9c0250" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.241382] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1340506f-247e-457d-b5d5-d9db4d9c0250" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.241382] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1340506f-247e-457d-b5d5-d9db4d9c0250',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 931.241382] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f44b2d06-c9ca-4621-a354-74c006769956 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.241382] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f44b2d06-c9ca-4621-a354-74c006769956" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.241382] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f44b2d06-c9ca-4621-a354-74c006769956" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.241382] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f44b2d06-c9ca-4621-a354-74c006769956" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.241382] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f44b2d06-c9ca-4621-a354-74c006769956',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 931.242243] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d53aff15-d6ed-495c-9f29-fdc03bd13622 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.242363] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d53aff15-d6ed-495c-9f29-fdc03bd13622" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.242363] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d53aff15-d6ed-495c-9f29-fdc03bd13622" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.242543] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d53aff15-d6ed-495c-9f29-fdc03bd13622" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.242628] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d53aff15-d6ed-495c-9f29-fdc03bd13622',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 931.243452] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock rules-186800b9-4416-4ee9-97e6-a0aa4cad729b taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.244418] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-186800b9-4416-4ee9-97e6-a0aa4cad729b" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.244524] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-186800b9-4416-4ee9-97e6-a0aa4cad729b" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.244694] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-186800b9-4416-4ee9-97e6-a0aa4cad729b" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.244786] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('186800b9-4416-4ee9-97e6-a0aa4cad729b',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 931.247112] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f9bdd708-8cea-4b45-818f-2a931611c895 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.247112] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f9bdd708-8cea-4b45-818f-2a931611c895" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.247112] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f9bdd708-8cea-4b45-818f-2a931611c895" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.247112] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f9bdd708-8cea-4b45-818f-2a931611c895" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.247112] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f9bdd708-8cea-4b45-818f-2a931611c895',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 931.247112] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock rules-701c8f75-0059-44a8-ab17-fcd4ee6f9c0e taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.247112] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-701c8f75-0059-44a8-ab17-fcd4ee6f9c0e" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.247112] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-701c8f75-0059-44a8-ab17-fcd4ee6f9c0e" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.247485] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-701c8f75-0059-44a8-ab17-fcd4ee6f9c0e" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.247485] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('701c8f75-0059-44a8-ab17-fcd4ee6f9c0e',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 931.247485] env[69980]: WARNING oslo_messaging._drivers.amqpdriver [-] Number of call queues is 21, greater than warning threshold: 20. There could be a leak. Increasing threshold to: 40 [ 931.249584] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d0e04be7-8718-489c-8ceb-fe661da4855a taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.249584] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d0e04be7-8718-489c-8ceb-fe661da4855a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.249584] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d0e04be7-8718-489c-8ceb-fe661da4855a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.249584] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d0e04be7-8718-489c-8ceb-fe661da4855a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.249584] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d0e04be7-8718-489c-8ceb-fe661da4855a',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 931.252739] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-700dc02a-f3c2-4363-9a0e-d7cdcb13a5b8 taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.252856] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-700dc02a-f3c2-4363-9a0e-d7cdcb13a5b8" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.255027] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 535a5a02-eb2a-4fe4-b461-9b488aa3b6f1 with status ACTIVE [ 931.255257] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.255412] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.255503] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.255697] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.255810] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.255998] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.256136] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.256217] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.256385] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.256488] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.256692] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.256819] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.256898] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.257081] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.257184] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.257419] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 535a5a02-eb2a-4fe4-b461-9b488aa3b6f1 is going to be updated. [ 931.422339] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.422473] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.422559] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.422740] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.422869] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.423037] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-535a5a02-eb2a-4fe4-b461-9b488aa3b6f1" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.424257] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.424394] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.424514] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.424702] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.457735] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.457860] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.458914] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.458981] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.475790] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.476091] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 75895721-8b52-47a4-a352-95fd377b4204 is going to be deleted. [ 931.477510] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.477880] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.501223] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.501373] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3b94a139-70f4-4b1b-82e2-803c78f509bf is going to be deleted. [ 931.502274] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.502483] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.519743] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.519869] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c3e6d316-0225-4e87-99d5-6c58ff0694cb is going to be deleted. [ 931.531723] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.531855] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.531938] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.532244] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.532340] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.532456] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-75895721-8b52-47a4-a352-95fd377b4204" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.556245] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.556245] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.556245] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.556441] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.556538] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.556578] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3b94a139-70f4-4b1b-82e2-803c78f509bf" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.570416] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.570555] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.570621] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.570827] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.570921] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.571051] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c3e6d316-0225-4e87-99d5-6c58ff0694cb" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.697287] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.697620] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.697620] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.697837] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.697977] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.698056] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7bc12ce3-2b1a-439c-8e90-f01bd1033c9a is going to be updated. [ 931.759177] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.759407] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.759499] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.759709] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.759854] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.768581] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7bc12ce3-2b1a-439c-8e90-f01bd1033c9a in Status: IN_PROGRESS for 2s [ 931.771935] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.772034] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.772105] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.772311] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.793832] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.797019] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 90ae0583-7d65-4cd4-8205-17d3726a65ac is going to be deleted. [ 931.797722] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.797850] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.797916] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.798149] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.816994] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.817194] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d53aff15-d6ed-495c-9f29-fdc03bd13622 is going to be deleted. [ 931.869031] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.869191] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.869288] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.869487] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.870014] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.870014] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-90ae0583-7d65-4cd4-8205-17d3726a65ac" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.880726] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.881121] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.881121] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.881286] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.881286] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.881375] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d53aff15-d6ed-495c-9f29-fdc03bd13622" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.921983] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-cdebe06d-8b9c-47c7-bf4d-f0246381eb14 taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.921983] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cdebe06d-8b9c-47c7-bf4d-f0246381eb14" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.921983] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cdebe06d-8b9c-47c7-bf4d-f0246381eb14" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.921983] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cdebe06d-8b9c-47c7-bf4d-f0246381eb14" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.922353] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.922353] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.922353] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.922472] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.922472] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.922535] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cdebe06d-8b9c-47c7-bf4d-f0246381eb14" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.922816] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('cdebe06d-8b9c-47c7-bf4d-f0246381eb14',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 931.934595] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-d0e04be7-8718-489c-8ceb-fe661da4855a taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.934993] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d0e04be7-8718-489c-8ceb-fe661da4855a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.934993] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d0e04be7-8718-489c-8ceb-fe661da4855a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.934993] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d0e04be7-8718-489c-8ceb-fe661da4855a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.935332] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.935905] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.935905] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.935905] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.935905] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.935905] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d0e04be7-8718-489c-8ceb-fe661da4855a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.936351] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d0e04be7-8718-489c-8ceb-fe661da4855a',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 931.937977] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-f9bdd708-8cea-4b45-818f-2a931611c895 taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.938100] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f9bdd708-8cea-4b45-818f-2a931611c895" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.938181] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f9bdd708-8cea-4b45-818f-2a931611c895" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.938318] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f9bdd708-8cea-4b45-818f-2a931611c895" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.938465] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.938557] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.938613] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.938750] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.938827] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.938984] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f9bdd708-8cea-4b45-818f-2a931611c895" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.939066] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f9bdd708-8cea-4b45-818f-2a931611c895',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 931.939948] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-0b52672e-87ad-43b6-b078-903b8601b014 taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.939948] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0b52672e-87ad-43b6-b078-903b8601b014" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.940072] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0b52672e-87ad-43b6-b078-903b8601b014" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.941999] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0b52672e-87ad-43b6-b078-903b8601b014" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.941999] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.941999] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.941999] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.941999] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.941999] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.941999] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0b52672e-87ad-43b6-b078-903b8601b014" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.941999] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('0b52672e-87ad-43b6-b078-903b8601b014',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 931.942899] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-100806a5-6fdb-4512-83e3-fc77cac134dd taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.943037] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-100806a5-6fdb-4512-83e3-fc77cac134dd" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.943093] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-100806a5-6fdb-4512-83e3-fc77cac134dd" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.943228] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-100806a5-6fdb-4512-83e3-fc77cac134dd" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.943369] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.943483] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.943548] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.943688] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.943763] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.943856] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-100806a5-6fdb-4512-83e3-fc77cac134dd" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.943930] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('100806a5-6fdb-4512-83e3-fc77cac134dd',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 931.950569] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-f44b2d06-c9ca-4621-a354-74c006769956 taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.950786] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f44b2d06-c9ca-4621-a354-74c006769956" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.950786] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f44b2d06-c9ca-4621-a354-74c006769956" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.950970] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f44b2d06-c9ca-4621-a354-74c006769956" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.951129] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.951228] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.951285] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.951425] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.951504] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.951585] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f44b2d06-c9ca-4621-a354-74c006769956" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.951662] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f44b2d06-c9ca-4621-a354-74c006769956',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 931.995452] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.995650] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.995725] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.995927] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.997616] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.997719] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.998489] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.998585] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.999239] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.999328] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.001834] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.001925] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.006319] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.006415] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.015269] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.015417] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.017171] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.017269] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.019374] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.019374] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0dbf2bcd-0572-43ef-b18d-cc3cca7fcfd5 is going to be deleted. [ 932.020151] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.020363] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.040579] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.040707] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 701c8f75-0059-44a8-ab17-fcd4ee6f9c0e is going to be deleted. [ 932.041589] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.041833] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.068305] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.068443] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7bc12ce3-2b1a-439c-8e90-f01bd1033c9a is going to be deleted. [ 932.069357] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.069565] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.072276] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.072384] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.102411] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.102550] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 61b51096-066e-4c5d-b696-b9c061599dcc is going to be deleted. [ 932.104016] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.104194] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.104235] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.104442] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.104529] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.104670] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-701c8f75-0059-44a8-ab17-fcd4ee6f9c0e" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.104791] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.104951] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.124177] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.124581] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1340506f-247e-457d-b5d5-d9db4d9c0250 is going to be deleted. [ 932.125256] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.125460] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.140186] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.140365] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.157067] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.157233] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 80e3ea48-91a5-4863-b1c2-f3e887204e39 is going to be deleted. [ 932.158202] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.158431] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.203337] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.203488] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.212299] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.212359] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bf060907-afd6-4dc2-b6bb-9fd99f7f9dad is going to be deleted. [ 932.213275] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.213494] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.213584] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.213701] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0dbf2bcd-0572-43ef-b18d-cc3cca7fcfd5" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.213873] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.214056] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.228109] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.228340] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.249774] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.249942] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 186800b9-4416-4ee9-97e6-a0aa4cad729b is going to be deleted. [ 932.250883] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.251105] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.251228] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.251412] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7bc12ce3-2b1a-439c-8e90-f01bd1033c9a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.251481] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.251614] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.251690] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.251800] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-61b51096-066e-4c5d-b696-b9c061599dcc" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.252446] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.252615] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.252697] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.252806] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1340506f-247e-457d-b5d5-d9db4d9c0250" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.265182] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.265351] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.265424] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.265619] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.265713] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.265827] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-80e3ea48-91a5-4863-b1c2-f3e887204e39" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.323264] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.323420] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.323567] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.323678] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.323768] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.323884] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-bf060907-afd6-4dc2-b6bb-9fd99f7f9dad" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.352898] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.353065] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.353142] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.353355] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.353452] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.353576] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-186800b9-4416-4ee9-97e6-a0aa4cad729b" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.424617] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('cdebe06d-8b9c-47c7-bf4d-f0246381eb14',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 932.454457] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('100806a5-6fdb-4512-83e3-fc77cac134dd',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 932.455929] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-d0e04be7-8718-489c-8ceb-fe661da4855a taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.456143] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d0e04be7-8718-489c-8ceb-fe661da4855a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.456218] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d0e04be7-8718-489c-8ceb-fe661da4855a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.456464] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d0e04be7-8718-489c-8ceb-fe661da4855a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.456590] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.456689] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.456750] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.456898] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.456983] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.457081] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d0e04be7-8718-489c-8ceb-fe661da4855a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.457246] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-d0e04be7-8718-489c-8ceb-fe661da4855a taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.457423] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d0e04be7-8718-489c-8ceb-fe661da4855a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.457489] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d0e04be7-8718-489c-8ceb-fe661da4855a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.457720] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d0e04be7-8718-489c-8ceb-fe661da4855a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.457955] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.458051] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.458100] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.458266] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.458370] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.458430] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d0e04be7-8718-489c-8ceb-fe661da4855a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.458654] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d0e04be7-8718-489c-8ceb-fe661da4855a',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 932.459765] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f9bdd708-8cea-4b45-818f-2a931611c895',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 932.460908] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-0b52672e-87ad-43b6-b078-903b8601b014 taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.461043] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0b52672e-87ad-43b6-b078-903b8601b014" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.461109] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0b52672e-87ad-43b6-b078-903b8601b014" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.461311] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0b52672e-87ad-43b6-b078-903b8601b014" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.461480] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.461680] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.461680] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.461852] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.461852] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.461928] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0b52672e-87ad-43b6-b078-903b8601b014" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.462079] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-0b52672e-87ad-43b6-b078-903b8601b014 taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.462181] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0b52672e-87ad-43b6-b078-903b8601b014" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.462241] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0b52672e-87ad-43b6-b078-903b8601b014" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.462375] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0b52672e-87ad-43b6-b078-903b8601b014" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.462510] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.463224] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.463224] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.463224] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.463224] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.463224] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0b52672e-87ad-43b6-b078-903b8601b014" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.463224] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('0b52672e-87ad-43b6-b078-903b8601b014',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 932.464489] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-f44b2d06-c9ca-4621-a354-74c006769956 taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.464489] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f44b2d06-c9ca-4621-a354-74c006769956" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.464489] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f44b2d06-c9ca-4621-a354-74c006769956" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.464489] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f44b2d06-c9ca-4621-a354-74c006769956" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.464489] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.464489] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.464489] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.464851] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.464851] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.464851] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f44b2d06-c9ca-4621-a354-74c006769956" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.464851] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-f44b2d06-c9ca-4621-a354-74c006769956 taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.465233] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f44b2d06-c9ca-4621-a354-74c006769956" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.465311] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f44b2d06-c9ca-4621-a354-74c006769956" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.465459] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f44b2d06-c9ca-4621-a354-74c006769956" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.465698] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.465817] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.465880] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.466035] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.466142] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.466190] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f44b2d06-c9ca-4621-a354-74c006769956" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.466263] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f44b2d06-c9ca-4621-a354-74c006769956',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 932.501605] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 30a735ee-d68e-4b01-87b7-59775ace11cc in Status: SUCCESS [ 932.502337] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-30a735ee-d68e-4b01-87b7-59775ace11cc" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.502337] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-30a735ee-d68e-4b01-87b7-59775ace11cc" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.502337] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-30a735ee-d68e-4b01-87b7-59775ace11cc" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.502560] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.502560] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.502665] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.502785] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.502873] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.502958] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-30a735ee-d68e-4b01-87b7-59775ace11cc" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.503063] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('30a735ee-d68e-4b01-87b7-59775ace11cc',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 932.761619] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e2390617-a1da-45a2-94eb-d162a19e2fae in Status: SUCCESS [ 932.761850] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e2390617-a1da-45a2-94eb-d162a19e2fae" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.762014] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e2390617-a1da-45a2-94eb-d162a19e2fae" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.762244] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e2390617-a1da-45a2-94eb-d162a19e2fae" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.762443] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.762557] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.762617] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.762765] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.762845] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.762930] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e2390617-a1da-45a2-94eb-d162a19e2fae" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.763104] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-e2390617-a1da-45a2-94eb-d162a19e2fae taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.763174] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e2390617-a1da-45a2-94eb-d162a19e2fae" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.763244] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e2390617-a1da-45a2-94eb-d162a19e2fae" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.763371] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e2390617-a1da-45a2-94eb-d162a19e2fae" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.763508] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.763589] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.763656] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.763774] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.763843] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.764056] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e2390617-a1da-45a2-94eb-d162a19e2fae" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.764056] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e2390617-a1da-45a2-94eb-d162a19e2fae',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 932.764893] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e2390617-a1da-45a2-94eb-d162a19e2fae" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.765071] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e2390617-a1da-45a2-94eb-d162a19e2fae" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.765229] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.765355] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.765355] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.765490] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.765559] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.765644] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e2390617-a1da-45a2-94eb-d162a19e2fae',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 932.927399] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for cdebe06d-8b9c-47c7-bf4d-f0246381eb14: rpc.has_security_group_logging(os_id): False [ 932.947138] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.948027] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.948027] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.948027] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.956039] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 100806a5-6fdb-4512-83e3-fc77cac134dd: rpc.has_security_group_logging(os_id): False [ 932.960656] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d0e04be7-8718-489c-8ceb-fe661da4855a: rpc.has_security_group_logging(os_id): False [ 932.965059] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.965507] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.965629] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.965698] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.965886] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.965972] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.966073] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cdebe06d-8b9c-47c7-bf4d-f0246381eb14 is going to be updated. [ 932.968397] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f44b2d06-c9ca-4621-a354-74c006769956: rpc.has_security_group_logging(os_id): False [ 932.969266] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f9bdd708-8cea-4b45-818f-2a931611c895: rpc.has_security_group_logging(os_id): False [ 932.970028] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 0b52672e-87ad-43b6-b078-903b8601b014: rpc.has_security_group_logging(os_id): False [ 932.972033] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.972153] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.972212] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.972388] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.975079] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.975079] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.986405] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.986542] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.987995] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.988114] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.990753] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.990854] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.993764] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.994015] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.994116] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.994240] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.994433] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.994516] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.994610] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 100806a5-6fdb-4512-83e3-fc77cac134dd is going to be updated. [ 932.995658] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.995821] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.009332] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-30a735ee-d68e-4b01-87b7-59775ace11cc taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.009444] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-30a735ee-d68e-4b01-87b7-59775ace11cc" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.009502] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-30a735ee-d68e-4b01-87b7-59775ace11cc" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.009679] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-30a735ee-d68e-4b01-87b7-59775ace11cc" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.009905] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.010029] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.010094] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.010255] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.010341] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.010430] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-30a735ee-d68e-4b01-87b7-59775ace11cc" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.010577] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-30a735ee-d68e-4b01-87b7-59775ace11cc taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.010669] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-30a735ee-d68e-4b01-87b7-59775ace11cc" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.010729] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-30a735ee-d68e-4b01-87b7-59775ace11cc" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.010864] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-30a735ee-d68e-4b01-87b7-59775ace11cc" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.010998] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.011098] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.011157] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.011286] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.011360] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.011438] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-30a735ee-d68e-4b01-87b7-59775ace11cc" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.011524] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('30a735ee-d68e-4b01-87b7-59775ace11cc',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 933.013071] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 700dc02a-f3c2-4363-9a0e-d7cdcb13a5b8 in Status: SUCCESS [ 933.013258] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-700dc02a-f3c2-4363-9a0e-d7cdcb13a5b8" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.013437] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-700dc02a-f3c2-4363-9a0e-d7cdcb13a5b8" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.013556] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-700dc02a-f3c2-4363-9a0e-d7cdcb13a5b8" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.013699] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.013793] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.013852] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.013988] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.014074] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.014213] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('700dc02a-f3c2-4363-9a0e-d7cdcb13a5b8',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 933.015858] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.015993] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.019834] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.019911] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.020090] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.020172] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.021383] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.021383] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.021383] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.021383] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.021383] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.021383] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.021383] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.021383] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.021383] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.021383] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.021383] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d0e04be7-8718-489c-8ceb-fe661da4855a is going to be updated. [ 933.022504] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.022686] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.037567] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.037567] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.052385] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.052385] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.052385] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.052385] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.052385] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.052385] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.052385] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f9bdd708-8cea-4b45-818f-2a931611c895 is going to be updated. [ 933.053548] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.053603] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.090596] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.090905] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.091045] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.091115] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.091325] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.091410] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.091637] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.091749] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.091813] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.091979] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.092093] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.092292] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.092400] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.092449] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.092584] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.092662] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.092752] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0b52672e-87ad-43b6-b078-903b8601b014 is going to be updated. [ 933.093818] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.093993] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.094164] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.095864] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.095864] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.097269] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.097364] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.124017] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.124335] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.125112] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cdebe06d-8b9c-47c7-bf4d-f0246381eb14 in Status: IN_PROGRESS for 2s [ 933.127315] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.127558] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.127672] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.127755] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.127965] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.128361] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.128361] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.128361] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.128499] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.128574] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.128649] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.128857] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.128935] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.128997] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.129154] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.129230] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.129326] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f44b2d06-c9ca-4621-a354-74c006769956 is going to be updated. [ 933.130315] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.130460] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.130592] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.131475] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.131649] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.131798] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.139583] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.139583] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.139583] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.139583] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.139583] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.156248] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d0e04be7-8718-489c-8ceb-fe661da4855a in Status: IN_PROGRESS for 2s [ 933.156909] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 100806a5-6fdb-4512-83e3-fc77cac134dd in Status: IN_PROGRESS for 2s [ 933.157644] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f9bdd708-8cea-4b45-818f-2a931611c895 in Status: IN_PROGRESS for 2s [ 933.189995] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.190343] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.190343] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.190466] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.190576] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.236141] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0b52672e-87ad-43b6-b078-903b8601b014 in Status: IN_PROGRESS for 2s [ 933.236686] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7f2e833b-9263-48ef-ba09-f0afee0fa4af in Status: SUCCESS [ 933.236897] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7f2e833b-9263-48ef-ba09-f0afee0fa4af" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.267387] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e2390617-a1da-45a2-94eb-d162a19e2fae: rpc.has_security_group_logging(os_id): False [ 933.268557] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e2390617-a1da-45a2-94eb-d162a19e2fae',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 933.297560] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.297714] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.297804] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.298109] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.298268] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.307173] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.307345] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.307444] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.307698] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.311738] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f44b2d06-c9ca-4621-a354-74c006769956 in Status: IN_PROGRESS for 2s [ 933.356581] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.356877] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.357010] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.357082] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.357777] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.357777] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.357777] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.357777] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.357777] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.358041] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.358041] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.358104] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.358221] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.358263] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.358371] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.358446] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.359031] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e2390617-a1da-45a2-94eb-d162a19e2fae is going to be updated. [ 933.440959] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.441131] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.441204] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.441408] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.441673] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.458815] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e2390617-a1da-45a2-94eb-d162a19e2fae in Status: IN_PROGRESS for 2s [ 933.517041] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 30a735ee-d68e-4b01-87b7-59775ace11cc: rpc.has_security_group_logging(os_id): False [ 933.524473] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('700dc02a-f3c2-4363-9a0e-d7cdcb13a5b8',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 933.540719] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.540867] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.540962] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.541232] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.541350] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.541566] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.541715] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.541800] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.541979] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.542099] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.542314] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.542501] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.542501] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.543512] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.543512] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.543512] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.543512] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.543512] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.543512] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.543512] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.543512] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 30a735ee-d68e-4b01-87b7-59775ace11cc is going to be created. [ 933.604201] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.604357] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.604431] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.604641] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.604808] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.617392] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 30a735ee-d68e-4b01-87b7-59775ace11cc in Status: IN_PROGRESS for 2s [ 933.770654] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e2390617-a1da-45a2-94eb-d162a19e2fae',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 933.778709] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7bc12ce3-2b1a-439c-8e90-f01bd1033c9a in Status: SUCCESS [ 933.779302] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7bc12ce3-2b1a-439c-8e90-f01bd1033c9a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.779556] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7bc12ce3-2b1a-439c-8e90-f01bd1033c9a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.779733] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7bc12ce3-2b1a-439c-8e90-f01bd1033c9a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.779927] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.780572] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.780572] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.780572] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.780572] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.780572] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7bc12ce3-2b1a-439c-8e90-f01bd1033c9a',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 934.027231] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('700dc02a-f3c2-4363-9a0e-d7cdcb13a5b8',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 934.273161] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.273432] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.273432] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.273572] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.273665] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.273768] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e2390617-a1da-45a2-94eb-d162a19e2fae is going to be updated. [ 934.282259] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.282398] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.282468] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.282663] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.282749] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.282941] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.283051] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.283113] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.283259] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.283334] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.283418] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7bc12ce3-2b1a-439c-8e90-f01bd1033c9a is going to be deleted. [ 934.309038] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.309187] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.309256] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.309453] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.309603] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.309669] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7bc12ce3-2b1a-439c-8e90-f01bd1033c9a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.310525] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.310702] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.310702] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.310861] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.310997] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.318613] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e2390617-a1da-45a2-94eb-d162a19e2fae in Status: IN_PROGRESS for 2s [ 934.529719] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.529894] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.529947] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.530168] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.530266] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.530382] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 700dc02a-f3c2-4363-9a0e-d7cdcb13a5b8 is going to be updated. [ 934.558725] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.558890] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.558970] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.559172] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.559320] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.567303] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 700dc02a-f3c2-4363-9a0e-d7cdcb13a5b8 in Status: IN_PROGRESS for 2s [ 935.138263] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cdebe06d-8b9c-47c7-bf4d-f0246381eb14 in Status: SUCCESS [ 935.138556] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cdebe06d-8b9c-47c7-bf4d-f0246381eb14" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.170172] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f9bdd708-8cea-4b45-818f-2a931611c895 in Status: SUCCESS [ 935.170434] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f9bdd708-8cea-4b45-818f-2a931611c895" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.171590] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d0e04be7-8718-489c-8ceb-fe661da4855a in Status: SUCCESS [ 935.171590] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d0e04be7-8718-489c-8ceb-fe661da4855a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.172626] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 100806a5-6fdb-4512-83e3-fc77cac134dd in Status: SUCCESS [ 935.172626] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-100806a5-6fdb-4512-83e3-fc77cac134dd" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.250184] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0b52672e-87ad-43b6-b078-903b8601b014 in Status: SUCCESS [ 935.250460] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0b52672e-87ad-43b6-b078-903b8601b014" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.327057] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f44b2d06-c9ca-4621-a354-74c006769956 in Status: SUCCESS [ 935.327420] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f44b2d06-c9ca-4621-a354-74c006769956" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.473960] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e2390617-a1da-45a2-94eb-d162a19e2fae in Status: SUCCESS [ 935.474290] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e2390617-a1da-45a2-94eb-d162a19e2fae" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.474481] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e2390617-a1da-45a2-94eb-d162a19e2fae" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.474703] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e2390617-a1da-45a2-94eb-d162a19e2fae" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.474795] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e2390617-a1da-45a2-94eb-d162a19e2fae',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 935.632575] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 30a735ee-d68e-4b01-87b7-59775ace11cc in Status: SUCCESS [ 935.632575] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-30a735ee-d68e-4b01-87b7-59775ace11cc" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.977892] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-e2390617-a1da-45a2-94eb-d162a19e2fae taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.977892] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e2390617-a1da-45a2-94eb-d162a19e2fae" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.214339] env[69980]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 936.214476] env[69980]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=5 [ 936.328439] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e2390617-a1da-45a2-94eb-d162a19e2fae in Status: SUCCESS [ 936.328439] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e2390617-a1da-45a2-94eb-d162a19e2fae" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.329035] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e2390617-a1da-45a2-94eb-d162a19e2fae" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.329035] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e2390617-a1da-45a2-94eb-d162a19e2fae" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.329192] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.329311] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.329380] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.329535] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.329614] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.329697] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e2390617-a1da-45a2-94eb-d162a19e2fae" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.329786] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e2390617-a1da-45a2-94eb-d162a19e2fae',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 936.580025] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 700dc02a-f3c2-4363-9a0e-d7cdcb13a5b8 in Status: SUCCESS [ 936.580025] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-700dc02a-f3c2-4363-9a0e-d7cdcb13a5b8" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.580025] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-700dc02a-f3c2-4363-9a0e-d7cdcb13a5b8" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.580025] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-700dc02a-f3c2-4363-9a0e-d7cdcb13a5b8" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.580025] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.580025] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.580025] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.580025] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.580025] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.580025] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-700dc02a-f3c2-4363-9a0e-d7cdcb13a5b8" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.580025] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('700dc02a-f3c2-4363-9a0e-d7cdcb13a5b8',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 936.832207] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-e2390617-a1da-45a2-94eb-d162a19e2fae taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.835242] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e2390617-a1da-45a2-94eb-d162a19e2fae" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.835242] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e2390617-a1da-45a2-94eb-d162a19e2fae" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.835242] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e2390617-a1da-45a2-94eb-d162a19e2fae" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.835242] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.835242] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.835242] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.835242] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.835242] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.835242] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e2390617-a1da-45a2-94eb-d162a19e2fae" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.835242] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-e2390617-a1da-45a2-94eb-d162a19e2fae taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.835242] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e2390617-a1da-45a2-94eb-d162a19e2fae" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.835242] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e2390617-a1da-45a2-94eb-d162a19e2fae" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.835242] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e2390617-a1da-45a2-94eb-d162a19e2fae" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.835242] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.835242] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.835242] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.835242] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.835242] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.835847] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e2390617-a1da-45a2-94eb-d162a19e2fae" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.835847] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e2390617-a1da-45a2-94eb-d162a19e2fae',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 937.080484] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-700dc02a-f3c2-4363-9a0e-d7cdcb13a5b8 taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.084076] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-700dc02a-f3c2-4363-9a0e-d7cdcb13a5b8" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.084076] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-700dc02a-f3c2-4363-9a0e-d7cdcb13a5b8" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.084076] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-700dc02a-f3c2-4363-9a0e-d7cdcb13a5b8" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.084076] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.084076] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.084076] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.084076] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.084076] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.084076] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-700dc02a-f3c2-4363-9a0e-d7cdcb13a5b8" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.084076] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-700dc02a-f3c2-4363-9a0e-d7cdcb13a5b8 taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.084076] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-700dc02a-f3c2-4363-9a0e-d7cdcb13a5b8" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.084076] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-700dc02a-f3c2-4363-9a0e-d7cdcb13a5b8" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.084076] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-700dc02a-f3c2-4363-9a0e-d7cdcb13a5b8" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.084076] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.084076] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.084076] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.084076] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.084076] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.084822] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-700dc02a-f3c2-4363-9a0e-d7cdcb13a5b8" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.084822] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('700dc02a-f3c2-4363-9a0e-d7cdcb13a5b8',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 937.177422] env[69980]: INFO networking_nsxv3.common.synchronization [req-94a60219-edc3-4573-887c-3eaa804495fe req-a453c761-67d6-41de-81ef-6592bf04005a tempest-DeleteServersTestJSON-1084822395 tempest-DeleteServersTestJSON-1084822395-project-member] Enqueued Resource ID: d0e04be7-8718-489c-8ceb-fe661da4855a with Priority: HIGHEST for action security_group_members [ 937.177422] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d0e04be7-8718-489c-8ceb-fe661da4855a with Priority: HIGHEST for action security_group_members [ 937.177422] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-d0e04be7-8718-489c-8ceb-fe661da4855a taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.177422] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d0e04be7-8718-489c-8ceb-fe661da4855a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.180157] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d0e04be7-8718-489c-8ceb-fe661da4855a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.180157] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d0e04be7-8718-489c-8ceb-fe661da4855a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.180157] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.180157] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.180157] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.180157] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.180157] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.180157] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d0e04be7-8718-489c-8ceb-fe661da4855a',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 937.206208] env[69980]: INFO networking_nsxv3.common.synchronization [req-3d093dbf-9f66-42d8-947d-fc09a6254670 req-3192df36-c963-46a5-b087-bf3166b07668 tempest-ListServersNegativeTestJSON-1235469780 tempest-ListServersNegativeTestJSON-1235469780-project-member] Enqueued Resource ID: 0b52672e-87ad-43b6-b078-903b8601b014 with Priority: HIGHEST for action security_group_members [ 937.206642] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0b52672e-87ad-43b6-b078-903b8601b014 with Priority: HIGHEST for action security_group_members [ 937.207048] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-0b52672e-87ad-43b6-b078-903b8601b014 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.207317] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0b52672e-87ad-43b6-b078-903b8601b014" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.207394] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0b52672e-87ad-43b6-b078-903b8601b014" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.207588] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0b52672e-87ad-43b6-b078-903b8601b014" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.208242] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.208242] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.208242] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.208242] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.208242] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.208242] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0b52672e-87ad-43b6-b078-903b8601b014',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 937.339780] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e2390617-a1da-45a2-94eb-d162a19e2fae: rpc.has_security_group_logging(os_id): False [ 937.355449] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.355606] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.355678] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.355910] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.356014] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.356247] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.356445] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.356445] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.356651] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.356772] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.356979] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.357092] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.357155] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.357297] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.357372] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.357545] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.357638] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.357697] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.357830] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.357901] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.357986] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e2390617-a1da-45a2-94eb-d162a19e2fae is going to be updated. [ 937.414569] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.416084] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.416332] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.416450] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.416736] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.429632] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e2390617-a1da-45a2-94eb-d162a19e2fae in Status: IN_PROGRESS for 2s [ 937.443976] env[69980]: INFO networking_nsxv3.common.synchronization [req-4ed6b5c1-fc00-462d-b87a-3cd1631bace6 req-223c4524-5b3d-41e9-9930-84349751f40b tempest-ListServersNegativeTestJSON-1235469780 tempest-ListServersNegativeTestJSON-1235469780-project-member] Enqueued Resource ID: 0b52672e-87ad-43b6-b078-903b8601b014 with Priority: HIGHEST for action security_group_members [ 937.444666] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0b52672e-87ad-43b6-b078-903b8601b014 with Priority: HIGHEST for action security_group_members [ 937.445373] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-0b52672e-87ad-43b6-b078-903b8601b014 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.445373] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0b52672e-87ad-43b6-b078-903b8601b014" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.587689] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 700dc02a-f3c2-4363-9a0e-d7cdcb13a5b8: rpc.has_security_group_logging(os_id): False [ 937.607909] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.608450] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.610251] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.610251] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.632278] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.632278] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.632278] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.632278] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.632278] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.632278] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.632278] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.632278] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.632278] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.632278] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.632278] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.632278] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.632278] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.632278] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.633170] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.633170] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.633170] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 700dc02a-f3c2-4363-9a0e-d7cdcb13a5b8 is going to be updated. [ 937.685463] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.685463] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.685463] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.685463] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.685463] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.685463] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.685463] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.685463] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.685463] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.685463] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.685463] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d0e04be7-8718-489c-8ceb-fe661da4855a is going to be updated. [ 937.710292] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.715019] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.715019] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.715019] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.715019] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.715019] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0b52672e-87ad-43b6-b078-903b8601b014',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 937.717189] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.717633] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.717858] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.718188] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.720094] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.727771] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d0e04be7-8718-489c-8ceb-fe661da4855a in Status: IN_PROGRESS for 2s [ 937.734283] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 700dc02a-f3c2-4363-9a0e-d7cdcb13a5b8 in Status: IN_PROGRESS for 2s [ 938.223125] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0b52672e-87ad-43b6-b078-903b8601b014',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 938.727130] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.728140] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.728140] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.728140] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.728140] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.728140] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0b52672e-87ad-43b6-b078-903b8601b014 is going to be updated. [ 938.753965] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.753965] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.753965] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.753965] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.753965] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.763635] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0b52672e-87ad-43b6-b078-903b8601b014 in Status: IN_PROGRESS for 2s [ 939.443491] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e2390617-a1da-45a2-94eb-d162a19e2fae in Status: SUCCESS [ 939.443723] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e2390617-a1da-45a2-94eb-d162a19e2fae" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.444817] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e2390617-a1da-45a2-94eb-d162a19e2fae" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.445401] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e2390617-a1da-45a2-94eb-d162a19e2fae" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.445523] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e2390617-a1da-45a2-94eb-d162a19e2fae',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 939.788712] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d0e04be7-8718-489c-8ceb-fe661da4855a in Status: SUCCESS [ 939.788968] env[69980]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d0e04be7-8718-489c-8ceb-fe661da4855a deletion is rescheduled due to dependency. [ 939.789024] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d0e04be7-8718-489c-8ceb-fe661da4855a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.793213] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 700dc02a-f3c2-4363-9a0e-d7cdcb13a5b8 in Status: SUCCESS [ 939.793400] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-700dc02a-f3c2-4363-9a0e-d7cdcb13a5b8" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.947650] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-e2390617-a1da-45a2-94eb-d162a19e2fae taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.949130] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e2390617-a1da-45a2-94eb-d162a19e2fae" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.949130] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e2390617-a1da-45a2-94eb-d162a19e2fae" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.949130] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e2390617-a1da-45a2-94eb-d162a19e2fae" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.949130] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.949130] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.949130] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.949130] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.949130] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.949130] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e2390617-a1da-45a2-94eb-d162a19e2fae" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.949130] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e2390617-a1da-45a2-94eb-d162a19e2fae',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 940.454828] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-e2390617-a1da-45a2-94eb-d162a19e2fae taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.458030] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e2390617-a1da-45a2-94eb-d162a19e2fae" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.458030] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e2390617-a1da-45a2-94eb-d162a19e2fae" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.458030] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e2390617-a1da-45a2-94eb-d162a19e2fae" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.458030] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.458030] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.458030] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.458030] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.458030] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.458030] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e2390617-a1da-45a2-94eb-d162a19e2fae" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.458030] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-e2390617-a1da-45a2-94eb-d162a19e2fae taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.458030] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e2390617-a1da-45a2-94eb-d162a19e2fae" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.458030] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e2390617-a1da-45a2-94eb-d162a19e2fae" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.458030] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e2390617-a1da-45a2-94eb-d162a19e2fae" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.458030] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.458030] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.458030] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.458030] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.458030] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.459161] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e2390617-a1da-45a2-94eb-d162a19e2fae" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.459161] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e2390617-a1da-45a2-94eb-d162a19e2fae',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 940.773599] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0b52672e-87ad-43b6-b078-903b8601b014 in Status: SUCCESS [ 940.774174] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0b52672e-87ad-43b6-b078-903b8601b014" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.774174] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0b52672e-87ad-43b6-b078-903b8601b014" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.774322] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0b52672e-87ad-43b6-b078-903b8601b014" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.774740] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.774740] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.774740] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.774740] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.774943] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.774943] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0b52672e-87ad-43b6-b078-903b8601b014',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 940.964017] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e2390617-a1da-45a2-94eb-d162a19e2fae: rpc.has_security_group_logging(os_id): False [ 940.982890] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.982890] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.983073] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.983213] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.984048] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.986036] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.986036] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.986036] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.986036] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.986036] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.986036] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.986036] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.986036] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.987343] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.987343] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.987343] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.987343] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.987343] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.987343] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.987343] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.987343] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e2390617-a1da-45a2-94eb-d162a19e2fae is going to be updated. [ 941.049184] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.049184] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.049363] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.049534] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.049731] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.069105] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e2390617-a1da-45a2-94eb-d162a19e2fae in Status: IN_PROGRESS for 2s [ 941.188351] env[69980]: INFO networking_nsxv3.common.synchronization [req-a68b27f2-e79a-4d22-a7c5-cb49478a6b1f req-11fad52a-0b0f-4c89-8952-936196d7eb10 tempest-ServerActionsTestOtherA-1240783872 tempest-ServerActionsTestOtherA-1240783872-project-member] Enqueued Resource ID: 9057c45b-1d82-49a9-8ffb-aaf0cddf5801 with Priority: HIGHEST for action security_group_members [ 941.193674] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9057c45b-1d82-49a9-8ffb-aaf0cddf5801 with Priority: HIGHEST for action security_group_members [ 941.194630] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-9057c45b-1d82-49a9-8ffb-aaf0cddf5801 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.194630] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9057c45b-1d82-49a9-8ffb-aaf0cddf5801" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.194630] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9057c45b-1d82-49a9-8ffb-aaf0cddf5801" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.195033] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9057c45b-1d82-49a9-8ffb-aaf0cddf5801" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.195033] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.195033] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.195180] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.195258] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.195343] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.195440] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9057c45b-1d82-49a9-8ffb-aaf0cddf5801',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 941.282129] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.282320] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.282395] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.282695] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.282792] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.283089] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.283191] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.283191] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.283317] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.283391] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.283477] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0b52672e-87ad-43b6-b078-903b8601b014 is going to be updated. [ 941.309296] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.309444] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.309518] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.309726] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.309863] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.320051] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0b52672e-87ad-43b6-b078-903b8601b014 in Status: IN_PROGRESS for 2s [ 941.700061] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.700306] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.700989] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.700989] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.700989] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.701302] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.701486] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.701486] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.701600] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.702442] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.702442] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9057c45b-1d82-49a9-8ffb-aaf0cddf5801 already deleted. [ 941.702442] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9057c45b-1d82-49a9-8ffb-aaf0cddf5801" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.850931] env[69980]: INFO networking_nsxv3.common.synchronization [None req-eb405211-fad7-4b09-b996-cad01c5b7296 None None] Enqueued Resource ID: 2bf88169-98d1-40d8-ab58-8b7d10421d2f with Priority: HIGHEST for action port [ 941.851469] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2bf88169-98d1-40d8-ab58-8b7d10421d2f with Priority: HIGHEST for action port [ 941.851767] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock port-2bf88169-98d1-40d8-ab58-8b7d10421d2f taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.851888] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2bf88169-98d1-40d8-ab58-8b7d10421d2f" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.851955] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2bf88169-98d1-40d8-ab58-8b7d10421d2f" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.853321] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2bf88169-98d1-40d8-ab58-8b7d10421d2f" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.853395] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2bf88169-98d1-40d8-ab58-8b7d10421d2f',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 942.019622] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock network-714 taken with stack trace [, , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.019992] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "network-714" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.019992] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "network-714" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.020336] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "network-714" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.020601] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.020765] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.020883] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.021334] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.021512] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.021722] env[69980]: DEBUG dogpile.cache.region [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] No value present for key: 'zone-id' {{(pid=69980) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 942.021837] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] NeedRegenerationException {{(pid=69980) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 942.022129] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] no value, waiting for create lock {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 942.022284] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] value creation lock acquired {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 942.022405] env[69980]: DEBUG dogpile.cache.region [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] No value present for key: 'zone-id' {{(pid=69980) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 942.022514] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Calling creation function for not-yet-present value {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 942.022706] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 942.040634] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 942.040813] env[69980]: DEBUG dogpile.cache.region [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=69980) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 942.040954] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Released creation lock {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 942.041156] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "network-714" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.041468] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock port-065d2c34-4c86-4c4d-8f9e-e42c2e818cc1 taken with stack trace [, , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.041641] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "port-065d2c34-4c86-4c4d-8f9e-e42c2e818cc1" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.041760] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "port-065d2c34-4c86-4c4d-8f9e-e42c2e818cc1" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.042500] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "port-065d2c34-4c86-4c4d-8f9e-e42c2e818cc1" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.042500] env[69980]: DEBUG networking_nsxv3.api.rpc [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('065d2c34-4c86-4c4d-8f9e-e42c2e818cc1',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 942.358336] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 2bf88169-98d1-40d8-ab58-8b7d10421d2f [ 942.358336] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.358336] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.358336] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.358336] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.358336] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.358336] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:2bf88169-98d1-40d8-ab58-8b7d10421d2f already deleted. [ 942.358336] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2bf88169-98d1-40d8-ab58-8b7d10421d2f" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.545051] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.545677] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.545677] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.545841] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.545841] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.546132] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Segment Port 065d2c34-4c86-4c4d-8f9e-e42c2e818cc1 not found, creating... [ 942.546278] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.546439] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.546580] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.546822] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.546969] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.547275] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.547436] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.547576] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.547799] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.548323] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.548323] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Resource: SegmentPort with ID: 065d2c34-4c86-4c4d-8f9e-e42c2e818cc1 is going to be created. [ 942.553521] env[69980]: INFO networking_nsxv3.common.synchronization [req-cada6ca5-33a5-40fd-bd4e-022472b4200d req-db30226e-fd04-4b31-87eb-7d9cb2a4ca3e tempest-ServersNegativeTestMultiTenantJSON-449274158 tempest-ServersNegativeTestMultiTenantJSON-449274158-project-member] Enqueued Resource ID: 30a735ee-d68e-4b01-87b7-59775ace11cc with Priority: HIGHEST for action security_group_members [ 942.554462] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 30a735ee-d68e-4b01-87b7-59775ace11cc with Priority: HIGHEST for action security_group_members [ 942.554793] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-30a735ee-d68e-4b01-87b7-59775ace11cc taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.554939] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-30a735ee-d68e-4b01-87b7-59775ace11cc" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.555042] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-30a735ee-d68e-4b01-87b7-59775ace11cc" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.555239] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-30a735ee-d68e-4b01-87b7-59775ace11cc" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.555420] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.555546] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.555633] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.555802] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.555912] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.556066] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('30a735ee-d68e-4b01-87b7-59775ace11cc',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 942.572134] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.573399] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.573399] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.573399] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.573399] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.573399] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "port-065d2c34-4c86-4c4d-8f9e-e42c2e818cc1" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.058309] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.058613] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.058613] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.058763] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.058763] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.058920] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.059024] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.059077] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.059222] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.059299] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.060292] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 30a735ee-d68e-4b01-87b7-59775ace11cc is going to be updated. [ 943.084793] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e2390617-a1da-45a2-94eb-d162a19e2fae in Status: SUCCESS [ 943.085172] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e2390617-a1da-45a2-94eb-d162a19e2fae" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.086345] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.086345] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.086345] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.086549] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.086627] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.102754] env[69980]: INFO networking_nsxv3.common.synchronization [req-3c4a882b-e5aa-40a7-a5fb-ffa239604efd req-f17a89e7-d2f6-4381-b92f-6f23a8b09254 tempest-ImagesTestJSON-600722714 tempest-ImagesTestJSON-600722714-project-member] Enqueued Resource ID: 80e3ea48-91a5-4863-b1c2-f3e887204e39 with Priority: HIGHEST for action security_group_members [ 943.104380] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 80e3ea48-91a5-4863-b1c2-f3e887204e39 with Priority: HIGHEST for action security_group_members [ 943.108020] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-80e3ea48-91a5-4863-b1c2-f3e887204e39 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.108020] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-80e3ea48-91a5-4863-b1c2-f3e887204e39" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.108020] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-80e3ea48-91a5-4863-b1c2-f3e887204e39" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.108855] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-80e3ea48-91a5-4863-b1c2-f3e887204e39" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.108855] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.108855] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.108855] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.108855] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.108855] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.109124] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('80e3ea48-91a5-4863-b1c2-f3e887204e39',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 943.110699] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 30a735ee-d68e-4b01-87b7-59775ace11cc in Status: IN_PROGRESS for 2s [ 943.332237] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0b52672e-87ad-43b6-b078-903b8601b014 in Status: SUCCESS [ 943.332237] env[69980]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0b52672e-87ad-43b6-b078-903b8601b014 deletion is rescheduled due to dependency. [ 943.332237] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0b52672e-87ad-43b6-b078-903b8601b014" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.612799] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.613061] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.613760] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.613997] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.614115] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.614390] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.614495] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.614561] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.614730] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.614813] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.614909] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 80e3ea48-91a5-4863-b1c2-f3e887204e39 is going to be deleted. [ 943.641482] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.641628] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.641702] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.643273] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.643411] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.643520] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-80e3ea48-91a5-4863-b1c2-f3e887204e39" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.678964] env[69980]: INFO networking_nsxv3.common.synchronization [req-a68b27f2-e79a-4d22-a7c5-cb49478a6b1f req-6d68963d-1d34-4e57-a565-16060b9d461f service nova] Enqueued Resource ID: 9057c45b-1d82-49a9-8ffb-aaf0cddf5801 with Priority: HIGHEST for action security_group_rules [ 943.684235] env[69980]: INFO networking_nsxv3.common.synchronization [req-a68b27f2-e79a-4d22-a7c5-cb49478a6b1f req-6d68963d-1d34-4e57-a565-16060b9d461f service nova] Enqueued Resource ID: 9057c45b-1d82-49a9-8ffb-aaf0cddf5801 with Priority: HIGHEST for action security_group_members [ 943.685830] env[69980]: INFO networking_nsxv3.common.synchronization [req-a68b27f2-e79a-4d22-a7c5-cb49478a6b1f req-6d68963d-1d34-4e57-a565-16060b9d461f service nova] Enqueued Resource ID: 065d2c34-4c86-4c4d-8f9e-e42c2e818cc1 with Priority: HIGHEST for action port [ 943.685830] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9057c45b-1d82-49a9-8ffb-aaf0cddf5801 with Priority: HIGHEST for action security_group_rules [ 943.685830] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9057c45b-1d82-49a9-8ffb-aaf0cddf5801 with Priority: HIGHEST for action security_group_members [ 943.685830] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 065d2c34-4c86-4c4d-8f9e-e42c2e818cc1 with Priority: HIGHEST for action port [ 943.686168] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9057c45b-1d82-49a9-8ffb-aaf0cddf5801 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.686392] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9057c45b-1d82-49a9-8ffb-aaf0cddf5801" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.686541] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9057c45b-1d82-49a9-8ffb-aaf0cddf5801" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.686817] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9057c45b-1d82-49a9-8ffb-aaf0cddf5801" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.691019] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9057c45b-1d82-49a9-8ffb-aaf0cddf5801',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 943.691019] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-9057c45b-1d82-49a9-8ffb-aaf0cddf5801 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.691019] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9057c45b-1d82-49a9-8ffb-aaf0cddf5801" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.691019] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9057c45b-1d82-49a9-8ffb-aaf0cddf5801" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.691019] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9057c45b-1d82-49a9-8ffb-aaf0cddf5801" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.691019] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.691019] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.691019] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.691019] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.691019] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.691019] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9057c45b-1d82-49a9-8ffb-aaf0cddf5801',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 943.691019] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock port-065d2c34-4c86-4c4d-8f9e-e42c2e818cc1 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.691019] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-065d2c34-4c86-4c4d-8f9e-e42c2e818cc1" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.691019] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-065d2c34-4c86-4c4d-8f9e-e42c2e818cc1" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.691019] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-065d2c34-4c86-4c4d-8f9e-e42c2e818cc1" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.691019] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('065d2c34-4c86-4c4d-8f9e-e42c2e818cc1',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 944.017805] env[69980]: INFO networking_nsxv3.common.synchronization [None req-e3e92356-272e-46e0-9b37-8e1b404c9e73 None None] Enqueued Resource ID: c7eaccc0-69dc-4c82-b0f3-eb3d84f80db4 with Priority: HIGHEST for action port [ 944.017990] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c7eaccc0-69dc-4c82-b0f3-eb3d84f80db4 with Priority: HIGHEST for action port [ 944.018602] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock port-c7eaccc0-69dc-4c82-b0f3-eb3d84f80db4 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.018744] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c7eaccc0-69dc-4c82-b0f3-eb3d84f80db4" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.018824] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c7eaccc0-69dc-4c82-b0f3-eb3d84f80db4" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.019906] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c7eaccc0-69dc-4c82-b0f3-eb3d84f80db4" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.020020] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c7eaccc0-69dc-4c82-b0f3-eb3d84f80db4',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 944.085858] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock network-136 taken with stack trace [, , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.085858] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "network-136" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.086251] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "network-136" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.086473] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "network-136" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.086879] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.087149] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.087215] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.087423] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.087679] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.087822] env[69980]: DEBUG dogpile.cache.region [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] No value present for key: 'zone-id' {{(pid=69980) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 944.087933] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] NeedRegenerationException {{(pid=69980) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 944.088047] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] no value, waiting for create lock {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 944.088178] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] value creation lock acquired {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 944.088294] env[69980]: DEBUG dogpile.cache.region [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] No value present for key: 'zone-id' {{(pid=69980) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 944.088376] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Calling creation function for not-yet-present value {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 944.088560] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 944.106427] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 944.106626] env[69980]: DEBUG dogpile.cache.region [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=69980) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 944.106797] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Released creation lock {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 944.106975] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "network-136" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.107354] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock port-27245a43-d9aa-4124-b55c-fed2a0ff3a3b taken with stack trace [, , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.107558] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "port-27245a43-d9aa-4124-b55c-fed2a0ff3a3b" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.107680] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "port-27245a43-d9aa-4124-b55c-fed2a0ff3a3b" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.108049] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "port-27245a43-d9aa-4124-b55c-fed2a0ff3a3b" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.108197] env[69980]: DEBUG networking_nsxv3.api.rpc [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('27245a43-d9aa-4124-b55c-fed2a0ff3a3b',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 944.193794] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-9057c45b-1d82-49a9-8ffb-aaf0cddf5801 taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.193794] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9057c45b-1d82-49a9-8ffb-aaf0cddf5801" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.194323] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9057c45b-1d82-49a9-8ffb-aaf0cddf5801',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 944.195453] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 065d2c34-4c86-4c4d-8f9e-e42c2e818cc1 with status ACTIVE [ 944.195677] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.195796] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.195872] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.196108] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.196219] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.196404] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.196517] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.196581] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.196747] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.196838] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.197546] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.197718] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.197787] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.197968] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.198190] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.198313] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 065d2c34-4c86-4c4d-8f9e-e42c2e818cc1 is going to be updated. [ 944.220280] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.220409] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.220463] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.220874] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.220874] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.221074] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-065d2c34-4c86-4c4d-8f9e-e42c2e818cc1" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.526445] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port c7eaccc0-69dc-4c82-b0f3-eb3d84f80db4 [ 944.526445] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.526445] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.526445] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.526445] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.526445] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.526445] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:c7eaccc0-69dc-4c82-b0f3-eb3d84f80db4 already deleted. [ 944.526445] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c7eaccc0-69dc-4c82-b0f3-eb3d84f80db4" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.611341] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.611341] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.611546] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.612340] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.612340] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.612340] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Segment Port 27245a43-d9aa-4124-b55c-fed2a0ff3a3b not found, creating... [ 944.612340] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.612622] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.612662] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.613224] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.613224] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.613360] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.613468] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.613596] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.613789] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.613923] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.616908] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Resource: SegmentPort with ID: 27245a43-d9aa-4124-b55c-fed2a0ff3a3b is going to be created. [ 944.633234] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.633475] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.633625] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.633896] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.634147] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.634414] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "port-27245a43-d9aa-4124-b55c-fed2a0ff3a3b" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.701285] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9057c45b-1d82-49a9-8ffb-aaf0cddf5801',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 945.122033] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 30a735ee-d68e-4b01-87b7-59775ace11cc in Status: SUCCESS [ 945.122304] env[69980]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 30a735ee-d68e-4b01-87b7-59775ace11cc deletion is rescheduled due to dependency. [ 945.122364] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-30a735ee-d68e-4b01-87b7-59775ace11cc" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.205715] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.207783] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.207783] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.207783] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.207783] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.207783] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9057c45b-1d82-49a9-8ffb-aaf0cddf5801 is going to be created. [ 945.230773] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.230966] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.230966] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.232794] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.232794] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.240382] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9057c45b-1d82-49a9-8ffb-aaf0cddf5801 in Status: UNINITIALIZED for 2s [ 945.491855] env[69980]: INFO networking_nsxv3.common.synchronization [req-3c4a882b-e5aa-40a7-a5fb-ffa239604efd req-55b95c44-3da3-4fbf-b49b-9b543d1d7517 service nova] Enqueued Resource ID: 80e3ea48-91a5-4863-b1c2-f3e887204e39 with Priority: HIGHEST for action security_group_rules [ 945.491967] env[69980]: INFO networking_nsxv3.common.synchronization [req-3c4a882b-e5aa-40a7-a5fb-ffa239604efd req-55b95c44-3da3-4fbf-b49b-9b543d1d7517 service nova] Enqueued Resource ID: 80e3ea48-91a5-4863-b1c2-f3e887204e39 with Priority: HIGHEST for action security_group_members [ 945.492120] env[69980]: INFO networking_nsxv3.common.synchronization [req-3c4a882b-e5aa-40a7-a5fb-ffa239604efd req-55b95c44-3da3-4fbf-b49b-9b543d1d7517 service nova] Enqueued Resource ID: 27245a43-d9aa-4124-b55c-fed2a0ff3a3b with Priority: HIGHEST for action port [ 945.492623] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 80e3ea48-91a5-4863-b1c2-f3e887204e39 with Priority: HIGHEST for action security_group_rules [ 945.492760] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 80e3ea48-91a5-4863-b1c2-f3e887204e39 with Priority: HIGHEST for action security_group_members [ 945.492858] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 27245a43-d9aa-4124-b55c-fed2a0ff3a3b with Priority: HIGHEST for action port [ 945.496432] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock rules-80e3ea48-91a5-4863-b1c2-f3e887204e39 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.496608] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-80e3ea48-91a5-4863-b1c2-f3e887204e39" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.496711] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-80e3ea48-91a5-4863-b1c2-f3e887204e39" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.496944] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-80e3ea48-91a5-4863-b1c2-f3e887204e39" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.497040] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('80e3ea48-91a5-4863-b1c2-f3e887204e39',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 945.497980] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-80e3ea48-91a5-4863-b1c2-f3e887204e39 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.498758] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-80e3ea48-91a5-4863-b1c2-f3e887204e39" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.499350] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-80e3ea48-91a5-4863-b1c2-f3e887204e39" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.499607] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-80e3ea48-91a5-4863-b1c2-f3e887204e39" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.499884] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.500294] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.500294] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.500967] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.501120] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.502650] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('80e3ea48-91a5-4863-b1c2-f3e887204e39',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 945.502650] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock port-27245a43-d9aa-4124-b55c-fed2a0ff3a3b taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.502847] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-27245a43-d9aa-4124-b55c-fed2a0ff3a3b" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.502847] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-27245a43-d9aa-4124-b55c-fed2a0ff3a3b" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.502927] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-27245a43-d9aa-4124-b55c-fed2a0ff3a3b" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.502962] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('27245a43-d9aa-4124-b55c-fed2a0ff3a3b',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 946.007431] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('80e3ea48-91a5-4863-b1c2-f3e887204e39',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 946.008461] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 27245a43-d9aa-4124-b55c-fed2a0ff3a3b with status ACTIVE [ 946.008682] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.008813] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.008813] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.009024] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.009200] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.009425] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.009480] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.009515] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.009711] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.009788] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.009988] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.010071] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.010132] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.010262] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.010309] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.010574] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 27245a43-d9aa-4124-b55c-fed2a0ff3a3b is going to be updated. [ 946.011522] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-80e3ea48-91a5-4863-b1c2-f3e887204e39 taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.011643] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-80e3ea48-91a5-4863-b1c2-f3e887204e39" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.032695] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.032695] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.032695] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.032695] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.032695] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.032695] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-27245a43-d9aa-4124-b55c-fed2a0ff3a3b" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.512729] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('80e3ea48-91a5-4863-b1c2-f3e887204e39',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 947.017994] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.017994] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.017994] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.017994] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.017994] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.017994] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 80e3ea48-91a5-4863-b1c2-f3e887204e39 is going to be created. [ 947.046326] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.046326] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.046326] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.046326] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.046326] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.055803] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 80e3ea48-91a5-4863-b1c2-f3e887204e39 in Status: UNINITIALIZED for 2s [ 947.252016] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9057c45b-1d82-49a9-8ffb-aaf0cddf5801 in Status: SUCCESS [ 947.252016] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9057c45b-1d82-49a9-8ffb-aaf0cddf5801" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.252016] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9057c45b-1d82-49a9-8ffb-aaf0cddf5801" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.252016] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9057c45b-1d82-49a9-8ffb-aaf0cddf5801" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.252016] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.252016] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.252016] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.252016] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.252016] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.252016] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9057c45b-1d82-49a9-8ffb-aaf0cddf5801" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.252016] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9057c45b-1d82-49a9-8ffb-aaf0cddf5801',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 947.487686] env[69980]: INFO networking_nsxv3.common.synchronization [req-e6b99cac-3f08-4646-aa33-ed1d87757d38 req-74bffb29-a2e6-40b7-87da-e454025e45a7 tempest-ImagesOneServerNegativeTestJSON-332667785 tempest-ImagesOneServerNegativeTestJSON-332667785-project-member] Enqueued Resource ID: d53aff15-d6ed-495c-9f29-fdc03bd13622 with Priority: HIGHEST for action security_group_members [ 947.488282] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d53aff15-d6ed-495c-9f29-fdc03bd13622 with Priority: HIGHEST for action security_group_members [ 947.488955] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-d53aff15-d6ed-495c-9f29-fdc03bd13622 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.489226] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d53aff15-d6ed-495c-9f29-fdc03bd13622" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.489344] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d53aff15-d6ed-495c-9f29-fdc03bd13622" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.490774] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d53aff15-d6ed-495c-9f29-fdc03bd13622" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.490774] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.490774] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.490774] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.490774] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.490774] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.490774] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d53aff15-d6ed-495c-9f29-fdc03bd13622',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 947.560208] env[69980]: INFO networking_nsxv3.common.synchronization [None req-e9eec00f-b03c-48b4-b562-5e43f9dd17e1 None None] Enqueued Resource ID: f5333883-2296-4667-8839-07d2468e4160 with Priority: HIGHEST for action port [ 947.560208] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f5333883-2296-4667-8839-07d2468e4160 with Priority: HIGHEST for action port [ 947.560208] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock port-f5333883-2296-4667-8839-07d2468e4160 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.560208] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f5333883-2296-4667-8839-07d2468e4160" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.560208] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f5333883-2296-4667-8839-07d2468e4160" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.560208] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f5333883-2296-4667-8839-07d2468e4160" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.560208] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f5333883-2296-4667-8839-07d2468e4160',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 947.755276] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9057c45b-1d82-49a9-8ffb-aaf0cddf5801',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 947.993042] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.993207] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.993283] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.993502] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.993591] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.993787] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.993887] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.993950] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.994124] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.994202] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.994314] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d53aff15-d6ed-495c-9f29-fdc03bd13622 is going to be deleted. [ 948.022608] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.022758] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.022857] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.023073] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.023807] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.023807] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d53aff15-d6ed-495c-9f29-fdc03bd13622" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.067471] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f5333883-2296-4667-8839-07d2468e4160 [ 948.067471] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.067471] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.067471] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.067471] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.067471] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.067471] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f5333883-2296-4667-8839-07d2468e4160 already deleted. [ 948.067471] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f5333883-2296-4667-8839-07d2468e4160" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.130138] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock network-926 taken with stack trace [, , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.130342] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "network-926" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.130466] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "network-926" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.130727] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "network-926" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.133642] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.133642] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.133642] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.133642] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.133642] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.133642] env[69980]: DEBUG dogpile.cache.region [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] No value present for key: 'zone-id' {{(pid=69980) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 948.133642] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] NeedRegenerationException {{(pid=69980) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 948.133642] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] no value, waiting for create lock {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 948.133642] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] value creation lock acquired {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 948.133642] env[69980]: DEBUG dogpile.cache.region [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] No value present for key: 'zone-id' {{(pid=69980) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 948.133642] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Calling creation function for not-yet-present value {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 948.133642] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 948.152290] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 948.152548] env[69980]: DEBUG dogpile.cache.region [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=69980) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 948.152713] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Released creation lock {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 948.152903] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "network-926" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.153260] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock port-8884bc72-93fe-404e-8940-91f085c6b13f taken with stack trace [, , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.153514] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "port-8884bc72-93fe-404e-8940-91f085c6b13f" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.153717] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "port-8884bc72-93fe-404e-8940-91f085c6b13f" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.154187] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "port-8884bc72-93fe-404e-8940-91f085c6b13f" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.154495] env[69980]: DEBUG networking_nsxv3.api.rpc [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8884bc72-93fe-404e-8940-91f085c6b13f',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 948.257128] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9057c45b-1d82-49a9-8ffb-aaf0cddf5801: rpc.has_security_group_logging(os_id): False [ 948.274923] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.275040] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.275107] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.275317] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.275402] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.276164] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.276164] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.276164] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.276164] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.276164] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.276164] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9057c45b-1d82-49a9-8ffb-aaf0cddf5801 is going to be created. [ 948.332875] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.333032] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.333120] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.333349] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.333461] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.345425] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9057c45b-1d82-49a9-8ffb-aaf0cddf5801 in Status: IN_PROGRESS for 2s [ 948.661019] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.661019] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.661019] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.661019] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.661019] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.661019] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Segment Port 8884bc72-93fe-404e-8940-91f085c6b13f not found, creating... [ 948.661019] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.661019] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.661019] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.661019] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.661019] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.661936] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.661936] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.661936] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.661936] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.661936] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.661936] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Resource: SegmentPort with ID: 8884bc72-93fe-404e-8940-91f085c6b13f is going to be created. [ 948.683078] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.683078] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.683078] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.683078] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.683078] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.683078] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "port-8884bc72-93fe-404e-8940-91f085c6b13f" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.843865] env[69980]: INFO networking_nsxv3.common.synchronization [None req-ca20a241-1c8b-4b4e-8aad-3e4050cd65bd tempest-ServersTestFqdnHostnames-1390135796 tempest-ServersTestFqdnHostnames-1390135796-project-member] Enqueued Resource ID: 98819590-8807-4667-9ed7-ac1964aca5fa with Priority: HIGHEST for action security_group_rules [ 948.844472] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 98819590-8807-4667-9ed7-ac1964aca5fa with Priority: HIGHEST for action security_group_rules [ 948.844775] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock rules-98819590-8807-4667-9ed7-ac1964aca5fa taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.844887] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-98819590-8807-4667-9ed7-ac1964aca5fa" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.844947] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-98819590-8807-4667-9ed7-ac1964aca5fa" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.847187] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-98819590-8807-4667-9ed7-ac1964aca5fa" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.847407] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('98819590-8807-4667-9ed7-ac1964aca5fa',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 949.071076] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 80e3ea48-91a5-4863-b1c2-f3e887204e39 in Status: SUCCESS [ 949.071334] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-80e3ea48-91a5-4863-b1c2-f3e887204e39" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.071513] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-80e3ea48-91a5-4863-b1c2-f3e887204e39" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.076353] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-80e3ea48-91a5-4863-b1c2-f3e887204e39" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.076630] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.076766] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.076835] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.077049] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.077142] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.077232] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-80e3ea48-91a5-4863-b1c2-f3e887204e39" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.077326] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('80e3ea48-91a5-4863-b1c2-f3e887204e39',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 949.266829] env[69980]: INFO networking_nsxv3.common.synchronization [None req-0126377e-20d7-48cc-a087-53b3660106a5 tempest-ServersTestFqdnHostnames-1390135796 tempest-ServersTestFqdnHostnames-1390135796-project-member] Enqueued Resource ID: 98819590-8807-4667-9ed7-ac1964aca5fa with Priority: HIGHEST for action security_group_rules [ 949.266829] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 98819590-8807-4667-9ed7-ac1964aca5fa with Priority: HIGHEST for action security_group_rules [ 949.266829] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock rules-98819590-8807-4667-9ed7-ac1964aca5fa taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.266829] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-98819590-8807-4667-9ed7-ac1964aca5fa" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.346251] env[69980]: INFO networking_nsxv3.common.synchronization [None req-a1a2f51b-e3d2-4954-9471-81929df5faab None None] Enqueued Resource ID: 4ed3e3cf-e5a9-45e8-90bd-e6ceda131170 with Priority: HIGHEST for action port [ 949.346827] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4ed3e3cf-e5a9-45e8-90bd-e6ceda131170 with Priority: HIGHEST for action port [ 949.347168] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock port-4ed3e3cf-e5a9-45e8-90bd-e6ceda131170 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.347286] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4ed3e3cf-e5a9-45e8-90bd-e6ceda131170" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.347374] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4ed3e3cf-e5a9-45e8-90bd-e6ceda131170" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.347680] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4ed3e3cf-e5a9-45e8-90bd-e6ceda131170" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.348990] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4ed3e3cf-e5a9-45e8-90bd-e6ceda131170',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 949.369013] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.369157] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.369228] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.369422] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.369512] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.369605] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 98819590-8807-4667-9ed7-ac1964aca5fa already deleted. [ 949.369687] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-98819590-8807-4667-9ed7-ac1964aca5fa" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.370115] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-98819590-8807-4667-9ed7-ac1964aca5fa" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.370279] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-98819590-8807-4667-9ed7-ac1964aca5fa" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.370364] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('98819590-8807-4667-9ed7-ac1964aca5fa',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 949.558984] env[69980]: INFO networking_nsxv3.common.synchronization [req-e6b99cac-3f08-4646-aa33-ed1d87757d38 req-b11999c0-d9a7-4421-b887-d533304636fa service nova] Enqueued Resource ID: d53aff15-d6ed-495c-9f29-fdc03bd13622 with Priority: HIGHEST for action security_group_rules [ 949.558984] env[69980]: INFO networking_nsxv3.common.synchronization [req-e6b99cac-3f08-4646-aa33-ed1d87757d38 req-b11999c0-d9a7-4421-b887-d533304636fa service nova] Enqueued Resource ID: d53aff15-d6ed-495c-9f29-fdc03bd13622 with Priority: HIGHEST for action security_group_members [ 949.559167] env[69980]: INFO networking_nsxv3.common.synchronization [req-e6b99cac-3f08-4646-aa33-ed1d87757d38 req-b11999c0-d9a7-4421-b887-d533304636fa service nova] Enqueued Resource ID: 8884bc72-93fe-404e-8940-91f085c6b13f with Priority: HIGHEST for action port [ 949.559395] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d53aff15-d6ed-495c-9f29-fdc03bd13622 with Priority: HIGHEST for action security_group_rules [ 949.559519] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d53aff15-d6ed-495c-9f29-fdc03bd13622 with Priority: HIGHEST for action security_group_members [ 949.559727] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8884bc72-93fe-404e-8940-91f085c6b13f with Priority: HIGHEST for action port [ 949.560332] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d53aff15-d6ed-495c-9f29-fdc03bd13622 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.560536] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d53aff15-d6ed-495c-9f29-fdc03bd13622" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.560592] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d53aff15-d6ed-495c-9f29-fdc03bd13622" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.560795] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d53aff15-d6ed-495c-9f29-fdc03bd13622" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.560918] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d53aff15-d6ed-495c-9f29-fdc03bd13622',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 949.562081] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-d53aff15-d6ed-495c-9f29-fdc03bd13622 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.562209] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d53aff15-d6ed-495c-9f29-fdc03bd13622" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.562322] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d53aff15-d6ed-495c-9f29-fdc03bd13622" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.562642] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d53aff15-d6ed-495c-9f29-fdc03bd13622" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.562916] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.563101] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.563101] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.563294] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.563393] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.563489] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d53aff15-d6ed-495c-9f29-fdc03bd13622',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 949.565478] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock port-8884bc72-93fe-404e-8940-91f085c6b13f taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.566119] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8884bc72-93fe-404e-8940-91f085c6b13f" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.566119] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8884bc72-93fe-404e-8940-91f085c6b13f" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.566119] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8884bc72-93fe-404e-8940-91f085c6b13f" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.566119] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8884bc72-93fe-404e-8940-91f085c6b13f',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 949.579724] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-80e3ea48-91a5-4863-b1c2-f3e887204e39 taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.579953] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-80e3ea48-91a5-4863-b1c2-f3e887204e39" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.580096] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-80e3ea48-91a5-4863-b1c2-f3e887204e39" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.580421] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-80e3ea48-91a5-4863-b1c2-f3e887204e39" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.582158] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.582158] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.582158] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.582158] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.582158] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.582158] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-80e3ea48-91a5-4863-b1c2-f3e887204e39" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.582158] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-80e3ea48-91a5-4863-b1c2-f3e887204e39 taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.582158] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-80e3ea48-91a5-4863-b1c2-f3e887204e39" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.582158] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-80e3ea48-91a5-4863-b1c2-f3e887204e39" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.582158] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-80e3ea48-91a5-4863-b1c2-f3e887204e39" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.582158] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.582158] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.582158] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.582158] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.582734] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.582734] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-80e3ea48-91a5-4863-b1c2-f3e887204e39" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.582734] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('80e3ea48-91a5-4863-b1c2-f3e887204e39',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 949.858386] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 4ed3e3cf-e5a9-45e8-90bd-e6ceda131170 [ 949.858386] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.858386] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.858386] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.858386] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.858386] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.858386] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:4ed3e3cf-e5a9-45e8-90bd-e6ceda131170 already deleted. [ 949.858386] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4ed3e3cf-e5a9-45e8-90bd-e6ceda131170" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.890889] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.891053] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.891113] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.891326] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.891451] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.891500] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 98819590-8807-4667-9ed7-ac1964aca5fa already deleted. [ 949.891585] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-98819590-8807-4667-9ed7-ac1964aca5fa" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.073395] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d53aff15-d6ed-495c-9f29-fdc03bd13622',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 950.073395] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 8884bc72-93fe-404e-8940-91f085c6b13f with status ACTIVE [ 950.073395] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.073395] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.073395] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.073395] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.073395] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.073395] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.073395] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.073395] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.073395] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.073395] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.073395] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.073395] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.073395] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.073395] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.074045] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.074045] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 8884bc72-93fe-404e-8940-91f085c6b13f is going to be updated. [ 950.075813] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-d53aff15-d6ed-495c-9f29-fdc03bd13622 taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.075813] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d53aff15-d6ed-495c-9f29-fdc03bd13622" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.084645] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 80e3ea48-91a5-4863-b1c2-f3e887204e39: rpc.has_security_group_logging(os_id): False [ 950.094908] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.095066] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.095142] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.095399] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.095893] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.096789] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8884bc72-93fe-404e-8940-91f085c6b13f" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.103860] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.103998] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.104081] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.104367] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.104542] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.104764] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.104855] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.104924] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.105113] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.105694] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.105694] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.105694] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.106446] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.106446] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.106446] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.106446] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.106446] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.106446] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.106909] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.106909] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.106909] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 80e3ea48-91a5-4863-b1c2-f3e887204e39 is going to be created. [ 950.182257] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.182257] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.182257] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.182257] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.182257] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.193625] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 80e3ea48-91a5-4863-b1c2-f3e887204e39 in Status: IN_PROGRESS for 2s [ 950.365131] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9057c45b-1d82-49a9-8ffb-aaf0cddf5801 in Status: SUCCESS [ 950.365366] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9057c45b-1d82-49a9-8ffb-aaf0cddf5801" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.579863] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d53aff15-d6ed-495c-9f29-fdc03bd13622',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 950.682671] env[69980]: INFO networking_nsxv3.common.synchronization [req-37075b08-622a-4dfe-b9b0-13fac1f8d75b req-79b86085-566f-4d08-b613-09346ae8e758 tempest-VolumesAdminNegativeTest-1476822754 tempest-VolumesAdminNegativeTest-1476822754-project-member] Enqueued Resource ID: 100806a5-6fdb-4512-83e3-fc77cac134dd with Priority: HIGHEST for action security_group_members [ 950.683067] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 100806a5-6fdb-4512-83e3-fc77cac134dd with Priority: HIGHEST for action security_group_members [ 950.684649] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-100806a5-6fdb-4512-83e3-fc77cac134dd taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.684649] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-100806a5-6fdb-4512-83e3-fc77cac134dd" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.684649] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-100806a5-6fdb-4512-83e3-fc77cac134dd" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.684649] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-100806a5-6fdb-4512-83e3-fc77cac134dd" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.684649] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.684649] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.684649] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.685099] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.685099] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.685099] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('100806a5-6fdb-4512-83e3-fc77cac134dd',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 951.081865] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.082186] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.082186] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.082337] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.082423] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.082523] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d53aff15-d6ed-495c-9f29-fdc03bd13622 is going to be created. [ 951.107124] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.107124] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.107124] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.107397] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.107491] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.117723] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d53aff15-d6ed-495c-9f29-fdc03bd13622 in Status: UNINITIALIZED for 2s [ 951.187891] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.188121] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.188212] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.188391] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.188686] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.188801] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.188887] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.188943] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.189090] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.189164] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.189254] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 100806a5-6fdb-4512-83e3-fc77cac134dd is going to be updated. [ 951.216785] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.216946] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.217078] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.221020] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.221020] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.227180] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 100806a5-6fdb-4512-83e3-fc77cac134dd in Status: IN_PROGRESS for 2s [ 952.213355] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 80e3ea48-91a5-4863-b1c2-f3e887204e39 in Status: SUCCESS [ 952.213355] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-80e3ea48-91a5-4863-b1c2-f3e887204e39" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.297439] env[69980]: INFO networking_nsxv3.common.synchronization [req-3ca9ce26-5457-4ab0-b153-03187d015d1d req-40f51434-c996-43d4-8eb6-2d3d2e909b09 tempest-ServerDiskConfigTestJSON-214268531 tempest-ServerDiskConfigTestJSON-214268531-project-member] Enqueued Resource ID: 0dbf2bcd-0572-43ef-b18d-cc3cca7fcfd5 with Priority: HIGHEST for action security_group_members [ 952.297967] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0dbf2bcd-0572-43ef-b18d-cc3cca7fcfd5 with Priority: HIGHEST for action security_group_members [ 952.298294] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-0dbf2bcd-0572-43ef-b18d-cc3cca7fcfd5 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.298423] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0dbf2bcd-0572-43ef-b18d-cc3cca7fcfd5" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.298489] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0dbf2bcd-0572-43ef-b18d-cc3cca7fcfd5" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.298683] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0dbf2bcd-0572-43ef-b18d-cc3cca7fcfd5" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.298847] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.298929] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.299017] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.303977] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.303977] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.303977] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0dbf2bcd-0572-43ef-b18d-cc3cca7fcfd5',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 952.754402] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock network-932 taken with stack trace [, , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.754672] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "network-932" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.754840] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "network-932" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.755091] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "network-932" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.755362] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.755522] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.755643] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.755865] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.756026] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.756239] env[69980]: DEBUG dogpile.cache.region [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] No value present for key: 'zone-id' {{(pid=69980) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 952.756353] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] NeedRegenerationException {{(pid=69980) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 952.756464] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] no value, waiting for create lock {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 952.756571] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] value creation lock acquired {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 952.756865] env[69980]: DEBUG dogpile.cache.region [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] No value present for key: 'zone-id' {{(pid=69980) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 952.756865] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Calling creation function for not-yet-present value {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 952.756983] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 952.776455] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 952.776690] env[69980]: DEBUG dogpile.cache.region [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=69980) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 952.777071] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Released creation lock {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 952.777071] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "network-932" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.777348] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock port-7e3858e9-27ef-4d71-a9b3-54f3b03f9fa9 taken with stack trace [, , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.777525] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "port-7e3858e9-27ef-4d71-a9b3-54f3b03f9fa9" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.777643] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "port-7e3858e9-27ef-4d71-a9b3-54f3b03f9fa9" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.777982] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "port-7e3858e9-27ef-4d71-a9b3-54f3b03f9fa9" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.778143] env[69980]: DEBUG networking_nsxv3.api.rpc [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7e3858e9-27ef-4d71-a9b3-54f3b03f9fa9',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 952.805826] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.805987] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.806078] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.806286] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.806404] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.806704] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.806813] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.806875] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.808044] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.808044] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.808044] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0dbf2bcd-0572-43ef-b18d-cc3cca7fcfd5 is going to be deleted. [ 952.836255] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.836414] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.836460] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.836696] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.836805] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.836851] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0dbf2bcd-0572-43ef-b18d-cc3cca7fcfd5" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.126490] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d53aff15-d6ed-495c-9f29-fdc03bd13622 in Status: SUCCESS [ 953.126599] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d53aff15-d6ed-495c-9f29-fdc03bd13622" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.126847] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d53aff15-d6ed-495c-9f29-fdc03bd13622" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.127285] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d53aff15-d6ed-495c-9f29-fdc03bd13622" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.127285] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.127443] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.127485] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.127625] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.127731] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.127793] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d53aff15-d6ed-495c-9f29-fdc03bd13622" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.127887] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d53aff15-d6ed-495c-9f29-fdc03bd13622',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 953.236479] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 100806a5-6fdb-4512-83e3-fc77cac134dd in Status: SUCCESS [ 953.236771] env[69980]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 100806a5-6fdb-4512-83e3-fc77cac134dd deletion is rescheduled due to dependency. [ 953.236771] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-100806a5-6fdb-4512-83e3-fc77cac134dd" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.280375] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.280660] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.280796] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.281085] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.281313] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.281508] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Segment Port 7e3858e9-27ef-4d71-a9b3-54f3b03f9fa9 not found, creating... [ 953.281821] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.282054] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.282210] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.282473] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.282622] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.282909] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.283138] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.283303] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.283558] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.283747] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.283920] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Resource: SegmentPort with ID: 7e3858e9-27ef-4d71-a9b3-54f3b03f9fa9 is going to be created. [ 953.302961] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.303194] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.303321] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.303581] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.303811] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.304047] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "port-7e3858e9-27ef-4d71-a9b3-54f3b03f9fa9" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.632030] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-d53aff15-d6ed-495c-9f29-fdc03bd13622 taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.632030] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d53aff15-d6ed-495c-9f29-fdc03bd13622" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.632030] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d53aff15-d6ed-495c-9f29-fdc03bd13622" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.632030] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d53aff15-d6ed-495c-9f29-fdc03bd13622" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.632502] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.636021] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.636021] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.636021] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.636021] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.636021] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d53aff15-d6ed-495c-9f29-fdc03bd13622" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.636021] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-d53aff15-d6ed-495c-9f29-fdc03bd13622 taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.636021] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d53aff15-d6ed-495c-9f29-fdc03bd13622" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.636021] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d53aff15-d6ed-495c-9f29-fdc03bd13622" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.636021] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d53aff15-d6ed-495c-9f29-fdc03bd13622" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.636021] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.636021] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.636021] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.636021] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.636021] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.636021] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d53aff15-d6ed-495c-9f29-fdc03bd13622" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.636021] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d53aff15-d6ed-495c-9f29-fdc03bd13622',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 954.137805] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d53aff15-d6ed-495c-9f29-fdc03bd13622: rpc.has_security_group_logging(os_id): False [ 954.155281] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.155465] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.155614] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.155750] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.155840] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.156097] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.156219] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.156327] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.156485] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.156648] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.156831] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.156982] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.157872] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.157938] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.158009] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.158255] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.158382] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.158463] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.158645] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.158735] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.158860] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d53aff15-d6ed-495c-9f29-fdc03bd13622 is going to be created. [ 954.229612] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.229943] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.229943] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.230109] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.230251] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.244369] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d53aff15-d6ed-495c-9f29-fdc03bd13622 in Status: IN_PROGRESS for 2s [ 954.616412] env[69980]: INFO networking_nsxv3.common.synchronization [req-3ca9ce26-5457-4ab0-b153-03187d015d1d req-0ab8fb3d-cc3c-4576-9ecc-75d9d8027bff service nova] Enqueued Resource ID: 0dbf2bcd-0572-43ef-b18d-cc3cca7fcfd5 with Priority: HIGHEST for action security_group_rules [ 954.616412] env[69980]: INFO networking_nsxv3.common.synchronization [req-3ca9ce26-5457-4ab0-b153-03187d015d1d req-0ab8fb3d-cc3c-4576-9ecc-75d9d8027bff service nova] Enqueued Resource ID: 0dbf2bcd-0572-43ef-b18d-cc3cca7fcfd5 with Priority: HIGHEST for action security_group_members [ 954.616412] env[69980]: INFO networking_nsxv3.common.synchronization [req-3ca9ce26-5457-4ab0-b153-03187d015d1d req-0ab8fb3d-cc3c-4576-9ecc-75d9d8027bff service nova] Enqueued Resource ID: 7e3858e9-27ef-4d71-a9b3-54f3b03f9fa9 with Priority: HIGHEST for action port [ 954.616412] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0dbf2bcd-0572-43ef-b18d-cc3cca7fcfd5 with Priority: HIGHEST for action security_group_rules [ 954.616412] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0dbf2bcd-0572-43ef-b18d-cc3cca7fcfd5 with Priority: HIGHEST for action security_group_members [ 954.616412] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7e3858e9-27ef-4d71-a9b3-54f3b03f9fa9 with Priority: HIGHEST for action port [ 954.616412] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0dbf2bcd-0572-43ef-b18d-cc3cca7fcfd5 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.616412] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0dbf2bcd-0572-43ef-b18d-cc3cca7fcfd5" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.616412] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0dbf2bcd-0572-43ef-b18d-cc3cca7fcfd5" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.616412] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0dbf2bcd-0572-43ef-b18d-cc3cca7fcfd5" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.616412] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0dbf2bcd-0572-43ef-b18d-cc3cca7fcfd5',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 954.617769] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-0dbf2bcd-0572-43ef-b18d-cc3cca7fcfd5 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.617769] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0dbf2bcd-0572-43ef-b18d-cc3cca7fcfd5" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.617769] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0dbf2bcd-0572-43ef-b18d-cc3cca7fcfd5" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.617769] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0dbf2bcd-0572-43ef-b18d-cc3cca7fcfd5" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.617769] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.617769] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.617769] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.617769] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.617769] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.618187] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0dbf2bcd-0572-43ef-b18d-cc3cca7fcfd5',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 954.619114] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock port-7e3858e9-27ef-4d71-a9b3-54f3b03f9fa9 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.619114] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7e3858e9-27ef-4d71-a9b3-54f3b03f9fa9" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.619114] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7e3858e9-27ef-4d71-a9b3-54f3b03f9fa9" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.619114] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7e3858e9-27ef-4d71-a9b3-54f3b03f9fa9" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.619114] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7e3858e9-27ef-4d71-a9b3-54f3b03f9fa9',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 955.121194] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-0dbf2bcd-0572-43ef-b18d-cc3cca7fcfd5 taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.121194] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0dbf2bcd-0572-43ef-b18d-cc3cca7fcfd5" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.121194] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0dbf2bcd-0572-43ef-b18d-cc3cca7fcfd5',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 955.125840] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 7e3858e9-27ef-4d71-a9b3-54f3b03f9fa9 with status ACTIVE [ 955.126286] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.126286] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.126286] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.126475] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.126537] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.126718] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.126814] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.126886] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.127035] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.127376] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.127570] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.127664] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.127721] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.127859] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.127934] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.128030] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 7e3858e9-27ef-4d71-a9b3-54f3b03f9fa9 is going to be updated. [ 955.152490] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.152694] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.152766] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.152917] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.153056] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.153216] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7e3858e9-27ef-4d71-a9b3-54f3b03f9fa9" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.559225] env[69980]: INFO networking_nsxv3.common.synchronization [None req-e237faeb-5d4d-4c19-9410-200ef84d9b7b None None] Enqueued Resource ID: 7f9c6ab7-e04c-4d3b-805d-a8143cb86e4d with Priority: HIGHEST for action port [ 955.559532] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7f9c6ab7-e04c-4d3b-805d-a8143cb86e4d with Priority: HIGHEST for action port [ 955.560779] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock port-7f9c6ab7-e04c-4d3b-805d-a8143cb86e4d taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.560779] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7f9c6ab7-e04c-4d3b-805d-a8143cb86e4d" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.560779] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7f9c6ab7-e04c-4d3b-805d-a8143cb86e4d" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.560779] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7f9c6ab7-e04c-4d3b-805d-a8143cb86e4d" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.561029] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7f9c6ab7-e04c-4d3b-805d-a8143cb86e4d',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 955.630381] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0dbf2bcd-0572-43ef-b18d-cc3cca7fcfd5',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 956.066519] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 7f9c6ab7-e04c-4d3b-805d-a8143cb86e4d [ 956.066750] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.066886] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.066955] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.067184] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.067276] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.067373] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:7f9c6ab7-e04c-4d3b-805d-a8143cb86e4d already deleted. [ 956.067455] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7f9c6ab7-e04c-4d3b-805d-a8143cb86e4d" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.135777] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.135938] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.136026] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.136239] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.136330] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.136473] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0dbf2bcd-0572-43ef-b18d-cc3cca7fcfd5 is going to be created. [ 956.160643] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.160868] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.160954] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.161221] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.161416] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.184171] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0dbf2bcd-0572-43ef-b18d-cc3cca7fcfd5 in Status: UNINITIALIZED for 2s [ 956.258216] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d53aff15-d6ed-495c-9f29-fdc03bd13622 in Status: SUCCESS [ 956.258510] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d53aff15-d6ed-495c-9f29-fdc03bd13622" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.106239] env[69980]: INFO networking_nsxv3.common.synchronization [req-c04a76ad-2b9d-408f-9cd1-575a6350628f req-63a36f7b-204f-4128-8ff1-d958bc571436 tempest-ServerDiagnosticsNegativeTest-1661671035 tempest-ServerDiagnosticsNegativeTest-1661671035-project-member] Enqueued Resource ID: 182d01fc-7e61-4437-b380-e0d264b41c12 with Priority: HIGHEST for action security_group_members [ 957.106239] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 182d01fc-7e61-4437-b380-e0d264b41c12 with Priority: HIGHEST for action security_group_members [ 957.106239] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-182d01fc-7e61-4437-b380-e0d264b41c12 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.106239] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-182d01fc-7e61-4437-b380-e0d264b41c12" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.106239] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-182d01fc-7e61-4437-b380-e0d264b41c12" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.106239] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-182d01fc-7e61-4437-b380-e0d264b41c12" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.106239] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.106239] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.106239] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.108296] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.108497] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.108704] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('182d01fc-7e61-4437-b380-e0d264b41c12',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 957.613650] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.614646] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.616058] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.616058] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.616058] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.616058] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.616058] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.616058] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.616058] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.616058] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.616058] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 182d01fc-7e61-4437-b380-e0d264b41c12 already deleted. [ 957.616058] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-182d01fc-7e61-4437-b380-e0d264b41c12" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.629098] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock network-557 taken with stack trace [, , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.629098] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "network-557" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.629098] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "network-557" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.629098] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "network-557" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.629098] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.629098] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.629489] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.629816] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.630070] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.630366] env[69980]: DEBUG dogpile.cache.region [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] No value present for key: 'zone-id' {{(pid=69980) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 957.630564] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] NeedRegenerationException {{(pid=69980) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 957.630748] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] no value, waiting for create lock {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 957.630954] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] value creation lock acquired {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 957.631178] env[69980]: DEBUG dogpile.cache.region [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] No value present for key: 'zone-id' {{(pid=69980) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 957.631366] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Calling creation function for not-yet-present value {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 957.631588] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 957.653244] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 957.653244] env[69980]: DEBUG dogpile.cache.region [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=69980) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 957.653244] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Released creation lock {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 957.653244] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "network-557" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.653244] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock port-775d0907-fcd8-46c9-a6a6-e8d06e310f6d taken with stack trace [, , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.653244] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "port-775d0907-fcd8-46c9-a6a6-e8d06e310f6d" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.653244] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "port-775d0907-fcd8-46c9-a6a6-e8d06e310f6d" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.653978] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "port-775d0907-fcd8-46c9-a6a6-e8d06e310f6d" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.654910] env[69980]: DEBUG networking_nsxv3.api.rpc [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('775d0907-fcd8-46c9-a6a6-e8d06e310f6d',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 958.157961] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.158251] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.158362] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.158650] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.158806] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.158968] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Segment Port 775d0907-fcd8-46c9-a6a6-e8d06e310f6d not found, creating... [ 958.159249] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.159411] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.159533] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.159754] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.159894] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.162496] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.162496] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.162496] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.162496] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.162496] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.162496] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Resource: SegmentPort with ID: 775d0907-fcd8-46c9-a6a6-e8d06e310f6d is going to be created. [ 958.181512] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.181512] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.181512] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.181512] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.181512] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.181512] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "port-775d0907-fcd8-46c9-a6a6-e8d06e310f6d" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.197527] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0dbf2bcd-0572-43ef-b18d-cc3cca7fcfd5 in Status: SUCCESS [ 958.197527] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0dbf2bcd-0572-43ef-b18d-cc3cca7fcfd5" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.197527] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0dbf2bcd-0572-43ef-b18d-cc3cca7fcfd5" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.197527] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0dbf2bcd-0572-43ef-b18d-cc3cca7fcfd5" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.197527] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.197527] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.197527] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.197527] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.197527] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.197828] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0dbf2bcd-0572-43ef-b18d-cc3cca7fcfd5" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.197828] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('0dbf2bcd-0572-43ef-b18d-cc3cca7fcfd5',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 958.276591] env[69980]: INFO networking_nsxv3.common.synchronization [None req-8bda984f-49f2-4358-b6df-e01167cd446a None None] Enqueued Resource ID: e88df025-3c19-4232-b273-64a9af0618c1 with Priority: HIGHEST for action port [ 958.276853] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e88df025-3c19-4232-b273-64a9af0618c1 with Priority: HIGHEST for action port [ 958.277418] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock port-e88df025-3c19-4232-b273-64a9af0618c1 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.277541] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e88df025-3c19-4232-b273-64a9af0618c1" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.277610] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e88df025-3c19-4232-b273-64a9af0618c1" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.277853] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e88df025-3c19-4232-b273-64a9af0618c1" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.277943] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e88df025-3c19-4232-b273-64a9af0618c1',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 958.703015] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-0dbf2bcd-0572-43ef-b18d-cc3cca7fcfd5 taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.703231] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0dbf2bcd-0572-43ef-b18d-cc3cca7fcfd5" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.703317] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0dbf2bcd-0572-43ef-b18d-cc3cca7fcfd5" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.703566] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0dbf2bcd-0572-43ef-b18d-cc3cca7fcfd5" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.704144] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.704144] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.704144] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.704144] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.704320] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.704392] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0dbf2bcd-0572-43ef-b18d-cc3cca7fcfd5" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.704585] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-0dbf2bcd-0572-43ef-b18d-cc3cca7fcfd5 taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.704687] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0dbf2bcd-0572-43ef-b18d-cc3cca7fcfd5" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.704775] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0dbf2bcd-0572-43ef-b18d-cc3cca7fcfd5" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.704932] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0dbf2bcd-0572-43ef-b18d-cc3cca7fcfd5" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.705116] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.705236] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.705305] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.705508] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.705565] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.705658] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0dbf2bcd-0572-43ef-b18d-cc3cca7fcfd5" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.705759] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('0dbf2bcd-0572-43ef-b18d-cc3cca7fcfd5',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 958.779831] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port e88df025-3c19-4232-b273-64a9af0618c1 [ 958.780071] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.780206] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.780278] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.780494] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.780581] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.780676] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:e88df025-3c19-4232-b273-64a9af0618c1 already deleted. [ 958.780757] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e88df025-3c19-4232-b273-64a9af0618c1" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.971684] env[69980]: INFO networking_nsxv3.common.synchronization [req-c04a76ad-2b9d-408f-9cd1-575a6350628f req-be40a478-d665-4011-a51a-3fd9d353c636 service nova] Enqueued Resource ID: 182d01fc-7e61-4437-b380-e0d264b41c12 with Priority: HIGHEST for action security_group_rules [ 958.971684] env[69980]: INFO networking_nsxv3.common.synchronization [req-c04a76ad-2b9d-408f-9cd1-575a6350628f req-be40a478-d665-4011-a51a-3fd9d353c636 service nova] Enqueued Resource ID: 182d01fc-7e61-4437-b380-e0d264b41c12 with Priority: HIGHEST for action security_group_members [ 958.971684] env[69980]: INFO networking_nsxv3.common.synchronization [req-c04a76ad-2b9d-408f-9cd1-575a6350628f req-be40a478-d665-4011-a51a-3fd9d353c636 service nova] Enqueued Resource ID: 775d0907-fcd8-46c9-a6a6-e8d06e310f6d with Priority: HIGHEST for action port [ 958.971851] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 182d01fc-7e61-4437-b380-e0d264b41c12 with Priority: HIGHEST for action security_group_rules [ 958.971938] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 182d01fc-7e61-4437-b380-e0d264b41c12 with Priority: HIGHEST for action security_group_members [ 958.972330] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 775d0907-fcd8-46c9-a6a6-e8d06e310f6d with Priority: HIGHEST for action port [ 958.972981] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock rules-182d01fc-7e61-4437-b380-e0d264b41c12 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.973129] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-182d01fc-7e61-4437-b380-e0d264b41c12" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.973199] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-182d01fc-7e61-4437-b380-e0d264b41c12" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.973459] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-182d01fc-7e61-4437-b380-e0d264b41c12" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.973546] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('182d01fc-7e61-4437-b380-e0d264b41c12',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 958.974619] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-182d01fc-7e61-4437-b380-e0d264b41c12 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.974725] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-182d01fc-7e61-4437-b380-e0d264b41c12" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.974790] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-182d01fc-7e61-4437-b380-e0d264b41c12" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.974962] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-182d01fc-7e61-4437-b380-e0d264b41c12" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.975119] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.975215] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.975277] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.975451] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.975537] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.975629] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('182d01fc-7e61-4437-b380-e0d264b41c12',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 958.977375] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock port-775d0907-fcd8-46c9-a6a6-e8d06e310f6d taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.977488] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-775d0907-fcd8-46c9-a6a6-e8d06e310f6d" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.977556] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-775d0907-fcd8-46c9-a6a6-e8d06e310f6d" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.978533] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-775d0907-fcd8-46c9-a6a6-e8d06e310f6d" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.978642] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('775d0907-fcd8-46c9-a6a6-e8d06e310f6d',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 959.211730] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 0dbf2bcd-0572-43ef-b18d-cc3cca7fcfd5: rpc.has_security_group_logging(os_id): False [ 959.252203] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.252495] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.252495] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.252716] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.252772] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.254478] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.254478] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.254478] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.254478] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.254478] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.254478] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.254478] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.254478] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.254478] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.254478] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.254478] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.254478] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.254478] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.255133] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.255133] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.255133] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0dbf2bcd-0572-43ef-b18d-cc3cca7fcfd5 is going to be created. [ 959.329091] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.329226] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.329274] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.329501] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.329752] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.341143] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0dbf2bcd-0572-43ef-b18d-cc3cca7fcfd5 in Status: IN_PROGRESS for 2s [ 959.481027] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-182d01fc-7e61-4437-b380-e0d264b41c12 taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.481027] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-182d01fc-7e61-4437-b380-e0d264b41c12" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.481481] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('182d01fc-7e61-4437-b380-e0d264b41c12',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 959.486075] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 775d0907-fcd8-46c9-a6a6-e8d06e310f6d with status ACTIVE [ 959.486075] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.486075] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.486075] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.486256] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.486336] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.486523] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.486779] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.486779] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.486854] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.486918] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.487530] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.487712] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.487751] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.487947] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.488050] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.488198] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 775d0907-fcd8-46c9-a6a6-e8d06e310f6d is going to be updated. [ 959.509368] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.509560] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.509560] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.509750] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.509884] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.510061] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-775d0907-fcd8-46c9-a6a6-e8d06e310f6d" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.990868] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('182d01fc-7e61-4437-b380-e0d264b41c12',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 960.496719] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.497109] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.497109] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.497423] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.497563] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.497724] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 182d01fc-7e61-4437-b380-e0d264b41c12 is going to be created. [ 960.520886] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.520886] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.521136] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.521280] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.522159] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.531871] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 182d01fc-7e61-4437-b380-e0d264b41c12 in Status: UNINITIALIZED for 2s [ 961.367210] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0dbf2bcd-0572-43ef-b18d-cc3cca7fcfd5 in Status: SUCCESS [ 961.367457] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0dbf2bcd-0572-43ef-b18d-cc3cca7fcfd5" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.911157] env[69980]: INFO networking_nsxv3.common.synchronization [req-77e2f533-feb4-42de-ad56-102bdb3c67e0 req-38a66881-c849-497d-80b0-be48eccf88b1 tempest-ServersWithSpecificFlavorTestJSON-977701913 tempest-ServersWithSpecificFlavorTestJSON-977701913-project-member] Enqueued Resource ID: 3b94a139-70f4-4b1b-82e2-803c78f509bf with Priority: HIGHEST for action security_group_members [ 961.911813] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3b94a139-70f4-4b1b-82e2-803c78f509bf with Priority: HIGHEST for action security_group_members [ 961.912270] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-3b94a139-70f4-4b1b-82e2-803c78f509bf taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.912421] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3b94a139-70f4-4b1b-82e2-803c78f509bf" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.915850] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3b94a139-70f4-4b1b-82e2-803c78f509bf" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.916134] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3b94a139-70f4-4b1b-82e2-803c78f509bf" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.916327] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.916453] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.916499] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.916681] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.916766] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.916867] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3b94a139-70f4-4b1b-82e2-803c78f509bf',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 962.390588] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock network-994 taken with stack trace [, , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.390781] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "network-994" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.391010] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "network-994" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.391833] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "network-994" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.392449] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.392656] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.392785] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.394023] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.394023] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.394023] env[69980]: DEBUG dogpile.cache.region [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] No value present for key: 'zone-id' {{(pid=69980) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 962.394023] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] NeedRegenerationException {{(pid=69980) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 962.394023] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] no value, waiting for create lock {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 962.394023] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] value creation lock acquired {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 962.394023] env[69980]: DEBUG dogpile.cache.region [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] No value present for key: 'zone-id' {{(pid=69980) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 962.394023] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Calling creation function for not-yet-present value {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 962.394438] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 962.412050] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 962.412204] env[69980]: DEBUG dogpile.cache.region [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=69980) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 962.412324] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Released creation lock {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 962.412677] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "network-994" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.412824] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock port-b023b1c8-769e-4b9a-926c-38e0d784d0a2 taken with stack trace [, , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.413061] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "port-b023b1c8-769e-4b9a-926c-38e0d784d0a2" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.413185] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "port-b023b1c8-769e-4b9a-926c-38e0d784d0a2" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.413511] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "port-b023b1c8-769e-4b9a-926c-38e0d784d0a2" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.413653] env[69980]: DEBUG networking_nsxv3.api.rpc [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b023b1c8-769e-4b9a-926c-38e0d784d0a2',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 962.419380] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.419530] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.419628] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.419957] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.419957] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.420189] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.420316] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.420403] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.420603] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.420697] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.420813] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3b94a139-70f4-4b1b-82e2-803c78f509bf is going to be deleted. [ 962.451939] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.452101] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.452161] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.452488] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.452592] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.452692] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3b94a139-70f4-4b1b-82e2-803c78f509bf" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.546334] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 182d01fc-7e61-4437-b380-e0d264b41c12 in Status: SUCCESS [ 962.546598] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-182d01fc-7e61-4437-b380-e0d264b41c12" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.546805] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-182d01fc-7e61-4437-b380-e0d264b41c12" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.547072] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-182d01fc-7e61-4437-b380-e0d264b41c12" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.547277] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.547397] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.547471] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.547623] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.547704] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.547808] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-182d01fc-7e61-4437-b380-e0d264b41c12" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.547902] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('182d01fc-7e61-4437-b380-e0d264b41c12',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 962.916223] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.916639] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.916745] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.917095] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.917323] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.917520] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Segment Port b023b1c8-769e-4b9a-926c-38e0d784d0a2 not found, creating... [ 962.917860] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.918166] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.918261] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.918525] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.918713] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.919080] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.919293] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.919444] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.919721] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.919879] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.920080] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Resource: SegmentPort with ID: b023b1c8-769e-4b9a-926c-38e0d784d0a2 is going to be created. [ 962.939527] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.939829] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.939964] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.940312] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.940583] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.940835] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "port-b023b1c8-769e-4b9a-926c-38e0d784d0a2" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.051518] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-182d01fc-7e61-4437-b380-e0d264b41c12 taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.051671] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-182d01fc-7e61-4437-b380-e0d264b41c12" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.051762] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-182d01fc-7e61-4437-b380-e0d264b41c12" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.051968] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-182d01fc-7e61-4437-b380-e0d264b41c12" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.052174] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.052280] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.052345] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.052526] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.052640] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.052736] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-182d01fc-7e61-4437-b380-e0d264b41c12" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.052840] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-182d01fc-7e61-4437-b380-e0d264b41c12 taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.052933] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-182d01fc-7e61-4437-b380-e0d264b41c12" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.053011] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-182d01fc-7e61-4437-b380-e0d264b41c12" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.053151] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-182d01fc-7e61-4437-b380-e0d264b41c12" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.053288] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.053382] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.053432] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.053568] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.053630] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.053728] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-182d01fc-7e61-4437-b380-e0d264b41c12" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.053896] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('182d01fc-7e61-4437-b380-e0d264b41c12',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 963.555826] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 182d01fc-7e61-4437-b380-e0d264b41c12: rpc.has_security_group_logging(os_id): False [ 963.573298] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.573298] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.573426] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.573600] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.573692] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.573927] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.574075] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.574142] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.574322] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.574434] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.574666] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.574770] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.574837] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.575178] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.575178] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.575463] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.575605] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.575690] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.575910] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.576019] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.576140] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 182d01fc-7e61-4437-b380-e0d264b41c12 is going to be created. [ 963.632530] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.632747] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.632787] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.632979] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.633172] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.651677] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 182d01fc-7e61-4437-b380-e0d264b41c12 in Status: IN_PROGRESS for 2s [ 963.741137] env[69980]: INFO networking_nsxv3.common.synchronization [req-77e2f533-feb4-42de-ad56-102bdb3c67e0 req-4d303796-7fc4-4238-868e-5a9b549d1534 service nova] Enqueued Resource ID: 3b94a139-70f4-4b1b-82e2-803c78f509bf with Priority: HIGHEST for action security_group_rules [ 963.741137] env[69980]: INFO networking_nsxv3.common.synchronization [req-77e2f533-feb4-42de-ad56-102bdb3c67e0 req-4d303796-7fc4-4238-868e-5a9b549d1534 service nova] Enqueued Resource ID: 3b94a139-70f4-4b1b-82e2-803c78f509bf with Priority: HIGHEST for action security_group_members [ 963.741137] env[69980]: INFO networking_nsxv3.common.synchronization [req-77e2f533-feb4-42de-ad56-102bdb3c67e0 req-4d303796-7fc4-4238-868e-5a9b549d1534 service nova] Enqueued Resource ID: b023b1c8-769e-4b9a-926c-38e0d784d0a2 with Priority: HIGHEST for action port [ 963.741294] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3b94a139-70f4-4b1b-82e2-803c78f509bf with Priority: HIGHEST for action security_group_rules [ 963.741432] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3b94a139-70f4-4b1b-82e2-803c78f509bf with Priority: HIGHEST for action security_group_members [ 963.741525] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b023b1c8-769e-4b9a-926c-38e0d784d0a2 with Priority: HIGHEST for action port [ 963.742826] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3b94a139-70f4-4b1b-82e2-803c78f509bf taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.742954] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3b94a139-70f4-4b1b-82e2-803c78f509bf" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.743031] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3b94a139-70f4-4b1b-82e2-803c78f509bf" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.743313] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3b94a139-70f4-4b1b-82e2-803c78f509bf" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.743437] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3b94a139-70f4-4b1b-82e2-803c78f509bf',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 963.744466] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-3b94a139-70f4-4b1b-82e2-803c78f509bf taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.744630] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3b94a139-70f4-4b1b-82e2-803c78f509bf" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.744697] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3b94a139-70f4-4b1b-82e2-803c78f509bf" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.744889] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3b94a139-70f4-4b1b-82e2-803c78f509bf" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.748039] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.748039] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.748039] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.748039] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.748039] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.748039] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3b94a139-70f4-4b1b-82e2-803c78f509bf',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 963.748039] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock port-b023b1c8-769e-4b9a-926c-38e0d784d0a2 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.748039] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b023b1c8-769e-4b9a-926c-38e0d784d0a2" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.748670] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b023b1c8-769e-4b9a-926c-38e0d784d0a2" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.748670] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b023b1c8-769e-4b9a-926c-38e0d784d0a2" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.748670] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b023b1c8-769e-4b9a-926c-38e0d784d0a2',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 963.934593] env[69980]: INFO networking_nsxv3.common.synchronization [req-7c754fc3-44ab-4fa1-8994-a4389cb70577 req-53485ef2-af2d-4c78-ac56-67d830cb2a3c tempest-SecurityGroupsTestJSON-1482814430 tempest-SecurityGroupsTestJSON-1482814430-project-member] Enqueued Resource ID: cdebe06d-8b9c-47c7-bf4d-f0246381eb14 with Priority: HIGHEST for action security_group_members [ 963.934593] env[69980]: INFO networking_nsxv3.common.synchronization [req-7c754fc3-44ab-4fa1-8994-a4389cb70577 req-53485ef2-af2d-4c78-ac56-67d830cb2a3c tempest-SecurityGroupsTestJSON-1482814430 tempest-SecurityGroupsTestJSON-1482814430-project-member] Enqueued Resource ID: f9bdd708-8cea-4b45-818f-2a931611c895 with Priority: HIGHEST for action security_group_members [ 963.934911] env[69980]: INFO networking_nsxv3.common.synchronization [req-7c754fc3-44ab-4fa1-8994-a4389cb70577 req-53485ef2-af2d-4c78-ac56-67d830cb2a3c tempest-SecurityGroupsTestJSON-1482814430 tempest-SecurityGroupsTestJSON-1482814430-project-member] Enqueued Resource ID: e2390617-a1da-45a2-94eb-d162a19e2fae with Priority: HIGHEST for action security_group_members [ 963.938021] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cdebe06d-8b9c-47c7-bf4d-f0246381eb14 with Priority: HIGHEST for action security_group_members [ 963.938021] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f9bdd708-8cea-4b45-818f-2a931611c895 with Priority: HIGHEST for action security_group_members [ 963.938021] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e2390617-a1da-45a2-94eb-d162a19e2fae with Priority: HIGHEST for action security_group_members [ 963.938021] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-cdebe06d-8b9c-47c7-bf4d-f0246381eb14 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.938021] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cdebe06d-8b9c-47c7-bf4d-f0246381eb14" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.938021] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cdebe06d-8b9c-47c7-bf4d-f0246381eb14" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.938021] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cdebe06d-8b9c-47c7-bf4d-f0246381eb14" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.938021] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.938021] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.938021] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.938021] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.938021] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.938021] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cdebe06d-8b9c-47c7-bf4d-f0246381eb14',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 963.938611] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-f9bdd708-8cea-4b45-818f-2a931611c895 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.938907] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f9bdd708-8cea-4b45-818f-2a931611c895" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.938907] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f9bdd708-8cea-4b45-818f-2a931611c895" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.938980] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f9bdd708-8cea-4b45-818f-2a931611c895" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.939140] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.939224] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.939288] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.939432] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.939527] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.939679] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f9bdd708-8cea-4b45-818f-2a931611c895',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 963.941369] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-e2390617-a1da-45a2-94eb-d162a19e2fae taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.941517] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e2390617-a1da-45a2-94eb-d162a19e2fae" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.941550] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e2390617-a1da-45a2-94eb-d162a19e2fae" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.941701] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e2390617-a1da-45a2-94eb-d162a19e2fae" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.942185] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.942294] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.942338] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.942493] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.942566] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.942644] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e2390617-a1da-45a2-94eb-d162a19e2fae',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 964.250293] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3b94a139-70f4-4b1b-82e2-803c78f509bf',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 964.251862] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-3b94a139-70f4-4b1b-82e2-803c78f509bf taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.252098] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3b94a139-70f4-4b1b-82e2-803c78f509bf" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.252782] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b023b1c8-769e-4b9a-926c-38e0d784d0a2 with status ACTIVE [ 964.253206] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.253577] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.253577] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.253926] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.254122] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.254497] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.254738] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.254738] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.255084] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.255235] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.255469] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.255648] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.255786] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.256034] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.256150] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.256276] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b023b1c8-769e-4b9a-926c-38e0d784d0a2 is going to be updated. [ 964.278474] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.278617] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.278719] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.279093] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.279364] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.279571] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b023b1c8-769e-4b9a-926c-38e0d784d0a2" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.444596] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.444777] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.444865] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.445135] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.445190] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.445379] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.445525] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.445606] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.445752] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.445827] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.445918] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cdebe06d-8b9c-47c7-bf4d-f0246381eb14 is going to be updated. [ 964.448230] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.448362] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.448421] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.448608] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.448694] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.448891] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.449012] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.449060] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.449208] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.449283] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.449371] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e2390617-a1da-45a2-94eb-d162a19e2fae is going to be updated. [ 964.450416] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.450524] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.450586] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.450740] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.450818] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.450992] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.451105] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.451155] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.451297] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.451371] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.451457] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f9bdd708-8cea-4b45-818f-2a931611c895 is going to be updated. [ 964.480255] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.480444] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.480490] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.480680] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.480816] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.483789] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.483789] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.483789] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.483789] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.483789] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.484501] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.484683] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.484683] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.484941] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.484941] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.496510] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cdebe06d-8b9c-47c7-bf4d-f0246381eb14 in Status: IN_PROGRESS for 2s [ 964.497220] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f9bdd708-8cea-4b45-818f-2a931611c895 in Status: IN_PROGRESS for 2s [ 964.498447] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e2390617-a1da-45a2-94eb-d162a19e2fae in Status: IN_PROGRESS for 2s [ 964.754541] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3b94a139-70f4-4b1b-82e2-803c78f509bf',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 965.262317] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.262317] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.262660] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.262660] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.262830] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.262830] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3b94a139-70f4-4b1b-82e2-803c78f509bf is going to be created. [ 965.296740] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.296942] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.296942] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.297172] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.297332] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.307200] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3b94a139-70f4-4b1b-82e2-803c78f509bf in Status: UNINITIALIZED for 2s [ 965.675693] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 182d01fc-7e61-4437-b380-e0d264b41c12 in Status: SUCCESS [ 965.675957] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-182d01fc-7e61-4437-b380-e0d264b41c12" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.513318] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e2390617-a1da-45a2-94eb-d162a19e2fae in Status: SUCCESS [ 966.513635] env[69980]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e2390617-a1da-45a2-94eb-d162a19e2fae deletion is rescheduled due to dependency. [ 966.513635] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e2390617-a1da-45a2-94eb-d162a19e2fae" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.514503] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cdebe06d-8b9c-47c7-bf4d-f0246381eb14 in Status: SUCCESS [ 966.515207] env[69980]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cdebe06d-8b9c-47c7-bf4d-f0246381eb14 deletion is rescheduled due to dependency. [ 966.515207] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cdebe06d-8b9c-47c7-bf4d-f0246381eb14" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.515368] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f9bdd708-8cea-4b45-818f-2a931611c895 in Status: SUCCESS [ 966.515533] env[69980]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f9bdd708-8cea-4b45-818f-2a931611c895 deletion is rescheduled due to dependency. [ 966.515616] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f9bdd708-8cea-4b45-818f-2a931611c895" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.317492] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3b94a139-70f4-4b1b-82e2-803c78f509bf in Status: SUCCESS [ 967.317729] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3b94a139-70f4-4b1b-82e2-803c78f509bf" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.317910] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3b94a139-70f4-4b1b-82e2-803c78f509bf" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.318155] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3b94a139-70f4-4b1b-82e2-803c78f509bf" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.318378] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.318501] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.318557] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.318729] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.318826] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.318891] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3b94a139-70f4-4b1b-82e2-803c78f509bf" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.318985] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('3b94a139-70f4-4b1b-82e2-803c78f509bf',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 967.821371] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('3b94a139-70f4-4b1b-82e2-803c78f509bf',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 968.324411] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 3b94a139-70f4-4b1b-82e2-803c78f509bf: rpc.has_security_group_logging(os_id): False [ 968.341893] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.342059] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.342131] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.342355] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.342435] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.342678] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.342798] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.342848] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.342979] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.343068] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.343154] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3b94a139-70f4-4b1b-82e2-803c78f509bf is going to be created. [ 968.398107] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.398249] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.398325] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.398536] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.398721] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.409500] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3b94a139-70f4-4b1b-82e2-803c78f509bf in Status: IN_PROGRESS for 2s [ 968.936344] env[69980]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 968.936619] env[69980]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 970.433883] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3b94a139-70f4-4b1b-82e2-803c78f509bf in Status: SUCCESS [ 970.434166] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3b94a139-70f4-4b1b-82e2-803c78f509bf" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.598837] env[69980]: INFO networking_nsxv3.common.synchronization [req-ae640ddb-4d59-4918-967d-957a06a4b808 req-d0d907ec-0aa9-4e15-80f4-3d81920c691b tempest-ServerDiagnosticsNegativeTest-1661671035 tempest-ServerDiagnosticsNegativeTest-1661671035-project-member] Enqueued Resource ID: 182d01fc-7e61-4437-b380-e0d264b41c12 with Priority: HIGHEST for action security_group_members [ 970.599542] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 182d01fc-7e61-4437-b380-e0d264b41c12 with Priority: HIGHEST for action security_group_members [ 970.599855] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-182d01fc-7e61-4437-b380-e0d264b41c12 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.599980] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-182d01fc-7e61-4437-b380-e0d264b41c12" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.600438] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-182d01fc-7e61-4437-b380-e0d264b41c12" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.600662] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-182d01fc-7e61-4437-b380-e0d264b41c12" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.600826] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.600928] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.600986] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.601153] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.601237] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.601581] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('182d01fc-7e61-4437-b380-e0d264b41c12',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 971.103223] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.104751] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.104751] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.104751] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.104751] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.104751] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.104751] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.104751] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.104751] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.104751] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.104751] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 182d01fc-7e61-4437-b380-e0d264b41c12 is going to be updated. [ 971.114469] env[69980]: INFO networking_nsxv3.common.synchronization [req-a4edaa7e-40c0-4fdd-8a92-ea091ca961f1 req-8233328b-0df1-417e-8e4d-224d06982188 tempest-ImagesOneServerNegativeTestJSON-332667785 tempest-ImagesOneServerNegativeTestJSON-332667785-project-member] Enqueued Resource ID: d53aff15-d6ed-495c-9f29-fdc03bd13622 with Priority: HIGHEST for action security_group_members [ 971.114469] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d53aff15-d6ed-495c-9f29-fdc03bd13622 with Priority: HIGHEST for action security_group_members [ 971.115660] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-d53aff15-d6ed-495c-9f29-fdc03bd13622 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.115660] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d53aff15-d6ed-495c-9f29-fdc03bd13622" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.115660] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d53aff15-d6ed-495c-9f29-fdc03bd13622" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.115660] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d53aff15-d6ed-495c-9f29-fdc03bd13622" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.115660] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.115660] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.115660] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.115660] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.115660] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.116055] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d53aff15-d6ed-495c-9f29-fdc03bd13622',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 971.157954] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.158113] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.158149] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.158358] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.158485] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.169461] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 182d01fc-7e61-4437-b380-e0d264b41c12 in Status: IN_PROGRESS for 2s [ 971.371643] env[69980]: INFO networking_nsxv3.common.synchronization [req-69ffde51-5385-4a25-bcc5-4924badabe2f req-02ed3543-b187-455c-b56d-4da6ad5afa2e tempest-ServerTagsTestJSON-1193910749 tempest-ServerTagsTestJSON-1193910749-project-member] Enqueued Resource ID: c6ee756d-3ef5-4a20-82b2-95a3ddd8edd4 with Priority: HIGHEST for action security_group_members [ 971.372214] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c6ee756d-3ef5-4a20-82b2-95a3ddd8edd4 with Priority: HIGHEST for action security_group_members [ 971.372538] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-c6ee756d-3ef5-4a20-82b2-95a3ddd8edd4 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.372674] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c6ee756d-3ef5-4a20-82b2-95a3ddd8edd4" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.372731] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c6ee756d-3ef5-4a20-82b2-95a3ddd8edd4" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.372963] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c6ee756d-3ef5-4a20-82b2-95a3ddd8edd4" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.373131] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.373249] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.373308] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.373460] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.373552] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.373674] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c6ee756d-3ef5-4a20-82b2-95a3ddd8edd4',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 971.620760] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.621065] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.621065] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.623025] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.623025] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.623025] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.623025] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.623025] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.623025] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.623025] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.623025] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d53aff15-d6ed-495c-9f29-fdc03bd13622 is going to be updated. [ 971.650688] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.653013] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.653013] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.653013] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.653013] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.674222] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d53aff15-d6ed-495c-9f29-fdc03bd13622 in Status: IN_PROGRESS for 2s [ 971.733328] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock network-686 taken with stack trace [, , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.733535] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "network-686" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.733666] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "network-686" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.733996] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "network-686" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.734304] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.734523] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.734658] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.734880] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.735048] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.735316] env[69980]: DEBUG dogpile.cache.region [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] No value present for key: 'zone-id' {{(pid=69980) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 971.735565] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] NeedRegenerationException {{(pid=69980) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 971.735734] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] no value, waiting for create lock {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 971.735866] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] value creation lock acquired {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 971.735999] env[69980]: DEBUG dogpile.cache.region [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] No value present for key: 'zone-id' {{(pid=69980) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 971.736120] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Calling creation function for not-yet-present value {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 971.736255] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 971.757509] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 971.757698] env[69980]: DEBUG dogpile.cache.region [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=69980) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 971.757842] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Released creation lock {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 971.758044] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "network-686" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.758374] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock port-4999f54e-8781-4f65-ab9d-c4c63829fa6d taken with stack trace [, , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.758567] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "port-4999f54e-8781-4f65-ab9d-c4c63829fa6d" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.758695] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "port-4999f54e-8781-4f65-ab9d-c4c63829fa6d" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.759037] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "port-4999f54e-8781-4f65-ab9d-c4c63829fa6d" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.759184] env[69980]: DEBUG networking_nsxv3.api.rpc [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4999f54e-8781-4f65-ab9d-c4c63829fa6d',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 971.876011] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.876242] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.876316] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.876587] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.876721] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.876939] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.877052] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.877119] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.877295] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.877385] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.877462] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c6ee756d-3ef5-4a20-82b2-95a3ddd8edd4 already deleted. [ 971.877810] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c6ee756d-3ef5-4a20-82b2-95a3ddd8edd4" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.261679] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.262368] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.262368] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.262539] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.262539] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.262692] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Segment Port 4999f54e-8781-4f65-ab9d-c4c63829fa6d not found, creating... [ 972.262952] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.263131] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.263261] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.263487] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.263633] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.263921] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.264098] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.264222] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.264949] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.265093] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.265255] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Resource: SegmentPort with ID: 4999f54e-8781-4f65-ab9d-c4c63829fa6d is going to be created. [ 972.283898] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.284103] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.284232] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.284487] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.284721] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.284946] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "port-4999f54e-8781-4f65-ab9d-c4c63829fa6d" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.066592] env[69980]: INFO networking_nsxv3.common.synchronization [req-69ffde51-5385-4a25-bcc5-4924badabe2f req-1ef0d15f-2ed2-44d2-b60a-3d1e0e4933ed service nova] Enqueued Resource ID: c6ee756d-3ef5-4a20-82b2-95a3ddd8edd4 with Priority: HIGHEST for action security_group_rules [ 973.066938] env[69980]: INFO networking_nsxv3.common.synchronization [req-69ffde51-5385-4a25-bcc5-4924badabe2f req-1ef0d15f-2ed2-44d2-b60a-3d1e0e4933ed service nova] Enqueued Resource ID: c6ee756d-3ef5-4a20-82b2-95a3ddd8edd4 with Priority: HIGHEST for action security_group_members [ 973.066938] env[69980]: INFO networking_nsxv3.common.synchronization [req-69ffde51-5385-4a25-bcc5-4924badabe2f req-1ef0d15f-2ed2-44d2-b60a-3d1e0e4933ed service nova] Enqueued Resource ID: 4999f54e-8781-4f65-ab9d-c4c63829fa6d with Priority: HIGHEST for action port [ 973.068117] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c6ee756d-3ef5-4a20-82b2-95a3ddd8edd4 with Priority: HIGHEST for action security_group_rules [ 973.068270] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c6ee756d-3ef5-4a20-82b2-95a3ddd8edd4 with Priority: HIGHEST for action security_group_members [ 973.068367] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4999f54e-8781-4f65-ab9d-c4c63829fa6d with Priority: HIGHEST for action port [ 973.068923] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c6ee756d-3ef5-4a20-82b2-95a3ddd8edd4 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.069159] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c6ee756d-3ef5-4a20-82b2-95a3ddd8edd4" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.069159] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c6ee756d-3ef5-4a20-82b2-95a3ddd8edd4" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.069430] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c6ee756d-3ef5-4a20-82b2-95a3ddd8edd4" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.069506] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c6ee756d-3ef5-4a20-82b2-95a3ddd8edd4',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 973.073404] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-c6ee756d-3ef5-4a20-82b2-95a3ddd8edd4 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.073404] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c6ee756d-3ef5-4a20-82b2-95a3ddd8edd4" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.073404] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c6ee756d-3ef5-4a20-82b2-95a3ddd8edd4" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.073404] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c6ee756d-3ef5-4a20-82b2-95a3ddd8edd4" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.073404] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.073814] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.073814] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.073814] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.073814] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.073976] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c6ee756d-3ef5-4a20-82b2-95a3ddd8edd4',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 973.074702] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock port-4999f54e-8781-4f65-ab9d-c4c63829fa6d taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.074820] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4999f54e-8781-4f65-ab9d-c4c63829fa6d" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.074880] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4999f54e-8781-4f65-ab9d-c4c63829fa6d" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.075044] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4999f54e-8781-4f65-ab9d-c4c63829fa6d" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.075137] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4999f54e-8781-4f65-ab9d-c4c63829fa6d',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 973.178610] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 182d01fc-7e61-4437-b380-e0d264b41c12 in Status: SUCCESS [ 973.178826] env[69980]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 182d01fc-7e61-4437-b380-e0d264b41c12 deletion is rescheduled due to dependency. [ 973.178965] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-182d01fc-7e61-4437-b380-e0d264b41c12" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.577891] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-c6ee756d-3ef5-4a20-82b2-95a3ddd8edd4 taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.578048] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c6ee756d-3ef5-4a20-82b2-95a3ddd8edd4" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.578238] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 4999f54e-8781-4f65-ab9d-c4c63829fa6d with status ACTIVE [ 973.578407] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.578513] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.578582] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.578793] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.578905] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.579084] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.579157] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.579228] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.579369] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.579448] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.579628] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.579835] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.579835] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.580679] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.580810] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.580942] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 4999f54e-8781-4f65-ab9d-c4c63829fa6d is going to be updated. [ 973.582508] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c6ee756d-3ef5-4a20-82b2-95a3ddd8edd4',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 973.604606] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.604606] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.604606] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.604733] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.604861] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.605019] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4999f54e-8781-4f65-ab9d-c4c63829fa6d" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.684082] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d53aff15-d6ed-495c-9f29-fdc03bd13622 in Status: SUCCESS [ 973.684526] env[69980]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d53aff15-d6ed-495c-9f29-fdc03bd13622 deletion is rescheduled due to dependency. [ 973.684526] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d53aff15-d6ed-495c-9f29-fdc03bd13622" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.859473] env[69980]: INFO networking_nsxv3.common.synchronization [req-d7d6552f-b96c-4a14-a5d2-4a0fc4da6e96 req-bc80ee96-4fad-494c-92e3-02522a524100 tempest-ServerActionsTestJSON-1479580870 tempest-ServerActionsTestJSON-1479580870-project-member] Enqueued Resource ID: 00f20236-2b69-46dc-a00f-0c4d6b93c17a with Priority: HIGHEST for action security_group_members [ 973.860013] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 00f20236-2b69-46dc-a00f-0c4d6b93c17a with Priority: HIGHEST for action security_group_members [ 973.860323] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-00f20236-2b69-46dc-a00f-0c4d6b93c17a taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.860448] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-00f20236-2b69-46dc-a00f-0c4d6b93c17a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.860514] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-00f20236-2b69-46dc-a00f-0c4d6b93c17a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.860768] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-00f20236-2b69-46dc-a00f-0c4d6b93c17a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.861371] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.861525] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.861595] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.861762] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.861852] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.861950] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('00f20236-2b69-46dc-a00f-0c4d6b93c17a',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 974.085988] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c6ee756d-3ef5-4a20-82b2-95a3ddd8edd4',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 974.172377] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock network-637 taken with stack trace [, , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.172630] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "network-637" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.172788] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "network-637" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.173134] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "network-637" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.173430] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.173862] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.173862] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.173962] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.174239] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.174532] env[69980]: DEBUG dogpile.cache.region [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] No value present for key: 'zone-id' {{(pid=69980) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 974.174688] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] NeedRegenerationException {{(pid=69980) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 974.174804] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] no value, waiting for create lock {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 974.174924] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] value creation lock acquired {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 974.175067] env[69980]: DEBUG dogpile.cache.region [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] No value present for key: 'zone-id' {{(pid=69980) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 974.175422] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Calling creation function for not-yet-present value {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 974.175422] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 974.196098] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 974.196285] env[69980]: DEBUG dogpile.cache.region [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=69980) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 974.196447] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Released creation lock {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 974.196671] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "network-637" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.197644] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock port-6bf5ec66-5a9b-438c-a316-fcc918f7f1de taken with stack trace [, , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.197839] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "port-6bf5ec66-5a9b-438c-a316-fcc918f7f1de" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.198047] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "port-6bf5ec66-5a9b-438c-a316-fcc918f7f1de" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.198397] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "port-6bf5ec66-5a9b-438c-a316-fcc918f7f1de" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.198543] env[69980]: DEBUG networking_nsxv3.api.rpc [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6bf5ec66-5a9b-438c-a316-fcc918f7f1de',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 974.364068] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.364233] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.364306] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.364545] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.364645] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.364843] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.364938] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.365010] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.365160] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.365236] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.365318] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 00f20236-2b69-46dc-a00f-0c4d6b93c17a already deleted. [ 974.365397] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-00f20236-2b69-46dc-a00f-0c4d6b93c17a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.589045] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.590064] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.590064] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.590064] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.590064] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.590064] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c6ee756d-3ef5-4a20-82b2-95a3ddd8edd4 is going to be created. [ 974.612585] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.612723] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.612792] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.612992] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.613161] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.622157] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c6ee756d-3ef5-4a20-82b2-95a3ddd8edd4 in Status: UNINITIALIZED for 2s [ 974.704784] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.705069] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.705235] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.705546] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.705704] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.705863] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Segment Port 6bf5ec66-5a9b-438c-a316-fcc918f7f1de not found, creating... [ 974.706153] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.706313] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.706431] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.706653] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.706869] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.707177] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.708032] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.708032] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.708032] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.708032] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.708032] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Resource: SegmentPort with ID: 6bf5ec66-5a9b-438c-a316-fcc918f7f1de is going to be created. [ 974.733292] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.733578] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.733775] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.734101] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.734391] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.734831] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "port-6bf5ec66-5a9b-438c-a316-fcc918f7f1de" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.521759] env[69980]: INFO networking_nsxv3.common.synchronization [req-d7d6552f-b96c-4a14-a5d2-4a0fc4da6e96 req-0718899c-4518-43ef-9ff0-fdd639503bbe service nova] Enqueued Resource ID: 00f20236-2b69-46dc-a00f-0c4d6b93c17a with Priority: HIGHEST for action security_group_rules [ 975.521998] env[69980]: INFO networking_nsxv3.common.synchronization [req-d7d6552f-b96c-4a14-a5d2-4a0fc4da6e96 req-0718899c-4518-43ef-9ff0-fdd639503bbe service nova] Enqueued Resource ID: 00f20236-2b69-46dc-a00f-0c4d6b93c17a with Priority: HIGHEST for action security_group_members [ 975.522075] env[69980]: INFO networking_nsxv3.common.synchronization [req-d7d6552f-b96c-4a14-a5d2-4a0fc4da6e96 req-0718899c-4518-43ef-9ff0-fdd639503bbe service nova] Enqueued Resource ID: 6bf5ec66-5a9b-438c-a316-fcc918f7f1de with Priority: HIGHEST for action port [ 975.522706] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 00f20236-2b69-46dc-a00f-0c4d6b93c17a with Priority: HIGHEST for action security_group_rules [ 975.522822] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 00f20236-2b69-46dc-a00f-0c4d6b93c17a with Priority: HIGHEST for action security_group_members [ 975.522919] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6bf5ec66-5a9b-438c-a316-fcc918f7f1de with Priority: HIGHEST for action port [ 975.525979] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock rules-00f20236-2b69-46dc-a00f-0c4d6b93c17a taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.525979] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-00f20236-2b69-46dc-a00f-0c4d6b93c17a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.525979] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-00f20236-2b69-46dc-a00f-0c4d6b93c17a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.526441] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-00f20236-2b69-46dc-a00f-0c4d6b93c17a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.526441] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('00f20236-2b69-46dc-a00f-0c4d6b93c17a',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 975.529019] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-00f20236-2b69-46dc-a00f-0c4d6b93c17a taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.529019] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-00f20236-2b69-46dc-a00f-0c4d6b93c17a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.529019] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-00f20236-2b69-46dc-a00f-0c4d6b93c17a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.529019] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-00f20236-2b69-46dc-a00f-0c4d6b93c17a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.529019] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.529019] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.529019] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.529019] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.529019] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.529019] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('00f20236-2b69-46dc-a00f-0c4d6b93c17a',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 975.529620] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock port-6bf5ec66-5a9b-438c-a316-fcc918f7f1de taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.529667] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6bf5ec66-5a9b-438c-a316-fcc918f7f1de" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.529711] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6bf5ec66-5a9b-438c-a316-fcc918f7f1de" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.529882] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6bf5ec66-5a9b-438c-a316-fcc918f7f1de" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.530037] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6bf5ec66-5a9b-438c-a316-fcc918f7f1de',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 976.029264] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-00f20236-2b69-46dc-a00f-0c4d6b93c17a taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.030058] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-00f20236-2b69-46dc-a00f-0c4d6b93c17a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.035503] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('00f20236-2b69-46dc-a00f-0c4d6b93c17a',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 976.035638] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 6bf5ec66-5a9b-438c-a316-fcc918f7f1de with status ACTIVE [ 976.035776] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.035917] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.035995] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.036213] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.036317] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.036492] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.036589] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.036657] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.036816] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.036911] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.037074] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.037167] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.037225] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.037360] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.037572] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.037572] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 6bf5ec66-5a9b-438c-a316-fcc918f7f1de is going to be updated. [ 976.057905] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.057905] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.057905] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.058320] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.058320] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.058414] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6bf5ec66-5a9b-438c-a316-fcc918f7f1de" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.542111] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('00f20236-2b69-46dc-a00f-0c4d6b93c17a',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 976.631980] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c6ee756d-3ef5-4a20-82b2-95a3ddd8edd4 in Status: UNINITIALIZED for 4s [ 977.043938] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.044078] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.044155] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.044371] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.044465] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.044614] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 00f20236-2b69-46dc-a00f-0c4d6b93c17a is going to be created. [ 977.073345] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.073524] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.073564] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.073749] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.073901] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.084377] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 00f20236-2b69-46dc-a00f-0c4d6b93c17a in Status: UNINITIALIZED for 2s [ 978.640572] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c6ee756d-3ef5-4a20-82b2-95a3ddd8edd4 in Status: SUCCESS [ 978.640943] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c6ee756d-3ef5-4a20-82b2-95a3ddd8edd4" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.641142] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c6ee756d-3ef5-4a20-82b2-95a3ddd8edd4" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.641357] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c6ee756d-3ef5-4a20-82b2-95a3ddd8edd4" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.641556] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.642767] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.642767] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.642767] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.642767] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.642767] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c6ee756d-3ef5-4a20-82b2-95a3ddd8edd4" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.642767] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c6ee756d-3ef5-4a20-82b2-95a3ddd8edd4',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 979.098440] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 00f20236-2b69-46dc-a00f-0c4d6b93c17a in Status: SUCCESS [ 979.098521] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-00f20236-2b69-46dc-a00f-0c4d6b93c17a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.098737] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-00f20236-2b69-46dc-a00f-0c4d6b93c17a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.098997] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-00f20236-2b69-46dc-a00f-0c4d6b93c17a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.099239] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.099725] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.099725] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.099725] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.099725] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.099835] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-00f20236-2b69-46dc-a00f-0c4d6b93c17a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.099948] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('00f20236-2b69-46dc-a00f-0c4d6b93c17a',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 979.144745] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-c6ee756d-3ef5-4a20-82b2-95a3ddd8edd4 taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.144921] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c6ee756d-3ef5-4a20-82b2-95a3ddd8edd4" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.144999] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c6ee756d-3ef5-4a20-82b2-95a3ddd8edd4" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.145248] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c6ee756d-3ef5-4a20-82b2-95a3ddd8edd4" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.145423] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.145536] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.145634] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.145763] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.145869] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.145962] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c6ee756d-3ef5-4a20-82b2-95a3ddd8edd4" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.146120] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-c6ee756d-3ef5-4a20-82b2-95a3ddd8edd4 taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.146212] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c6ee756d-3ef5-4a20-82b2-95a3ddd8edd4" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.146269] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c6ee756d-3ef5-4a20-82b2-95a3ddd8edd4" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.146433] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c6ee756d-3ef5-4a20-82b2-95a3ddd8edd4" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.146574] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.146664] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.146720] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.146868] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.146935] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.147025] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c6ee756d-3ef5-4a20-82b2-95a3ddd8edd4" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.147115] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c6ee756d-3ef5-4a20-82b2-95a3ddd8edd4',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 979.562678] env[69980]: INFO networking_nsxv3.common.synchronization [req-6c514281-be3f-49c3-a8fe-68ccf85410a9 req-adf5d713-18b4-4faf-acdc-a378f903cd8f tempest-ServersTestBootFromVolume-1163221882 tempest-ServersTestBootFromVolume-1163221882-project-member] Enqueued Resource ID: f2b778ac-011d-472f-9220-d8d50a881380 with Priority: HIGHEST for action security_group_members [ 979.563298] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f2b778ac-011d-472f-9220-d8d50a881380 with Priority: HIGHEST for action security_group_members [ 979.563637] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-f2b778ac-011d-472f-9220-d8d50a881380 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.563775] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f2b778ac-011d-472f-9220-d8d50a881380" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.563909] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f2b778ac-011d-472f-9220-d8d50a881380" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.564856] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f2b778ac-011d-472f-9220-d8d50a881380" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.565062] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.565189] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.565279] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.565459] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.565552] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.565653] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f2b778ac-011d-472f-9220-d8d50a881380',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 979.603165] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('00f20236-2b69-46dc-a00f-0c4d6b93c17a',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 979.650708] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c6ee756d-3ef5-4a20-82b2-95a3ddd8edd4: rpc.has_security_group_logging(os_id): False [ 979.667946] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.668335] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.668491] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.668839] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.669345] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.669877] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.670111] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.670253] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.670572] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.671180] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.671686] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.672102] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.672248] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.672595] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.672743] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.673018] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.673436] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.673974] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.676118] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.676118] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.676118] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c6ee756d-3ef5-4a20-82b2-95a3ddd8edd4 is going to be created. [ 979.725453] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.726118] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.726118] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.726118] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.726567] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.739430] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c6ee756d-3ef5-4a20-82b2-95a3ddd8edd4 in Status: IN_PROGRESS for 2s [ 980.072666] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.072866] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.072941] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.073224] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.094739] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.095722] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.095907] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.096062] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.096217] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.096305] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.096402] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f2b778ac-011d-472f-9220-d8d50a881380 is going to be updated. [ 980.104490] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 00f20236-2b69-46dc-a00f-0c4d6b93c17a: rpc.has_security_group_logging(os_id): False [ 980.119172] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.119356] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.119419] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.119622] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.119775] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.119974] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.120082] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.120148] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.120315] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.120386] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.120545] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 00f20236-2b69-46dc-a00f-0c4d6b93c17a is going to be created. [ 980.122361] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.122544] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.122686] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.122811] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.122968] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.132517] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f2b778ac-011d-472f-9220-d8d50a881380 in Status: IN_PROGRESS for 2s [ 980.181171] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.181462] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.181462] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.181620] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.181805] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.192295] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 00f20236-2b69-46dc-a00f-0c4d6b93c17a in Status: IN_PROGRESS for 2s [ 981.751051] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c6ee756d-3ef5-4a20-82b2-95a3ddd8edd4 in Status: SUCCESS [ 981.751324] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c6ee756d-3ef5-4a20-82b2-95a3ddd8edd4" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.146545] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f2b778ac-011d-472f-9220-d8d50a881380 in Status: SUCCESS [ 982.146545] env[69980]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f2b778ac-011d-472f-9220-d8d50a881380 deletion is rescheduled due to dependency. [ 982.146545] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f2b778ac-011d-472f-9220-d8d50a881380" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.205195] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 00f20236-2b69-46dc-a00f-0c4d6b93c17a in Status: SUCCESS [ 982.205451] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-00f20236-2b69-46dc-a00f-0c4d6b93c17a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.715430] env[69980]: INFO networking_nsxv3.common.synchronization [req-801c1513-a898-4705-b36d-9f28707da6ba req-15942ec5-db06-46e5-911e-1753e89013df tempest-ServerActionsTestOtherB-1413576659 tempest-ServerActionsTestOtherB-1413576659-project-member] Enqueued Resource ID: 72f0fad5-906a-4ed9-a922-fdb13010a34d with Priority: HIGHEST for action security_group_members [ 982.716320] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 72f0fad5-906a-4ed9-a922-fdb13010a34d with Priority: HIGHEST for action security_group_members [ 982.716804] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-72f0fad5-906a-4ed9-a922-fdb13010a34d taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.717013] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-72f0fad5-906a-4ed9-a922-fdb13010a34d" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.717150] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-72f0fad5-906a-4ed9-a922-fdb13010a34d" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.717517] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-72f0fad5-906a-4ed9-a922-fdb13010a34d" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.717766] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.717948] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.718072] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.718336] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.718489] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.718657] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('72f0fad5-906a-4ed9-a922-fdb13010a34d',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 983.224437] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.224775] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.224897] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.225186] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.225308] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.225587] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.225808] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.225841] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.226048] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.226194] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.226256] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 72f0fad5-906a-4ed9-a922-fdb13010a34d already deleted. [ 983.226354] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-72f0fad5-906a-4ed9-a922-fdb13010a34d" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.322923] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock network-29 taken with stack trace [, , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.323173] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "network-29" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.323326] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "network-29" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.323666] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "network-29" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.323982] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.324179] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.324302] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.324610] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.324754] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.324984] env[69980]: DEBUG dogpile.cache.region [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] No value present for key: 'zone-id' {{(pid=69980) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 983.325132] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] NeedRegenerationException {{(pid=69980) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 983.325248] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] no value, waiting for create lock {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 983.325375] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] value creation lock acquired {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 983.325500] env[69980]: DEBUG dogpile.cache.region [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] No value present for key: 'zone-id' {{(pid=69980) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 983.325659] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Calling creation function for not-yet-present value {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 983.325820] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 983.345275] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 983.345275] env[69980]: DEBUG dogpile.cache.region [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=69980) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 983.345275] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Released creation lock {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 983.345275] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "network-29" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.345275] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock port-6b7841d0-8fda-4b5d-bc1a-1da7f78dd308 taken with stack trace [, , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.345275] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "port-6b7841d0-8fda-4b5d-bc1a-1da7f78dd308" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.345275] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "port-6b7841d0-8fda-4b5d-bc1a-1da7f78dd308" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.345583] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "port-6b7841d0-8fda-4b5d-bc1a-1da7f78dd308" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.346117] env[69980]: DEBUG networking_nsxv3.api.rpc [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6b7841d0-8fda-4b5d-bc1a-1da7f78dd308',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 983.849854] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.850222] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.850463] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.850802] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.850966] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.851144] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Segment Port 6b7841d0-8fda-4b5d-bc1a-1da7f78dd308 not found, creating... [ 983.851457] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.851628] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.851768] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.852047] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.852215] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.852563] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.852777] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.852923] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.853183] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.853368] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.853533] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Resource: SegmentPort with ID: 6b7841d0-8fda-4b5d-bc1a-1da7f78dd308 is going to be created. [ 983.873841] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.874658] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.874658] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.874658] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.874867] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.875121] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "port-6b7841d0-8fda-4b5d-bc1a-1da7f78dd308" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.896862] env[69980]: INFO networking_nsxv3.common.synchronization [req-801c1513-a898-4705-b36d-9f28707da6ba req-fd7e6bcd-1c19-4bfb-adf4-58eb650b3bfa service nova] Enqueued Resource ID: 72f0fad5-906a-4ed9-a922-fdb13010a34d with Priority: HIGHEST for action security_group_rules [ 984.897230] env[69980]: INFO networking_nsxv3.common.synchronization [req-801c1513-a898-4705-b36d-9f28707da6ba req-fd7e6bcd-1c19-4bfb-adf4-58eb650b3bfa service nova] Enqueued Resource ID: 72f0fad5-906a-4ed9-a922-fdb13010a34d with Priority: HIGHEST for action security_group_members [ 984.897369] env[69980]: INFO networking_nsxv3.common.synchronization [req-801c1513-a898-4705-b36d-9f28707da6ba req-fd7e6bcd-1c19-4bfb-adf4-58eb650b3bfa service nova] Enqueued Resource ID: 6b7841d0-8fda-4b5d-bc1a-1da7f78dd308 with Priority: HIGHEST for action port [ 984.899021] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 72f0fad5-906a-4ed9-a922-fdb13010a34d with Priority: HIGHEST for action security_group_rules [ 984.899270] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 72f0fad5-906a-4ed9-a922-fdb13010a34d with Priority: HIGHEST for action security_group_members [ 984.899329] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6b7841d0-8fda-4b5d-bc1a-1da7f78dd308 with Priority: HIGHEST for action port [ 984.899683] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock rules-72f0fad5-906a-4ed9-a922-fdb13010a34d taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.899852] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-72f0fad5-906a-4ed9-a922-fdb13010a34d" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.899940] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-72f0fad5-906a-4ed9-a922-fdb13010a34d" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.900833] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-72f0fad5-906a-4ed9-a922-fdb13010a34d" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.900833] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('72f0fad5-906a-4ed9-a922-fdb13010a34d',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 984.901521] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-72f0fad5-906a-4ed9-a922-fdb13010a34d taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.901665] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-72f0fad5-906a-4ed9-a922-fdb13010a34d" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.901733] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-72f0fad5-906a-4ed9-a922-fdb13010a34d" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.901985] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-72f0fad5-906a-4ed9-a922-fdb13010a34d" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.903623] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.903623] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.903623] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.903623] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.903623] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.904355] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('72f0fad5-906a-4ed9-a922-fdb13010a34d',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 984.910489] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock port-6b7841d0-8fda-4b5d-bc1a-1da7f78dd308 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.910674] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6b7841d0-8fda-4b5d-bc1a-1da7f78dd308" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.910738] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6b7841d0-8fda-4b5d-bc1a-1da7f78dd308" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.910941] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6b7841d0-8fda-4b5d-bc1a-1da7f78dd308" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.911280] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6b7841d0-8fda-4b5d-bc1a-1da7f78dd308',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 985.413462] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-72f0fad5-906a-4ed9-a922-fdb13010a34d taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.413591] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-72f0fad5-906a-4ed9-a922-fdb13010a34d" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.413791] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('72f0fad5-906a-4ed9-a922-fdb13010a34d',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 985.414787] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 6b7841d0-8fda-4b5d-bc1a-1da7f78dd308 with status ACTIVE [ 985.414949] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.415294] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.415294] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.415744] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.415744] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.415744] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.415744] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.415950] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.415950] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.416375] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.416636] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.416851] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.416934] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.417099] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.417179] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.417268] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 6b7841d0-8fda-4b5d-bc1a-1da7f78dd308 is going to be updated. [ 985.442954] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.442954] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.442954] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.443388] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.443388] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.443388] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6b7841d0-8fda-4b5d-bc1a-1da7f78dd308" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.565225] env[69980]: INFO networking_nsxv3.common.synchronization [req-090e68c5-5e87-4ee2-827c-f9781f32dd52 req-9412bb5c-cabe-4d40-a6bd-62073cf4b697 tempest-ServerAddressesNegativeTestJSON-1457243180 tempest-ServerAddressesNegativeTestJSON-1457243180-project-member] Enqueued Resource ID: 2a4996fc-ca8e-4694-8fe3-48cd22295c48 with Priority: HIGHEST for action security_group_members [ 985.565225] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2a4996fc-ca8e-4694-8fe3-48cd22295c48 with Priority: HIGHEST for action security_group_members [ 985.565225] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-2a4996fc-ca8e-4694-8fe3-48cd22295c48 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.565225] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2a4996fc-ca8e-4694-8fe3-48cd22295c48" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.565225] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2a4996fc-ca8e-4694-8fe3-48cd22295c48" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.565225] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2a4996fc-ca8e-4694-8fe3-48cd22295c48" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.566029] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.566982] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.567160] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.567405] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.567578] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.567769] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2a4996fc-ca8e-4694-8fe3-48cd22295c48',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 985.834976] env[69980]: INFO networking_nsxv3.common.synchronization [None req-541b8280-e401-448b-b7d2-ba18b2fd7e01 None None] Enqueued Resource ID: 819731cf-34ec-42c6-9cb6-b79fe6236dbe with Priority: HIGHEST for action port [ 985.834976] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 819731cf-34ec-42c6-9cb6-b79fe6236dbe with Priority: HIGHEST for action port [ 985.834976] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock port-819731cf-34ec-42c6-9cb6-b79fe6236dbe taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.834976] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-819731cf-34ec-42c6-9cb6-b79fe6236dbe" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.834976] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-819731cf-34ec-42c6-9cb6-b79fe6236dbe" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.834976] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-819731cf-34ec-42c6-9cb6-b79fe6236dbe" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.834976] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('819731cf-34ec-42c6-9cb6-b79fe6236dbe',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 985.919389] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('72f0fad5-906a-4ed9-a922-fdb13010a34d',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 986.070222] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.070436] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.070497] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.070683] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.070846] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.070989] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.071163] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.071163] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.071537] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.071646] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.071710] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2a4996fc-ca8e-4694-8fe3-48cd22295c48 already deleted. [ 986.071783] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2a4996fc-ca8e-4694-8fe3-48cd22295c48" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.157023] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock network-573 taken with stack trace [, , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.157231] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "network-573" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.157231] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "network-573" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.157607] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "network-573" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.157839] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.158416] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.159039] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.159213] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.159370] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.159581] env[69980]: DEBUG dogpile.cache.region [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] No value present for key: 'zone-id' {{(pid=69980) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 986.159959] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] NeedRegenerationException {{(pid=69980) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 986.162518] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] no value, waiting for create lock {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 986.162518] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] value creation lock acquired {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 986.162518] env[69980]: DEBUG dogpile.cache.region [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] No value present for key: 'zone-id' {{(pid=69980) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 986.162518] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Calling creation function for not-yet-present value {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 986.162518] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 986.182652] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 986.182829] env[69980]: DEBUG dogpile.cache.region [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=69980) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 986.182976] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Released creation lock {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 986.183170] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "network-573" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.183547] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock port-a1795317-3c89-41f4-ae58-b7a727f86550 taken with stack trace [, , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.183829] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "port-a1795317-3c89-41f4-ae58-b7a727f86550" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.183974] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "port-a1795317-3c89-41f4-ae58-b7a727f86550" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.184816] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "port-a1795317-3c89-41f4-ae58-b7a727f86550" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.184975] env[69980]: DEBUG networking_nsxv3.api.rpc [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a1795317-3c89-41f4-ae58-b7a727f86550',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 986.341709] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 819731cf-34ec-42c6-9cb6-b79fe6236dbe [ 986.341709] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.341709] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.341709] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.341709] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.341709] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.341709] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:819731cf-34ec-42c6-9cb6-b79fe6236dbe already deleted. [ 986.341709] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-819731cf-34ec-42c6-9cb6-b79fe6236dbe" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.430062] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.430062] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.430062] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.430062] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.430062] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.430062] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 72f0fad5-906a-4ed9-a922-fdb13010a34d is going to be created. [ 986.449823] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.450048] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.450097] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.450317] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.450509] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.459866] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 72f0fad5-906a-4ed9-a922-fdb13010a34d in Status: UNINITIALIZED for 2s [ 986.687482] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.688031] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.688031] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.688136] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.688286] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.688448] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Segment Port a1795317-3c89-41f4-ae58-b7a727f86550 not found, creating... [ 986.688748] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.688954] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.689990] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.689990] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.689990] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.689990] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.689990] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.689990] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.690240] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.690529] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.690529] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Resource: SegmentPort with ID: a1795317-3c89-41f4-ae58-b7a727f86550 is going to be created. [ 986.720581] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.720581] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.720581] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.720806] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.720957] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.721202] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "port-a1795317-3c89-41f4-ae58-b7a727f86550" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.109209] env[69980]: INFO networking_nsxv3.common.synchronization [req-cefaff64-7ebd-4466-9572-57bb36747a2c req-146d3047-d6b7-4ad1-9e03-265967399c01 tempest-ServerTagsTestJSON-1193910749 tempest-ServerTagsTestJSON-1193910749-project-member] Enqueued Resource ID: c6ee756d-3ef5-4a20-82b2-95a3ddd8edd4 with Priority: HIGHEST for action security_group_members [ 987.109692] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c6ee756d-3ef5-4a20-82b2-95a3ddd8edd4 with Priority: HIGHEST for action security_group_members [ 987.109755] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-c6ee756d-3ef5-4a20-82b2-95a3ddd8edd4 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.109876] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c6ee756d-3ef5-4a20-82b2-95a3ddd8edd4" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.109946] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c6ee756d-3ef5-4a20-82b2-95a3ddd8edd4" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.113999] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c6ee756d-3ef5-4a20-82b2-95a3ddd8edd4" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.114211] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.114325] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.114388] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.114555] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.114677] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.114777] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c6ee756d-3ef5-4a20-82b2-95a3ddd8edd4',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 987.558453] env[69980]: INFO networking_nsxv3.common.synchronization [None req-21643ea3-d574-4e41-94a1-fb70044631bb tempest-ServerActionsV293TestJSON-116352925 tempest-ServerActionsV293TestJSON-116352925-project-member] Enqueued Resource ID: 194841ae-0965-407f-a2bf-6d1f7693c801 with Priority: HIGHEST for action security_group_rules [ 987.558453] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 194841ae-0965-407f-a2bf-6d1f7693c801 with Priority: HIGHEST for action security_group_rules [ 987.558453] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock rules-194841ae-0965-407f-a2bf-6d1f7693c801 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.558453] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-194841ae-0965-407f-a2bf-6d1f7693c801" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.558453] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-194841ae-0965-407f-a2bf-6d1f7693c801" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.558453] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-194841ae-0965-407f-a2bf-6d1f7693c801" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.558453] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('194841ae-0965-407f-a2bf-6d1f7693c801',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 987.591464] env[69980]: INFO networking_nsxv3.common.synchronization [req-090e68c5-5e87-4ee2-827c-f9781f32dd52 req-15684c32-1c3e-4ac9-bd59-33c269325d27 service nova] Enqueued Resource ID: 2a4996fc-ca8e-4694-8fe3-48cd22295c48 with Priority: HIGHEST for action security_group_rules [ 987.591464] env[69980]: INFO networking_nsxv3.common.synchronization [req-090e68c5-5e87-4ee2-827c-f9781f32dd52 req-15684c32-1c3e-4ac9-bd59-33c269325d27 service nova] Enqueued Resource ID: 2a4996fc-ca8e-4694-8fe3-48cd22295c48 with Priority: HIGHEST for action security_group_members [ 987.591464] env[69980]: INFO networking_nsxv3.common.synchronization [req-090e68c5-5e87-4ee2-827c-f9781f32dd52 req-15684c32-1c3e-4ac9-bd59-33c269325d27 service nova] Enqueued Resource ID: a1795317-3c89-41f4-ae58-b7a727f86550 with Priority: HIGHEST for action port [ 987.591619] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2a4996fc-ca8e-4694-8fe3-48cd22295c48 with Priority: HIGHEST for action security_group_rules [ 987.591731] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2a4996fc-ca8e-4694-8fe3-48cd22295c48 with Priority: HIGHEST for action security_group_members [ 987.591823] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a1795317-3c89-41f4-ae58-b7a727f86550 with Priority: HIGHEST for action port [ 987.592263] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2a4996fc-ca8e-4694-8fe3-48cd22295c48 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.593022] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2a4996fc-ca8e-4694-8fe3-48cd22295c48" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.593022] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2a4996fc-ca8e-4694-8fe3-48cd22295c48" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.593022] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2a4996fc-ca8e-4694-8fe3-48cd22295c48" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.593022] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2a4996fc-ca8e-4694-8fe3-48cd22295c48',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 987.595728] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-2a4996fc-ca8e-4694-8fe3-48cd22295c48 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.595896] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2a4996fc-ca8e-4694-8fe3-48cd22295c48" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.596011] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2a4996fc-ca8e-4694-8fe3-48cd22295c48" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.596377] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2a4996fc-ca8e-4694-8fe3-48cd22295c48" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.596510] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.596751] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.596896] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.597929] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.598251] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.598375] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2a4996fc-ca8e-4694-8fe3-48cd22295c48',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 987.599888] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock port-a1795317-3c89-41f4-ae58-b7a727f86550 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.600110] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a1795317-3c89-41f4-ae58-b7a727f86550" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.600180] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a1795317-3c89-41f4-ae58-b7a727f86550" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.600343] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a1795317-3c89-41f4-ae58-b7a727f86550" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.600922] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a1795317-3c89-41f4-ae58-b7a727f86550',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 987.625133] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.625133] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.625133] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.625133] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.625133] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.625133] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.625133] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.625133] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.625133] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.625133] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.625133] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c6ee756d-3ef5-4a20-82b2-95a3ddd8edd4 is going to be updated. [ 987.652902] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.652902] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.652902] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.652902] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.652902] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.658777] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c6ee756d-3ef5-4a20-82b2-95a3ddd8edd4 in Status: IN_PROGRESS for 2s [ 987.673625] env[69980]: INFO networking_nsxv3.common.synchronization [None req-e6b86e9c-b842-4de0-ba92-2a3f228cca67 tempest-ServerActionsV293TestJSON-116352925 tempest-ServerActionsV293TestJSON-116352925-project-member] Enqueued Resource ID: 194841ae-0965-407f-a2bf-6d1f7693c801 with Priority: HIGHEST for action security_group_rules [ 987.673625] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 194841ae-0965-407f-a2bf-6d1f7693c801 with Priority: HIGHEST for action security_group_rules [ 987.673625] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock rules-194841ae-0965-407f-a2bf-6d1f7693c801 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.673625] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-194841ae-0965-407f-a2bf-6d1f7693c801" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.947277] env[69980]: INFO networking_nsxv3.common.synchronization [None req-cb6e71ba-98da-4cf8-b18f-44ff419963a0 None None] Enqueued Resource ID: c0d97457-c650-48de-899e-e07a7ed3cebc with Priority: HIGHEST for action port [ 987.949477] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c0d97457-c650-48de-899e-e07a7ed3cebc with Priority: HIGHEST for action port [ 987.949477] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock port-c0d97457-c650-48de-899e-e07a7ed3cebc taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.949477] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c0d97457-c650-48de-899e-e07a7ed3cebc" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.949477] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c0d97457-c650-48de-899e-e07a7ed3cebc" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.949477] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c0d97457-c650-48de-899e-e07a7ed3cebc" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.949477] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c0d97457-c650-48de-899e-e07a7ed3cebc',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 988.086985] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.087160] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.087218] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.089229] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.089229] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.089229] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 194841ae-0965-407f-a2bf-6d1f7693c801 already deleted. [ 988.089229] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-194841ae-0965-407f-a2bf-6d1f7693c801" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.089229] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-194841ae-0965-407f-a2bf-6d1f7693c801" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.089229] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-194841ae-0965-407f-a2bf-6d1f7693c801" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.089229] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('194841ae-0965-407f-a2bf-6d1f7693c801',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 988.100254] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2a4996fc-ca8e-4694-8fe3-48cd22295c48',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 988.101673] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-2a4996fc-ca8e-4694-8fe3-48cd22295c48 taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.101776] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2a4996fc-ca8e-4694-8fe3-48cd22295c48" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.101949] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a1795317-3c89-41f4-ae58-b7a727f86550 with status ACTIVE [ 988.102125] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.102260] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.102299] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.102476] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.102563] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.102730] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.102825] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.102885] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.103897] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.103897] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.103897] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.104045] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.104045] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.104158] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.104260] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.104357] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a1795317-3c89-41f4-ae58-b7a727f86550 is going to be updated. [ 988.128292] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.128580] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.128580] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.128705] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.128834] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.128992] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a1795317-3c89-41f4-ae58-b7a727f86550" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.455676] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port c0d97457-c650-48de-899e-e07a7ed3cebc [ 988.455676] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.455676] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.455676] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.455914] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.455941] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.456040] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:c0d97457-c650-48de-899e-e07a7ed3cebc already deleted. [ 988.456116] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c0d97457-c650-48de-899e-e07a7ed3cebc" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.471722] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 72f0fad5-906a-4ed9-a922-fdb13010a34d in Status: SUCCESS [ 988.471983] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-72f0fad5-906a-4ed9-a922-fdb13010a34d" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.473327] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-72f0fad5-906a-4ed9-a922-fdb13010a34d" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.473327] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-72f0fad5-906a-4ed9-a922-fdb13010a34d" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.473327] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.473327] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.473327] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.473644] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.473644] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.473644] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-72f0fad5-906a-4ed9-a922-fdb13010a34d" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.473644] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('72f0fad5-906a-4ed9-a922-fdb13010a34d',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 988.606708] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2a4996fc-ca8e-4694-8fe3-48cd22295c48',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 988.613378] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.613378] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.613563] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.617020] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.617020] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.617020] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 194841ae-0965-407f-a2bf-6d1f7693c801 already deleted. [ 988.617020] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-194841ae-0965-407f-a2bf-6d1f7693c801" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.977076] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('72f0fad5-906a-4ed9-a922-fdb13010a34d',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 989.115446] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.115646] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.115713] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.115952] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.116078] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.116189] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2a4996fc-ca8e-4694-8fe3-48cd22295c48 is going to be created. [ 989.139780] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.140258] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.140258] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.140258] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.140534] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.148527] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2a4996fc-ca8e-4694-8fe3-48cd22295c48 in Status: UNINITIALIZED for 2s [ 989.482551] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 72f0fad5-906a-4ed9-a922-fdb13010a34d: rpc.has_security_group_logging(os_id): False [ 989.499075] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.499237] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.499317] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.499644] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.499762] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.500083] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.500215] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.500264] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.500425] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.500520] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.500616] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 72f0fad5-906a-4ed9-a922-fdb13010a34d is going to be created. [ 989.555536] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.555684] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.555799] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.555973] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.556175] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.568787] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 72f0fad5-906a-4ed9-a922-fdb13010a34d in Status: IN_PROGRESS for 2s [ 989.683735] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c6ee756d-3ef5-4a20-82b2-95a3ddd8edd4 in Status: SUCCESS [ 989.683965] env[69980]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c6ee756d-3ef5-4a20-82b2-95a3ddd8edd4 deletion is rescheduled due to dependency. [ 989.684105] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c6ee756d-3ef5-4a20-82b2-95a3ddd8edd4" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.350820] env[69980]: INFO networking_nsxv3.common.synchronization [req-32dbd403-6920-4787-a45e-7ac6bf09dba4 req-13354fcb-c8e7-4481-8abe-077c67e384bd tempest-ServersAdminTestJSON-1581544378 tempest-ServersAdminTestJSON-1581544378-project-member] Enqueued Resource ID: 700dc02a-f3c2-4363-9a0e-d7cdcb13a5b8 with Priority: HIGHEST for action security_group_members [ 990.351352] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 700dc02a-f3c2-4363-9a0e-d7cdcb13a5b8 with Priority: HIGHEST for action security_group_members [ 990.351654] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-700dc02a-f3c2-4363-9a0e-d7cdcb13a5b8 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.351768] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-700dc02a-f3c2-4363-9a0e-d7cdcb13a5b8" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.352019] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-700dc02a-f3c2-4363-9a0e-d7cdcb13a5b8" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.352234] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-700dc02a-f3c2-4363-9a0e-d7cdcb13a5b8" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.352395] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.352987] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.352987] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.352987] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.352987] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.352987] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('700dc02a-f3c2-4363-9a0e-d7cdcb13a5b8',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 990.726126] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock network-504 taken with stack trace [, , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.726521] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "network-504" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.726668] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "network-504" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.726952] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "network-504" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.727221] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.727382] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.727500] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.727720] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.728034] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.728098] env[69980]: DEBUG dogpile.cache.region [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] No value present for key: 'zone-id' {{(pid=69980) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 990.728211] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] NeedRegenerationException {{(pid=69980) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 990.728388] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] no value, waiting for create lock {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 990.728438] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] value creation lock acquired {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 990.728549] env[69980]: DEBUG dogpile.cache.region [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] No value present for key: 'zone-id' {{(pid=69980) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 990.728658] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Calling creation function for not-yet-present value {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 990.728791] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 990.747503] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 990.747733] env[69980]: DEBUG dogpile.cache.region [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=69980) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 990.747897] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Released creation lock {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 990.748078] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "network-504" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.748377] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock port-60c1cfa2-06b2-45c1-bb37-920c62bd162c taken with stack trace [, , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.748541] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "port-60c1cfa2-06b2-45c1-bb37-920c62bd162c" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.748659] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "port-60c1cfa2-06b2-45c1-bb37-920c62bd162c" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.748956] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "port-60c1cfa2-06b2-45c1-bb37-920c62bd162c" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.749107] env[69980]: DEBUG networking_nsxv3.api.rpc [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('60c1cfa2-06b2-45c1-bb37-920c62bd162c',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 990.855246] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('700dc02a-f3c2-4363-9a0e-d7cdcb13a5b8',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 991.158082] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2a4996fc-ca8e-4694-8fe3-48cd22295c48 in Status: SUCCESS [ 991.158082] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2a4996fc-ca8e-4694-8fe3-48cd22295c48" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.158082] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2a4996fc-ca8e-4694-8fe3-48cd22295c48" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.158614] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2a4996fc-ca8e-4694-8fe3-48cd22295c48" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.158614] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.158772] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.158822] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.158978] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.159070] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.159163] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2a4996fc-ca8e-4694-8fe3-48cd22295c48" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.159255] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('2a4996fc-ca8e-4694-8fe3-48cd22295c48',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 991.251677] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.251919] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.252072] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.252368] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.252534] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.252740] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Segment Port 60c1cfa2-06b2-45c1-bb37-920c62bd162c not found, creating... [ 991.253034] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.253201] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.253322] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.253542] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.253686] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.253971] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.254445] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.254679] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.255039] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.255332] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.255631] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Resource: SegmentPort with ID: 60c1cfa2-06b2-45c1-bb37-920c62bd162c is going to be created. [ 991.275390] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.277102] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.277312] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.277649] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.277947] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.278277] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "port-60c1cfa2-06b2-45c1-bb37-920c62bd162c" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.357628] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('700dc02a-f3c2-4363-9a0e-d7cdcb13a5b8',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 991.582281] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 72f0fad5-906a-4ed9-a922-fdb13010a34d in Status: SUCCESS [ 991.582588] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-72f0fad5-906a-4ed9-a922-fdb13010a34d" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.661738] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-2a4996fc-ca8e-4694-8fe3-48cd22295c48 taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.661912] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2a4996fc-ca8e-4694-8fe3-48cd22295c48" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.661982] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2a4996fc-ca8e-4694-8fe3-48cd22295c48" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.662210] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2a4996fc-ca8e-4694-8fe3-48cd22295c48" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.662386] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.662533] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.662603] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.662759] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.662844] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.662929] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2a4996fc-ca8e-4694-8fe3-48cd22295c48" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.663089] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-2a4996fc-ca8e-4694-8fe3-48cd22295c48 taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.663179] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2a4996fc-ca8e-4694-8fe3-48cd22295c48" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.663237] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2a4996fc-ca8e-4694-8fe3-48cd22295c48" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.663381] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2a4996fc-ca8e-4694-8fe3-48cd22295c48" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.663507] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.663592] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.663659] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.663825] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.663903] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.663985] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2a4996fc-ca8e-4694-8fe3-48cd22295c48" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.664083] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('2a4996fc-ca8e-4694-8fe3-48cd22295c48',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 991.863650] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.863839] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.863839] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.864054] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.864146] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.864244] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 700dc02a-f3c2-4363-9a0e-d7cdcb13a5b8 is going to be updated. [ 991.890919] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.891047] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.891710] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.891710] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.891710] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.899854] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 700dc02a-f3c2-4363-9a0e-d7cdcb13a5b8 in Status: IN_PROGRESS for 2s [ 992.095214] env[69980]: INFO networking_nsxv3.common.synchronization [req-32dbd403-6920-4787-a45e-7ac6bf09dba4 req-ab6586b8-567c-4fed-9e14-aba09062aa98 service nova] Enqueued Resource ID: 700dc02a-f3c2-4363-9a0e-d7cdcb13a5b8 with Priority: HIGHEST for action security_group_rules [ 992.095326] env[69980]: INFO networking_nsxv3.common.synchronization [req-32dbd403-6920-4787-a45e-7ac6bf09dba4 req-ab6586b8-567c-4fed-9e14-aba09062aa98 service nova] Enqueued Resource ID: 700dc02a-f3c2-4363-9a0e-d7cdcb13a5b8 with Priority: HIGHEST for action security_group_members [ 992.095396] env[69980]: INFO networking_nsxv3.common.synchronization [req-32dbd403-6920-4787-a45e-7ac6bf09dba4 req-ab6586b8-567c-4fed-9e14-aba09062aa98 service nova] Enqueued Resource ID: 60c1cfa2-06b2-45c1-bb37-920c62bd162c with Priority: HIGHEST for action port [ 992.096438] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 700dc02a-f3c2-4363-9a0e-d7cdcb13a5b8 with Priority: HIGHEST for action security_group_rules [ 992.096438] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 700dc02a-f3c2-4363-9a0e-d7cdcb13a5b8 with Priority: HIGHEST for action security_group_members [ 992.096887] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 60c1cfa2-06b2-45c1-bb37-920c62bd162c with Priority: HIGHEST for action port [ 992.097308] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock rules-700dc02a-f3c2-4363-9a0e-d7cdcb13a5b8 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.097388] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-700dc02a-f3c2-4363-9a0e-d7cdcb13a5b8" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.097425] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-700dc02a-f3c2-4363-9a0e-d7cdcb13a5b8" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.098079] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-700dc02a-f3c2-4363-9a0e-d7cdcb13a5b8" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.098079] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('700dc02a-f3c2-4363-9a0e-d7cdcb13a5b8',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 992.099424] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-700dc02a-f3c2-4363-9a0e-d7cdcb13a5b8 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.099531] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-700dc02a-f3c2-4363-9a0e-d7cdcb13a5b8" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.100294] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock port-60c1cfa2-06b2-45c1-bb37-920c62bd162c taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.100294] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-60c1cfa2-06b2-45c1-bb37-920c62bd162c" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.100294] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-60c1cfa2-06b2-45c1-bb37-920c62bd162c" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.100294] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-60c1cfa2-06b2-45c1-bb37-920c62bd162c" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.100294] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('60c1cfa2-06b2-45c1-bb37-920c62bd162c',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 992.166327] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 2a4996fc-ca8e-4694-8fe3-48cd22295c48: rpc.has_security_group_logging(os_id): False [ 992.187065] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.187065] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.187065] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.187065] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.187065] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.187065] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.187065] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.187065] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.187065] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.187065] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.187065] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.187065] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.187065] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.187065] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.187682] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.187682] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.187682] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.187682] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.187682] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.187682] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.187874] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2a4996fc-ca8e-4694-8fe3-48cd22295c48 is going to be created. [ 992.244057] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.244279] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.244279] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.244486] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.244742] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.258222] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2a4996fc-ca8e-4694-8fe3-48cd22295c48 in Status: IN_PROGRESS for 2s [ 992.602696] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-700dc02a-f3c2-4363-9a0e-d7cdcb13a5b8 taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.602992] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-700dc02a-f3c2-4363-9a0e-d7cdcb13a5b8" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.603158] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 60c1cfa2-06b2-45c1-bb37-920c62bd162c with status ACTIVE [ 992.603441] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.603646] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.603715] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.603934] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.604133] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.604260] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.604375] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.604453] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.604878] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.605027] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.605288] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.605439] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.605534] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.605759] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.605876] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.606045] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 60c1cfa2-06b2-45c1-bb37-920c62bd162c is going to be updated. [ 992.630020] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.630020] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.630020] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.630020] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.630020] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.630020] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-60c1cfa2-06b2-45c1-bb37-920c62bd162c" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.909834] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 700dc02a-f3c2-4363-9a0e-d7cdcb13a5b8 in Status: SUCCESS [ 993.910932] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-700dc02a-f3c2-4363-9a0e-d7cdcb13a5b8" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.911265] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-700dc02a-f3c2-4363-9a0e-d7cdcb13a5b8" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.911581] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-700dc02a-f3c2-4363-9a0e-d7cdcb13a5b8" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.911849] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.912045] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.912117] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.912297] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.912374] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.912470] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('700dc02a-f3c2-4363-9a0e-d7cdcb13a5b8',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 994.270130] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2a4996fc-ca8e-4694-8fe3-48cd22295c48 in Status: SUCCESS [ 994.270337] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2a4996fc-ca8e-4694-8fe3-48cd22295c48" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.415713] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('700dc02a-f3c2-4363-9a0e-d7cdcb13a5b8',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 994.870993] env[69980]: INFO networking_nsxv3.common.synchronization [req-d40ccd24-bf29-4387-93e0-2eebac257cda req-63aab28b-80a1-40f5-9cae-ca2db1f296ad tempest-ServersTestMultiNic-322776819 tempest-ServersTestMultiNic-322776819-project-member] Enqueued Resource ID: 690c96d5-eb4d-48e2-8d5e-d794cdf78fd1 with Priority: HIGHEST for action security_group_members [ 994.871396] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 690c96d5-eb4d-48e2-8d5e-d794cdf78fd1 with Priority: HIGHEST for action security_group_members [ 994.871734] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-690c96d5-eb4d-48e2-8d5e-d794cdf78fd1 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.871897] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-690c96d5-eb4d-48e2-8d5e-d794cdf78fd1" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.871958] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-690c96d5-eb4d-48e2-8d5e-d794cdf78fd1" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.872243] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-690c96d5-eb4d-48e2-8d5e-d794cdf78fd1" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.872387] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.872615] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.872615] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.872867] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.872867] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.872867] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('690c96d5-eb4d-48e2-8d5e-d794cdf78fd1',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 994.917888] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('700dc02a-f3c2-4363-9a0e-d7cdcb13a5b8',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 995.256393] env[69980]: INFO networking_nsxv3.common.synchronization [req-d40ccd24-bf29-4387-93e0-2eebac257cda req-00a76339-fcd4-4f6d-9bc7-c699f72ef9f4 tempest-ServersTestMultiNic-322776819 tempest-ServersTestMultiNic-322776819-project-member] Enqueued Resource ID: 690c96d5-eb4d-48e2-8d5e-d794cdf78fd1 with Priority: HIGHEST for action security_group_members [ 995.257024] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 690c96d5-eb4d-48e2-8d5e-d794cdf78fd1 with Priority: HIGHEST for action security_group_members [ 995.257439] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-690c96d5-eb4d-48e2-8d5e-d794cdf78fd1 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.257549] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-690c96d5-eb4d-48e2-8d5e-d794cdf78fd1" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.374874] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.375072] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.375338] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.375417] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.375623] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.375691] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.375788] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.375844] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.376689] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.376689] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.376689] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 690c96d5-eb4d-48e2-8d5e-d794cdf78fd1 already deleted. [ 995.376689] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-690c96d5-eb4d-48e2-8d5e-d794cdf78fd1" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.376689] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-690c96d5-eb4d-48e2-8d5e-d794cdf78fd1" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.376689] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-690c96d5-eb4d-48e2-8d5e-d794cdf78fd1" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.376689] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.377234] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.377234] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.377234] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.377234] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.377234] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('690c96d5-eb4d-48e2-8d5e-d794cdf78fd1',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 995.422470] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.422470] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.422470] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.422470] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.422470] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.422470] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 700dc02a-f3c2-4363-9a0e-d7cdcb13a5b8 is going to be updated. [ 995.453346] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.453346] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.453346] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.453346] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.453346] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.462742] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 700dc02a-f3c2-4363-9a0e-d7cdcb13a5b8 in Status: IN_PROGRESS for 2s [ 995.576225] env[69980]: INFO networking_nsxv3.common.synchronization [req-d40ccd24-bf29-4387-93e0-2eebac257cda req-02e6a6ea-667c-42a2-a7e2-4b0ed31852e6 tempest-ServersTestMultiNic-322776819 tempest-ServersTestMultiNic-322776819-project-member] Enqueued Resource ID: 690c96d5-eb4d-48e2-8d5e-d794cdf78fd1 with Priority: HIGHEST for action security_group_members [ 995.576225] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 690c96d5-eb4d-48e2-8d5e-d794cdf78fd1 with Priority: HIGHEST for action security_group_members [ 995.576867] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-690c96d5-eb4d-48e2-8d5e-d794cdf78fd1 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.577195] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-690c96d5-eb4d-48e2-8d5e-d794cdf78fd1" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.884306] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.884901] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.885049] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.885285] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.885380] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.885586] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.885701] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.885767] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.885928] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.886020] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.886105] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 690c96d5-eb4d-48e2-8d5e-d794cdf78fd1 already deleted. [ 995.886185] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-690c96d5-eb4d-48e2-8d5e-d794cdf78fd1" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.886348] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-690c96d5-eb4d-48e2-8d5e-d794cdf78fd1" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.886490] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-690c96d5-eb4d-48e2-8d5e-d794cdf78fd1" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.886630] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.886729] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.886782] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.886937] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.886990] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.887090] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('690c96d5-eb4d-48e2-8d5e-d794cdf78fd1',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 995.944881] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock network-883 taken with stack trace [, , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.945206] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "network-883" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.945241] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "network-883" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.945545] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "network-883" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.945848] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.946825] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.947064] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.947370] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.947623] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.947895] env[69980]: DEBUG dogpile.cache.region [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] No value present for key: 'zone-id' {{(pid=69980) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 995.948078] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] NeedRegenerationException {{(pid=69980) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 995.948244] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] no value, waiting for create lock {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 995.948399] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] value creation lock acquired {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 995.948730] env[69980]: DEBUG dogpile.cache.region [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] No value present for key: 'zone-id' {{(pid=69980) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 995.949221] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Calling creation function for not-yet-present value {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 995.949410] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 995.971161] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 995.971711] env[69980]: DEBUG dogpile.cache.region [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=69980) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 995.971923] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Released creation lock {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 995.972167] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "network-883" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.973089] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock port-fb9eaded-af28-4ea7-929b-f39ae5d09a55 taken with stack trace [, , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.973358] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "port-fb9eaded-af28-4ea7-929b-f39ae5d09a55" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.973495] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "port-fb9eaded-af28-4ea7-929b-f39ae5d09a55" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.973806] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "port-fb9eaded-af28-4ea7-929b-f39ae5d09a55" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.973950] env[69980]: DEBUG networking_nsxv3.api.rpc [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fb9eaded-af28-4ea7-929b-f39ae5d09a55',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 996.389638] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.389801] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.389876] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.390135] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.390235] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.390393] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.390482] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.390570] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.390736] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.390813] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.390901] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 690c96d5-eb4d-48e2-8d5e-d794cdf78fd1 already deleted. [ 996.391069] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-690c96d5-eb4d-48e2-8d5e-d794cdf78fd1" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.477524] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.477776] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.477909] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.478549] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.478549] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.478549] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Segment Port fb9eaded-af28-4ea7-929b-f39ae5d09a55 not found, creating... [ 996.478810] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.478969] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.479129] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.479359] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.479500] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.479787] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.479948] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.482018] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.486080] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.486080] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.486080] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Resource: SegmentPort with ID: fb9eaded-af28-4ea7-929b-f39ae5d09a55 is going to be created. [ 996.535269] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.535508] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.535664] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.536008] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.536260] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.536495] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "port-fb9eaded-af28-4ea7-929b-f39ae5d09a55" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.375526] env[69980]: INFO networking_nsxv3.common.synchronization [req-d40ccd24-bf29-4387-93e0-2eebac257cda req-6d48d596-6cde-41ea-96c0-f8b9300c98b6 service nova] Enqueued Resource ID: 690c96d5-eb4d-48e2-8d5e-d794cdf78fd1 with Priority: HIGHEST for action security_group_rules [ 997.376768] env[69980]: INFO networking_nsxv3.common.synchronization [req-d40ccd24-bf29-4387-93e0-2eebac257cda req-6d48d596-6cde-41ea-96c0-f8b9300c98b6 service nova] Enqueued Resource ID: 690c96d5-eb4d-48e2-8d5e-d794cdf78fd1 with Priority: HIGHEST for action security_group_members [ 997.376768] env[69980]: INFO networking_nsxv3.common.synchronization [req-d40ccd24-bf29-4387-93e0-2eebac257cda req-6d48d596-6cde-41ea-96c0-f8b9300c98b6 service nova] Enqueued Resource ID: fb9eaded-af28-4ea7-929b-f39ae5d09a55 with Priority: HIGHEST for action port [ 997.377431] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 690c96d5-eb4d-48e2-8d5e-d794cdf78fd1 with Priority: HIGHEST for action security_group_rules [ 997.377497] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 690c96d5-eb4d-48e2-8d5e-d794cdf78fd1 with Priority: HIGHEST for action security_group_members [ 997.377556] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fb9eaded-af28-4ea7-929b-f39ae5d09a55 with Priority: HIGHEST for action port [ 997.377921] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock rules-690c96d5-eb4d-48e2-8d5e-d794cdf78fd1 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.378039] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-690c96d5-eb4d-48e2-8d5e-d794cdf78fd1" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.378039] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-690c96d5-eb4d-48e2-8d5e-d794cdf78fd1" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.378295] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-690c96d5-eb4d-48e2-8d5e-d794cdf78fd1" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.378402] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('690c96d5-eb4d-48e2-8d5e-d794cdf78fd1',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 997.379645] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-690c96d5-eb4d-48e2-8d5e-d794cdf78fd1 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.379842] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-690c96d5-eb4d-48e2-8d5e-d794cdf78fd1" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.379842] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-690c96d5-eb4d-48e2-8d5e-d794cdf78fd1" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.380040] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-690c96d5-eb4d-48e2-8d5e-d794cdf78fd1" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.380211] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.380307] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.380369] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.380517] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.380611] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.380707] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('690c96d5-eb4d-48e2-8d5e-d794cdf78fd1',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 997.381811] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock port-fb9eaded-af28-4ea7-929b-f39ae5d09a55 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.381921] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fb9eaded-af28-4ea7-929b-f39ae5d09a55" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.381988] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fb9eaded-af28-4ea7-929b-f39ae5d09a55" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.382153] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fb9eaded-af28-4ea7-929b-f39ae5d09a55" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.382228] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fb9eaded-af28-4ea7-929b-f39ae5d09a55',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 997.473417] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 700dc02a-f3c2-4363-9a0e-d7cdcb13a5b8 in Status: SUCCESS [ 997.473633] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-700dc02a-f3c2-4363-9a0e-d7cdcb13a5b8" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.473932] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-700dc02a-f3c2-4363-9a0e-d7cdcb13a5b8" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.474190] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-700dc02a-f3c2-4363-9a0e-d7cdcb13a5b8" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.474464] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.474627] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.475057] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.475461] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.476026] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.476838] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-700dc02a-f3c2-4363-9a0e-d7cdcb13a5b8" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.476838] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('700dc02a-f3c2-4363-9a0e-d7cdcb13a5b8',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 997.636419] env[69980]: INFO networking_nsxv3.common.synchronization [req-8ac14c3a-c4a5-444e-a0b8-a74cc4e6c9c0 req-2e5e2417-cf25-4003-addd-0c603206916a tempest-ServersTestFqdnHostnames-1390135796 tempest-ServersTestFqdnHostnames-1390135796-project-member] Enqueued Resource ID: 98819590-8807-4667-9ed7-ac1964aca5fa with Priority: HIGHEST for action security_group_members [ 997.636994] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 98819590-8807-4667-9ed7-ac1964aca5fa with Priority: HIGHEST for action security_group_members [ 997.637439] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-98819590-8807-4667-9ed7-ac1964aca5fa taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.637571] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-98819590-8807-4667-9ed7-ac1964aca5fa" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.637838] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-98819590-8807-4667-9ed7-ac1964aca5fa" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.637915] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-98819590-8807-4667-9ed7-ac1964aca5fa" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.638029] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.638128] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.638238] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.638334] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.638970] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.638970] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('98819590-8807-4667-9ed7-ac1964aca5fa',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 997.885683] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('690c96d5-eb4d-48e2-8d5e-d794cdf78fd1',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 997.892486] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-690c96d5-eb4d-48e2-8d5e-d794cdf78fd1 taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.892486] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-690c96d5-eb4d-48e2-8d5e-d794cdf78fd1" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.892486] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port fb9eaded-af28-4ea7-929b-f39ae5d09a55 with status ACTIVE [ 997.892486] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.892486] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.892486] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.892486] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.892486] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.892486] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.892486] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.892486] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.893514] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.896382] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.896382] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.896382] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.896382] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.896382] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.896382] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.896382] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: fb9eaded-af28-4ea7-929b-f39ae5d09a55 is going to be updated. [ 997.915261] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.915432] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.915484] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.916232] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.916232] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.916302] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fb9eaded-af28-4ea7-929b-f39ae5d09a55" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.979524] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-700dc02a-f3c2-4363-9a0e-d7cdcb13a5b8 taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.979699] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-700dc02a-f3c2-4363-9a0e-d7cdcb13a5b8" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.979752] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-700dc02a-f3c2-4363-9a0e-d7cdcb13a5b8" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.979994] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-700dc02a-f3c2-4363-9a0e-d7cdcb13a5b8" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.980170] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.980260] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.980305] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.980490] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.980561] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.980605] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-700dc02a-f3c2-4363-9a0e-d7cdcb13a5b8" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.980749] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-700dc02a-f3c2-4363-9a0e-d7cdcb13a5b8 taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.980815] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-700dc02a-f3c2-4363-9a0e-d7cdcb13a5b8" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.980857] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-700dc02a-f3c2-4363-9a0e-d7cdcb13a5b8" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.981008] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-700dc02a-f3c2-4363-9a0e-d7cdcb13a5b8" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.981146] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.981916] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.981916] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.981916] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.981916] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.981916] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-700dc02a-f3c2-4363-9a0e-d7cdcb13a5b8" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.981916] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('700dc02a-f3c2-4363-9a0e-d7cdcb13a5b8',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 998.142015] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.142015] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.142015] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.142015] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.142015] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.142371] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.142417] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.146116] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.146116] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.146116] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.146116] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 98819590-8807-4667-9ed7-ac1964aca5fa already deleted. [ 998.146116] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-98819590-8807-4667-9ed7-ac1964aca5fa" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.200468] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock network-137 taken with stack trace [, , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.200715] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "network-137" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.200885] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "network-137" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.201565] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "network-137" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.201565] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.201760] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.202444] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.202732] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.202897] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.203136] env[69980]: DEBUG dogpile.cache.region [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] No value present for key: 'zone-id' {{(pid=69980) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 998.203276] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] NeedRegenerationException {{(pid=69980) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 998.203361] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] no value, waiting for create lock {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 998.203478] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] value creation lock acquired {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 998.203578] env[69980]: DEBUG dogpile.cache.region [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] No value present for key: 'zone-id' {{(pid=69980) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 998.204092] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Calling creation function for not-yet-present value {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 998.204178] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 998.223661] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 998.223661] env[69980]: DEBUG dogpile.cache.region [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=69980) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 998.223661] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Released creation lock {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 998.223661] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "network-137" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.223661] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock port-1c450804-5f1f-4b16-9517-682e1461a6f4 taken with stack trace [, , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.223661] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "port-1c450804-5f1f-4b16-9517-682e1461a6f4" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.223661] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "port-1c450804-5f1f-4b16-9517-682e1461a6f4" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.224129] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "port-1c450804-5f1f-4b16-9517-682e1461a6f4" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.224129] env[69980]: DEBUG networking_nsxv3.api.rpc [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1c450804-5f1f-4b16-9517-682e1461a6f4',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 998.368654] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock network-88 taken with stack trace [, , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.368930] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "network-88" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.369037] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "network-88" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.372136] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "network-88" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.372136] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.372136] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.372136] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.372136] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.372136] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.372136] env[69980]: DEBUG dogpile.cache.region [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] No value present for key: 'zone-id' {{(pid=69980) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 998.372136] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] NeedRegenerationException {{(pid=69980) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 998.372136] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] no value, waiting for create lock {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 998.372136] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] value creation lock acquired {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 998.372136] env[69980]: DEBUG dogpile.cache.region [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] No value present for key: 'zone-id' {{(pid=69980) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 998.372136] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Calling creation function for not-yet-present value {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 998.372136] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 998.397537] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('690c96d5-eb4d-48e2-8d5e-d794cdf78fd1',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 998.450019] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 998.450019] env[69980]: DEBUG dogpile.cache.region [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Cache value generated in 0.077 seconds for key(s): 'zone-id' {{(pid=69980) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 998.450019] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Released creation lock {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 998.450019] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "network-88" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.450019] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock port-18e6a86e-5424-4cc6-bbd4-fa78d9614a31 taken with stack trace [, , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.450019] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "port-18e6a86e-5424-4cc6-bbd4-fa78d9614a31" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.450019] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "port-18e6a86e-5424-4cc6-bbd4-fa78d9614a31" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.450019] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "port-18e6a86e-5424-4cc6-bbd4-fa78d9614a31" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.450019] env[69980]: DEBUG networking_nsxv3.api.rpc [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('18e6a86e-5424-4cc6-bbd4-fa78d9614a31',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 998.484365] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 700dc02a-f3c2-4363-9a0e-d7cdcb13a5b8: rpc.has_security_group_logging(os_id): False [ 998.501809] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.504402] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.504637] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.505039] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.505193] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.505511] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.505650] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.505759] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.505960] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.506140] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.506381] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.506500] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.506561] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.506740] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.506822] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.507041] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.507155] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.507218] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.507620] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.507620] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.507620] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 700dc02a-f3c2-4363-9a0e-d7cdcb13a5b8 is going to be updated. [ 998.570089] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.570289] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.570361] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.570552] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.570699] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.586564] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 700dc02a-f3c2-4363-9a0e-d7cdcb13a5b8 in Status: IN_PROGRESS for 2s [ 998.731980] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.732547] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.732851] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.733449] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.733715] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.734066] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Segment Port 1c450804-5f1f-4b16-9517-682e1461a6f4 not found, creating... [ 998.734640] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.735229] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.735358] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.735779] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.736084] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.736666] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.736967] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.737340] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.737752] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.738052] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.738347] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Resource: SegmentPort with ID: 1c450804-5f1f-4b16-9517-682e1461a6f4 is going to be created. [ 998.759210] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.759642] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.759900] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.760406] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.760841] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.761279] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "port-1c450804-5f1f-4b16-9517-682e1461a6f4" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.904350] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.904350] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.904350] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.904350] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.904350] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.904350] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 690c96d5-eb4d-48e2-8d5e-d794cdf78fd1 is going to be created. [ 998.929148] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.929148] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.929148] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.929148] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.929148] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.939747] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 690c96d5-eb4d-48e2-8d5e-d794cdf78fd1 in Status: UNINITIALIZED for 2s [ 998.954016] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.954389] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.954611] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.955072] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.955341] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.955616] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Segment Port 18e6a86e-5424-4cc6-bbd4-fa78d9614a31 not found, creating... [ 998.956059] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.956346] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.956562] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.957048] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.957203] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.957702] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.958010] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.958282] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.958572] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.958823] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.959095] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Resource: SegmentPort with ID: 18e6a86e-5424-4cc6-bbd4-fa78d9614a31 is going to be created. [ 998.980115] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.980428] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.980618] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.981013] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.981347] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.981667] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "port-18e6a86e-5424-4cc6-bbd4-fa78d9614a31" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.028510] env[69980]: INFO networking_nsxv3.common.synchronization [req-cad39a8e-bf31-4785-980d-50e2fbb90b2d req-4fd1aa69-864b-499d-9d70-efe827cf2003 tempest-ServerAddressesNegativeTestJSON-1457243180 tempest-ServerAddressesNegativeTestJSON-1457243180-project-member] Enqueued Resource ID: 2a4996fc-ca8e-4694-8fe3-48cd22295c48 with Priority: HIGHEST for action security_group_members [ 999.028510] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2a4996fc-ca8e-4694-8fe3-48cd22295c48 with Priority: HIGHEST for action security_group_members [ 999.028510] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-2a4996fc-ca8e-4694-8fe3-48cd22295c48 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.028510] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2a4996fc-ca8e-4694-8fe3-48cd22295c48" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.028510] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2a4996fc-ca8e-4694-8fe3-48cd22295c48" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.028510] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2a4996fc-ca8e-4694-8fe3-48cd22295c48" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.028510] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.028510] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.028510] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.028510] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.028510] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.028510] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2a4996fc-ca8e-4694-8fe3-48cd22295c48',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 999.479009] env[69980]: INFO networking_nsxv3.common.synchronization [req-8ac14c3a-c4a5-444e-a0b8-a74cc4e6c9c0 req-2272cbce-a410-45aa-b51c-6955f0ffafaa service nova] Enqueued Resource ID: 98819590-8807-4667-9ed7-ac1964aca5fa with Priority: HIGHEST for action security_group_rules [ 999.479408] env[69980]: INFO networking_nsxv3.common.synchronization [req-8ac14c3a-c4a5-444e-a0b8-a74cc4e6c9c0 req-2272cbce-a410-45aa-b51c-6955f0ffafaa service nova] Enqueued Resource ID: 98819590-8807-4667-9ed7-ac1964aca5fa with Priority: HIGHEST for action security_group_members [ 999.479408] env[69980]: INFO networking_nsxv3.common.synchronization [req-8ac14c3a-c4a5-444e-a0b8-a74cc4e6c9c0 req-2272cbce-a410-45aa-b51c-6955f0ffafaa service nova] Enqueued Resource ID: 1c450804-5f1f-4b16-9517-682e1461a6f4 with Priority: HIGHEST for action port [ 999.479934] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 98819590-8807-4667-9ed7-ac1964aca5fa with Priority: HIGHEST for action security_group_rules [ 999.479934] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 98819590-8807-4667-9ed7-ac1964aca5fa with Priority: HIGHEST for action security_group_members [ 999.479934] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1c450804-5f1f-4b16-9517-682e1461a6f4 with Priority: HIGHEST for action port [ 999.480371] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock rules-98819590-8807-4667-9ed7-ac1964aca5fa taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.481009] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-98819590-8807-4667-9ed7-ac1964aca5fa" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.481009] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-98819590-8807-4667-9ed7-ac1964aca5fa" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.481009] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-98819590-8807-4667-9ed7-ac1964aca5fa" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.481009] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('98819590-8807-4667-9ed7-ac1964aca5fa',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 999.482028] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-98819590-8807-4667-9ed7-ac1964aca5fa taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.482158] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-98819590-8807-4667-9ed7-ac1964aca5fa" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.482275] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-98819590-8807-4667-9ed7-ac1964aca5fa" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.482409] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-98819590-8807-4667-9ed7-ac1964aca5fa" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.482559] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.482675] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.482744] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.482876] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.483009] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.483119] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('98819590-8807-4667-9ed7-ac1964aca5fa',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 999.483781] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock port-1c450804-5f1f-4b16-9517-682e1461a6f4 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.483880] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1c450804-5f1f-4b16-9517-682e1461a6f4" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.483946] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1c450804-5f1f-4b16-9517-682e1461a6f4" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.484151] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1c450804-5f1f-4b16-9517-682e1461a6f4" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.484243] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1c450804-5f1f-4b16-9517-682e1461a6f4',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 999.530453] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.530618] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.530718] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.530899] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.530999] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.531222] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.531346] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.531421] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.531531] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.531601] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.531696] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2a4996fc-ca8e-4694-8fe3-48cd22295c48 is going to be updated. [ 999.557864] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.557864] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.557864] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.557864] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.557864] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.565971] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2a4996fc-ca8e-4694-8fe3-48cd22295c48 in Status: IN_PROGRESS for 2s [ 999.715837] env[69980]: INFO networking_nsxv3.common.synchronization [req-d40ccd24-bf29-4387-93e0-2eebac257cda req-8b23214e-acaf-4e79-be02-e9fab9ded02f service nova] Enqueued Resource ID: 690c96d5-eb4d-48e2-8d5e-d794cdf78fd1 with Priority: HIGHEST for action security_group_rules [ 999.716050] env[69980]: INFO networking_nsxv3.common.synchronization [req-d40ccd24-bf29-4387-93e0-2eebac257cda req-8b23214e-acaf-4e79-be02-e9fab9ded02f service nova] Enqueued Resource ID: 690c96d5-eb4d-48e2-8d5e-d794cdf78fd1 with Priority: HIGHEST for action security_group_members [ 999.716193] env[69980]: INFO networking_nsxv3.common.synchronization [req-d40ccd24-bf29-4387-93e0-2eebac257cda req-8b23214e-acaf-4e79-be02-e9fab9ded02f service nova] Enqueued Resource ID: 18e6a86e-5424-4cc6-bbd4-fa78d9614a31 with Priority: HIGHEST for action port [ 999.716836] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 690c96d5-eb4d-48e2-8d5e-d794cdf78fd1 with Priority: HIGHEST for action security_group_rules [ 999.716959] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 690c96d5-eb4d-48e2-8d5e-d794cdf78fd1 with Priority: HIGHEST for action security_group_members [ 999.717290] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 18e6a86e-5424-4cc6-bbd4-fa78d9614a31 with Priority: HIGHEST for action port [ 999.717943] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock rules-690c96d5-eb4d-48e2-8d5e-d794cdf78fd1 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.718070] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-690c96d5-eb4d-48e2-8d5e-d794cdf78fd1" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.718291] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-690c96d5-eb4d-48e2-8d5e-d794cdf78fd1 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.718377] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-690c96d5-eb4d-48e2-8d5e-d794cdf78fd1" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.718548] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock port-18e6a86e-5424-4cc6-bbd4-fa78d9614a31 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.718634] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-18e6a86e-5424-4cc6-bbd4-fa78d9614a31" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.718700] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-18e6a86e-5424-4cc6-bbd4-fa78d9614a31" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.718936] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-18e6a86e-5424-4cc6-bbd4-fa78d9614a31" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.719032] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('18e6a86e-5424-4cc6-bbd4-fa78d9614a31',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 999.985514] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-98819590-8807-4667-9ed7-ac1964aca5fa taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.985672] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-98819590-8807-4667-9ed7-ac1964aca5fa" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.985967] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('98819590-8807-4667-9ed7-ac1964aca5fa',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 999.989711] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 1c450804-5f1f-4b16-9517-682e1461a6f4 with status ACTIVE [ 999.989990] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.990130] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.990187] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.990430] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.990553] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.990756] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.990816] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.990847] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.991405] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.991405] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.991405] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.991405] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.991405] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.991689] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.991689] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.991689] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 1c450804-5f1f-4b16-9517-682e1461a6f4 is going to be updated. [ 1000.011595] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.011768] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.011825] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.012776] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.012776] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.012776] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1c450804-5f1f-4b16-9517-682e1461a6f4" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.221160] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 18e6a86e-5424-4cc6-bbd4-fa78d9614a31 with status ACTIVE [ 1000.221418] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.221557] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.221628] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.221840] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.221931] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.222119] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.222219] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.222280] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.222428] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.222503] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.222691] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.222786] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.222846] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.222981] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.223067] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.223150] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 18e6a86e-5424-4cc6-bbd4-fa78d9614a31 is going to be updated. [ 1000.243608] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.243831] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.243831] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.244563] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.244563] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.244563] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-18e6a86e-5424-4cc6-bbd4-fa78d9614a31" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.488025] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('98819590-8807-4667-9ed7-ac1964aca5fa',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1000.551342] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock network-883 taken with stack trace [, , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.551547] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "network-883" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.552297] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "network-883" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.552297] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "network-883" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.552297] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.552468] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.553533] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.553533] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.553533] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.553533] env[69980]: DEBUG dogpile.cache.region [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] No value present for key: 'zone-id' {{(pid=69980) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1000.553533] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] NeedRegenerationException {{(pid=69980) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1000.553533] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] no value, waiting for create lock {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1000.553759] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] value creation lock acquired {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1000.553759] env[69980]: DEBUG dogpile.cache.region [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] No value present for key: 'zone-id' {{(pid=69980) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1000.553831] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Calling creation function for not-yet-present value {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1000.553963] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1000.576765] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1000.576949] env[69980]: DEBUG dogpile.cache.region [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=69980) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1000.577315] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Released creation lock {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1000.577315] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "network-883" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.578585] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock port-7dfadede-1d4a-4180-8a0c-b8635ba28f07 taken with stack trace [, , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.578585] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "port-7dfadede-1d4a-4180-8a0c-b8635ba28f07" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.578585] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "port-7dfadede-1d4a-4180-8a0c-b8635ba28f07" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.578585] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "port-7dfadede-1d4a-4180-8a0c-b8635ba28f07" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.578585] env[69980]: DEBUG networking_nsxv3.api.rpc [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7dfadede-1d4a-4180-8a0c-b8635ba28f07',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1000.606966] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 700dc02a-f3c2-4363-9a0e-d7cdcb13a5b8 in Status: SUCCESS [ 1000.606966] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-700dc02a-f3c2-4363-9a0e-d7cdcb13a5b8" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.948658] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 690c96d5-eb4d-48e2-8d5e-d794cdf78fd1 in Status: SUCCESS [ 1000.950082] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-690c96d5-eb4d-48e2-8d5e-d794cdf78fd1" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.950082] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-690c96d5-eb4d-48e2-8d5e-d794cdf78fd1" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.950082] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-690c96d5-eb4d-48e2-8d5e-d794cdf78fd1" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.950082] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.950082] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.950082] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.950082] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.950082] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.950082] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-690c96d5-eb4d-48e2-8d5e-d794cdf78fd1" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.950082] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('690c96d5-eb4d-48e2-8d5e-d794cdf78fd1',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1000.951377] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-690c96d5-eb4d-48e2-8d5e-d794cdf78fd1" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.951575] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-690c96d5-eb4d-48e2-8d5e-d794cdf78fd1" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.951784] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.951888] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.951941] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.952087] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.952161] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.952251] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('690c96d5-eb4d-48e2-8d5e-d794cdf78fd1',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1000.995842] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.996052] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.996123] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.996352] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.996352] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.996495] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 98819590-8807-4667-9ed7-ac1964aca5fa is going to be created. [ 1001.028875] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.029045] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.029121] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.029341] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.029469] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.038015] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 98819590-8807-4667-9ed7-ac1964aca5fa in Status: UNINITIALIZED for 2s [ 1001.080640] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.080878] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.081018] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.081309] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.081466] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.081625] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Segment Port 7dfadede-1d4a-4180-8a0c-b8635ba28f07 not found, creating... [ 1001.081923] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.082432] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.082432] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.082432] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.082561] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.082842] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.083000] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.083132] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.083339] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.083482] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.083619] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Resource: SegmentPort with ID: 7dfadede-1d4a-4180-8a0c-b8635ba28f07 is going to be created. [ 1001.105147] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.105147] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.105147] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.105147] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.105147] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.105147] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "port-7dfadede-1d4a-4180-8a0c-b8635ba28f07" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.109313] env[69980]: INFO networking_nsxv3.common.synchronization [req-6bd1913f-ec30-4f17-a76b-7b9c06f70360 req-2e0e2897-06f2-4f05-886a-c5a5673fd72c tempest-ServerGroupTestJSON-148683231 tempest-ServerGroupTestJSON-148683231-project-member] Enqueued Resource ID: c894c3c8-4482-4b2e-a8fb-72eb5f6eb886 with Priority: HIGHEST for action security_group_members [ 1001.109313] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c894c3c8-4482-4b2e-a8fb-72eb5f6eb886 with Priority: HIGHEST for action security_group_members [ 1001.109313] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-c894c3c8-4482-4b2e-a8fb-72eb5f6eb886 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.109313] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c894c3c8-4482-4b2e-a8fb-72eb5f6eb886" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.109313] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c894c3c8-4482-4b2e-a8fb-72eb5f6eb886" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.109313] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c894c3c8-4482-4b2e-a8fb-72eb5f6eb886" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.109313] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.109313] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.109313] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.109313] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.109313] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.109313] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c894c3c8-4482-4b2e-a8fb-72eb5f6eb886',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1001.452295] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-690c96d5-eb4d-48e2-8d5e-d794cdf78fd1 taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.456020] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-690c96d5-eb4d-48e2-8d5e-d794cdf78fd1" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.456020] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('690c96d5-eb4d-48e2-8d5e-d794cdf78fd1',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1001.576355] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2a4996fc-ca8e-4694-8fe3-48cd22295c48 in Status: SUCCESS [ 1001.577198] env[69980]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2a4996fc-ca8e-4694-8fe3-48cd22295c48 deletion is rescheduled due to dependency. [ 1001.577198] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2a4996fc-ca8e-4694-8fe3-48cd22295c48" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.599257] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock network-455 taken with stack trace [, , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.599430] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "network-455" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.600027] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "network-455" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.600243] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "network-455" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.600696] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.600946] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.601374] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.601807] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.601954] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.602477] env[69980]: DEBUG dogpile.cache.region [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] No value present for key: 'zone-id' {{(pid=69980) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1001.602745] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] NeedRegenerationException {{(pid=69980) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1001.602937] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] no value, waiting for create lock {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1001.603164] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] value creation lock acquired {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1001.603302] env[69980]: DEBUG dogpile.cache.region [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] No value present for key: 'zone-id' {{(pid=69980) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1001.603491] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Calling creation function for not-yet-present value {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1001.603722] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1001.610758] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.610947] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.611079] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.611719] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.611902] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.612206] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.612432] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.612539] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.612788] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.613329] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.614155] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c894c3c8-4482-4b2e-a8fb-72eb5f6eb886 already deleted. [ 1001.614332] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c894c3c8-4482-4b2e-a8fb-72eb5f6eb886" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.624587] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1001.624977] env[69980]: DEBUG dogpile.cache.region [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=69980) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1001.625561] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Released creation lock {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1001.625561] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "network-455" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.626179] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock port-01a4025a-e0bf-42aa-8095-6dcd934439b5 taken with stack trace [, , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.626580] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "port-01a4025a-e0bf-42aa-8095-6dcd934439b5" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.626677] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "port-01a4025a-e0bf-42aa-8095-6dcd934439b5" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.627179] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "port-01a4025a-e0bf-42aa-8095-6dcd934439b5" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.627329] env[69980]: DEBUG networking_nsxv3.api.rpc [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('01a4025a-e0bf-42aa-8095-6dcd934439b5',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1001.956259] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('690c96d5-eb4d-48e2-8d5e-d794cdf78fd1',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1001.966965] env[69980]: INFO networking_nsxv3.common.synchronization [req-d40ccd24-bf29-4387-93e0-2eebac257cda req-fa187a96-055c-4d83-8ad1-125845725f4b service nova] Enqueued Resource ID: 690c96d5-eb4d-48e2-8d5e-d794cdf78fd1 with Priority: HIGHEST for action security_group_rules [ 1001.967155] env[69980]: INFO networking_nsxv3.common.synchronization [req-d40ccd24-bf29-4387-93e0-2eebac257cda req-fa187a96-055c-4d83-8ad1-125845725f4b service nova] Enqueued Resource ID: 690c96d5-eb4d-48e2-8d5e-d794cdf78fd1 with Priority: HIGHEST for action security_group_members [ 1001.967296] env[69980]: INFO networking_nsxv3.common.synchronization [req-d40ccd24-bf29-4387-93e0-2eebac257cda req-fa187a96-055c-4d83-8ad1-125845725f4b service nova] Enqueued Resource ID: 7dfadede-1d4a-4180-8a0c-b8635ba28f07 with Priority: HIGHEST for action port [ 1001.967516] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 690c96d5-eb4d-48e2-8d5e-d794cdf78fd1 with Priority: HIGHEST for action security_group_rules [ 1001.967642] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 690c96d5-eb4d-48e2-8d5e-d794cdf78fd1 with Priority: HIGHEST for action security_group_members [ 1001.967759] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7dfadede-1d4a-4180-8a0c-b8635ba28f07 with Priority: HIGHEST for action port [ 1001.968272] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock rules-690c96d5-eb4d-48e2-8d5e-d794cdf78fd1 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.968382] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-690c96d5-eb4d-48e2-8d5e-d794cdf78fd1" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.969436] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-690c96d5-eb4d-48e2-8d5e-d794cdf78fd1 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.969436] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-690c96d5-eb4d-48e2-8d5e-d794cdf78fd1" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.969436] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock port-7dfadede-1d4a-4180-8a0c-b8635ba28f07 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.971143] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7dfadede-1d4a-4180-8a0c-b8635ba28f07" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.971340] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7dfadede-1d4a-4180-8a0c-b8635ba28f07" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.971446] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7dfadede-1d4a-4180-8a0c-b8635ba28f07" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.971531] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7dfadede-1d4a-4180-8a0c-b8635ba28f07',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1002.132444] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.132678] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.132811] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.133136] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.134229] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.134229] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Segment Port 01a4025a-e0bf-42aa-8095-6dcd934439b5 not found, creating... [ 1002.134229] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.134229] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.134229] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.134229] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.134484] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.134586] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.134773] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.134896] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.135192] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.135339] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.135480] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Resource: SegmentPort with ID: 01a4025a-e0bf-42aa-8095-6dcd934439b5 is going to be created. [ 1002.157779] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.158040] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.158176] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.158402] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.158622] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.158920] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "port-01a4025a-e0bf-42aa-8095-6dcd934439b5" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.462865] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.463064] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.463168] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.463390] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.463481] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.465018] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 690c96d5-eb4d-48e2-8d5e-d794cdf78fd1 is going to be updated. [ 1002.475239] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 7dfadede-1d4a-4180-8a0c-b8635ba28f07 with status ACTIVE [ 1002.475239] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.475239] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.475239] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.475495] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.475495] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.475618] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.475710] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.475770] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.475954] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.476044] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.478014] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.478014] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.478014] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.478014] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.478014] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.478014] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 7dfadede-1d4a-4180-8a0c-b8635ba28f07 is going to be updated. [ 1002.501434] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.501682] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.501682] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.502034] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.502091] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.502257] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7dfadede-1d4a-4180-8a0c-b8635ba28f07" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.503179] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.503288] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.503345] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.503545] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.503732] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.517101] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 690c96d5-eb4d-48e2-8d5e-d794cdf78fd1 in Status: IN_PROGRESS for 2s [ 1003.049154] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 98819590-8807-4667-9ed7-ac1964aca5fa in Status: SUCCESS [ 1003.049154] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-98819590-8807-4667-9ed7-ac1964aca5fa" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.049154] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-98819590-8807-4667-9ed7-ac1964aca5fa" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.049154] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-98819590-8807-4667-9ed7-ac1964aca5fa" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.049154] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.049154] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.049154] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.049154] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.049154] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.049154] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-98819590-8807-4667-9ed7-ac1964aca5fa" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.049154] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('98819590-8807-4667-9ed7-ac1964aca5fa',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1003.326614] env[69980]: INFO networking_nsxv3.common.synchronization [req-6bd1913f-ec30-4f17-a76b-7b9c06f70360 req-5e137060-e34a-40f2-a2ba-e127f6d7dcee service nova] Enqueued Resource ID: c894c3c8-4482-4b2e-a8fb-72eb5f6eb886 with Priority: HIGHEST for action security_group_rules [ 1003.326839] env[69980]: INFO networking_nsxv3.common.synchronization [req-6bd1913f-ec30-4f17-a76b-7b9c06f70360 req-5e137060-e34a-40f2-a2ba-e127f6d7dcee service nova] Enqueued Resource ID: c894c3c8-4482-4b2e-a8fb-72eb5f6eb886 with Priority: HIGHEST for action security_group_members [ 1003.326948] env[69980]: INFO networking_nsxv3.common.synchronization [req-6bd1913f-ec30-4f17-a76b-7b9c06f70360 req-5e137060-e34a-40f2-a2ba-e127f6d7dcee service nova] Enqueued Resource ID: 01a4025a-e0bf-42aa-8095-6dcd934439b5 with Priority: HIGHEST for action port [ 1003.327443] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c894c3c8-4482-4b2e-a8fb-72eb5f6eb886 with Priority: HIGHEST for action security_group_rules [ 1003.327576] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c894c3c8-4482-4b2e-a8fb-72eb5f6eb886 with Priority: HIGHEST for action security_group_members [ 1003.327673] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 01a4025a-e0bf-42aa-8095-6dcd934439b5 with Priority: HIGHEST for action port [ 1003.327938] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c894c3c8-4482-4b2e-a8fb-72eb5f6eb886 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.328549] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c894c3c8-4482-4b2e-a8fb-72eb5f6eb886" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.328650] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c894c3c8-4482-4b2e-a8fb-72eb5f6eb886" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.328903] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c894c3c8-4482-4b2e-a8fb-72eb5f6eb886" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.329113] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c894c3c8-4482-4b2e-a8fb-72eb5f6eb886',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1003.329804] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-c894c3c8-4482-4b2e-a8fb-72eb5f6eb886 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.329933] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c894c3c8-4482-4b2e-a8fb-72eb5f6eb886" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.329996] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c894c3c8-4482-4b2e-a8fb-72eb5f6eb886" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.333519] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c894c3c8-4482-4b2e-a8fb-72eb5f6eb886" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.333519] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.333798] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.333873] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.334373] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.334523] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.334601] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c894c3c8-4482-4b2e-a8fb-72eb5f6eb886',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1003.335439] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock port-01a4025a-e0bf-42aa-8095-6dcd934439b5 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.335560] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-01a4025a-e0bf-42aa-8095-6dcd934439b5" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.335774] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-01a4025a-e0bf-42aa-8095-6dcd934439b5" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.335945] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-01a4025a-e0bf-42aa-8095-6dcd934439b5" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.336031] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('01a4025a-e0bf-42aa-8095-6dcd934439b5',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1003.553548] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('98819590-8807-4667-9ed7-ac1964aca5fa',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1003.838229] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c894c3c8-4482-4b2e-a8fb-72eb5f6eb886',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1003.840224] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-c894c3c8-4482-4b2e-a8fb-72eb5f6eb886 taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.840224] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c894c3c8-4482-4b2e-a8fb-72eb5f6eb886" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.840224] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 01a4025a-e0bf-42aa-8095-6dcd934439b5 with status ACTIVE [ 1003.840224] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.840224] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.840756] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.840756] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.840756] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.840756] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.840994] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.840994] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.841159] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.841159] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.841386] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.841386] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.841476] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.842033] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.842033] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.842033] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 01a4025a-e0bf-42aa-8095-6dcd934439b5 is going to be updated. [ 1003.862481] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.862714] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.862795] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.863563] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.863563] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.863563] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-01a4025a-e0bf-42aa-8095-6dcd934439b5" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.058147] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 98819590-8807-4667-9ed7-ac1964aca5fa: rpc.has_security_group_logging(os_id): False [ 1004.074680] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.075830] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.075830] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.075830] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.075830] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.075830] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.076023] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.076150] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.076288] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.076373] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.076472] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 98819590-8807-4667-9ed7-ac1964aca5fa is going to be created. [ 1004.146515] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.146661] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.146749] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.148033] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.148033] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.159442] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 98819590-8807-4667-9ed7-ac1964aca5fa in Status: IN_PROGRESS for 2s [ 1004.346049] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c894c3c8-4482-4b2e-a8fb-72eb5f6eb886',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1004.527139] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 690c96d5-eb4d-48e2-8d5e-d794cdf78fd1 in Status: SUCCESS [ 1004.527437] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-690c96d5-eb4d-48e2-8d5e-d794cdf78fd1" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.527651] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-690c96d5-eb4d-48e2-8d5e-d794cdf78fd1" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.527925] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-690c96d5-eb4d-48e2-8d5e-d794cdf78fd1" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.528193] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.528359] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.528461] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.528683] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.528771] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.528877] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-690c96d5-eb4d-48e2-8d5e-d794cdf78fd1" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.529199] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-690c96d5-eb4d-48e2-8d5e-d794cdf78fd1 taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.529366] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-690c96d5-eb4d-48e2-8d5e-d794cdf78fd1" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.529499] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-690c96d5-eb4d-48e2-8d5e-d794cdf78fd1" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.529750] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-690c96d5-eb4d-48e2-8d5e-d794cdf78fd1" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.529999] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.530194] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.530309] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.530534] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.530671] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.530830] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-690c96d5-eb4d-48e2-8d5e-d794cdf78fd1" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.530974] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('690c96d5-eb4d-48e2-8d5e-d794cdf78fd1',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1004.532040] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-690c96d5-eb4d-48e2-8d5e-d794cdf78fd1" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.532278] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-690c96d5-eb4d-48e2-8d5e-d794cdf78fd1" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.532508] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.532754] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.532892] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.533511] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.533667] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.534180] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('690c96d5-eb4d-48e2-8d5e-d794cdf78fd1',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1004.849329] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.849491] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.849566] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.849778] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.849872] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.849971] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c894c3c8-4482-4b2e-a8fb-72eb5f6eb886 is going to be created. [ 1004.873779] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.873928] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.873987] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.874304] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.874527] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.883302] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c894c3c8-4482-4b2e-a8fb-72eb5f6eb886 in Status: UNINITIALIZED for 2s [ 1005.036270] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 690c96d5-eb4d-48e2-8d5e-d794cdf78fd1: rpc.has_security_group_logging(os_id): False [ 1005.037379] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('690c96d5-eb4d-48e2-8d5e-d794cdf78fd1',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1005.071029] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.071367] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.071367] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.071511] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.071619] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.071842] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.071953] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.072052] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.072178] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.072272] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.072430] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.072539] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.072790] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.072790] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.072790] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.073070] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.073141] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.073197] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.073320] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.073393] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.073476] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 690c96d5-eb4d-48e2-8d5e-d794cdf78fd1 is going to be created. [ 1005.147301] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.147301] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.147301] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.147301] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.147301] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.158960] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 690c96d5-eb4d-48e2-8d5e-d794cdf78fd1 in Status: IN_PROGRESS for 2s [ 1005.541198] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('690c96d5-eb4d-48e2-8d5e-d794cdf78fd1',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1006.043612] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.043776] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.043840] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.044067] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.044182] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.044287] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 690c96d5-eb4d-48e2-8d5e-d794cdf78fd1 is going to be updated. [ 1006.070037] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.070283] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.070283] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.070362] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.070498] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.078996] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 690c96d5-eb4d-48e2-8d5e-d794cdf78fd1 in Status: IN_PROGRESS for 2s [ 1006.171370] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 98819590-8807-4667-9ed7-ac1964aca5fa in Status: SUCCESS [ 1006.171627] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-98819590-8807-4667-9ed7-ac1964aca5fa" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.892920] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c894c3c8-4482-4b2e-a8fb-72eb5f6eb886 in Status: SUCCESS [ 1006.893268] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c894c3c8-4482-4b2e-a8fb-72eb5f6eb886" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.893528] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c894c3c8-4482-4b2e-a8fb-72eb5f6eb886" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.893831] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c894c3c8-4482-4b2e-a8fb-72eb5f6eb886" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.894136] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.894323] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.894441] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.894691] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.894835] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.894979] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c894c3c8-4482-4b2e-a8fb-72eb5f6eb886" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.895242] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c894c3c8-4482-4b2e-a8fb-72eb5f6eb886',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1007.118852] env[69980]: INFO networking_nsxv3.common.synchronization [None req-f9552e9b-1458-4f0b-a463-4ea8e13f85e4 None None] Enqueued Resource ID: 48531947-dba7-4e4e-abb7-4d020ac12973 with Priority: HIGHEST for action port [ 1007.119444] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 48531947-dba7-4e4e-abb7-4d020ac12973 with Priority: HIGHEST for action port [ 1007.120396] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock port-48531947-dba7-4e4e-abb7-4d020ac12973 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.120396] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-48531947-dba7-4e4e-abb7-4d020ac12973" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.120396] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-48531947-dba7-4e4e-abb7-4d020ac12973" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.120631] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-48531947-dba7-4e4e-abb7-4d020ac12973" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.120631] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('48531947-dba7-4e4e-abb7-4d020ac12973',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1007.173245] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 690c96d5-eb4d-48e2-8d5e-d794cdf78fd1 in Status: SUCCESS [ 1007.173245] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-690c96d5-eb4d-48e2-8d5e-d794cdf78fd1" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.173245] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-690c96d5-eb4d-48e2-8d5e-d794cdf78fd1" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.173245] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-690c96d5-eb4d-48e2-8d5e-d794cdf78fd1" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.173245] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('690c96d5-eb4d-48e2-8d5e-d794cdf78fd1',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1007.399036] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-c894c3c8-4482-4b2e-a8fb-72eb5f6eb886 taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.399658] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c894c3c8-4482-4b2e-a8fb-72eb5f6eb886" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.399965] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c894c3c8-4482-4b2e-a8fb-72eb5f6eb886" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.400415] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c894c3c8-4482-4b2e-a8fb-72eb5f6eb886" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.403160] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.403160] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.403160] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.403160] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.403160] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.403160] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c894c3c8-4482-4b2e-a8fb-72eb5f6eb886" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.403160] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-c894c3c8-4482-4b2e-a8fb-72eb5f6eb886 taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.403160] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c894c3c8-4482-4b2e-a8fb-72eb5f6eb886" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.403160] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c894c3c8-4482-4b2e-a8fb-72eb5f6eb886" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.403160] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c894c3c8-4482-4b2e-a8fb-72eb5f6eb886" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.403160] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.403160] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.403160] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.403160] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.403160] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.403160] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c894c3c8-4482-4b2e-a8fb-72eb5f6eb886" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.403906] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c894c3c8-4482-4b2e-a8fb-72eb5f6eb886',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1007.580123] env[69980]: INFO networking_nsxv3.common.synchronization [req-dcbb8a80-2eb0-427e-9a4c-c239dc2b716f req-c3a56ac9-7b04-47d9-bf4b-a1522760ae22 tempest-MultipleCreateTestJSON-827335919 tempest-MultipleCreateTestJSON-827335919-project-member] Enqueued Resource ID: 7bc12ce3-2b1a-439c-8e90-f01bd1033c9a with Priority: HIGHEST for action security_group_members [ 1007.580123] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7bc12ce3-2b1a-439c-8e90-f01bd1033c9a with Priority: HIGHEST for action security_group_members [ 1007.580123] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-7bc12ce3-2b1a-439c-8e90-f01bd1033c9a taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.580123] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7bc12ce3-2b1a-439c-8e90-f01bd1033c9a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.580123] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7bc12ce3-2b1a-439c-8e90-f01bd1033c9a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.580123] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7bc12ce3-2b1a-439c-8e90-f01bd1033c9a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.580123] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.580123] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.580123] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.580123] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.580123] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.583587] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7bc12ce3-2b1a-439c-8e90-f01bd1033c9a',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1007.625271] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 48531947-dba7-4e4e-abb7-4d020ac12973 [ 1007.625271] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.625271] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.625271] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.625271] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.625271] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.625271] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:48531947-dba7-4e4e-abb7-4d020ac12973 already deleted. [ 1007.625271] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-48531947-dba7-4e4e-abb7-4d020ac12973" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.674891] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-690c96d5-eb4d-48e2-8d5e-d794cdf78fd1 taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.674891] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-690c96d5-eb4d-48e2-8d5e-d794cdf78fd1" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.907110] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c894c3c8-4482-4b2e-a8fb-72eb5f6eb886: rpc.has_security_group_logging(os_id): False [ 1007.928838] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.928838] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.928838] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.928838] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.928838] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.928838] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.928838] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.928838] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.929247] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.929247] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.929402] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.929477] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.929561] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.929729] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.929806] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.930874] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.931014] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.931089] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.931325] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.931325] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.931417] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c894c3c8-4482-4b2e-a8fb-72eb5f6eb886 is going to be created. [ 1007.987239] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.987409] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.987479] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.987739] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.987970] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.998202] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c894c3c8-4482-4b2e-a8fb-72eb5f6eb886 in Status: IN_PROGRESS for 2s [ 1008.085733] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.085910] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.088937] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.088937] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.088937] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.088937] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.088937] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.088937] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.088937] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.088937] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.088937] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7bc12ce3-2b1a-439c-8e90-f01bd1033c9a already deleted. [ 1008.088937] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7bc12ce3-2b1a-439c-8e90-f01bd1033c9a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.089631] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 690c96d5-eb4d-48e2-8d5e-d794cdf78fd1 in Status: SUCCESS [ 1008.089631] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-690c96d5-eb4d-48e2-8d5e-d794cdf78fd1" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.089631] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-690c96d5-eb4d-48e2-8d5e-d794cdf78fd1" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.089631] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-690c96d5-eb4d-48e2-8d5e-d794cdf78fd1" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.089789] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.089845] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.089887] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.090024] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.090153] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.090187] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-690c96d5-eb4d-48e2-8d5e-d794cdf78fd1" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.091291] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('690c96d5-eb4d-48e2-8d5e-d794cdf78fd1',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1008.121382] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock network-834 taken with stack trace [, , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.121382] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "network-834" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.121382] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "network-834" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.121382] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "network-834" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.121788] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.121843] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.122057] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.122200] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.122353] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.122562] env[69980]: DEBUG dogpile.cache.region [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] No value present for key: 'zone-id' {{(pid=69980) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1008.122680] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] NeedRegenerationException {{(pid=69980) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1008.123957] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] no value, waiting for create lock {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1008.123957] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] value creation lock acquired {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1008.123957] env[69980]: DEBUG dogpile.cache.region [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] No value present for key: 'zone-id' {{(pid=69980) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1008.123957] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Calling creation function for not-yet-present value {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1008.123957] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1008.142578] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1008.142776] env[69980]: DEBUG dogpile.cache.region [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=69980) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1008.142907] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Released creation lock {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1008.143169] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "network-834" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.143541] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock port-f084cc0c-779d-4cbc-bb8e-9f2148ef4548 taken with stack trace [, , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.143731] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "port-f084cc0c-779d-4cbc-bb8e-9f2148ef4548" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.143850] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "port-f084cc0c-779d-4cbc-bb8e-9f2148ef4548" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.144229] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "port-f084cc0c-779d-4cbc-bb8e-9f2148ef4548" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.144380] env[69980]: DEBUG networking_nsxv3.api.rpc [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f084cc0c-779d-4cbc-bb8e-9f2148ef4548',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1008.596042] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-690c96d5-eb4d-48e2-8d5e-d794cdf78fd1 taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.596042] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-690c96d5-eb4d-48e2-8d5e-d794cdf78fd1" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.596042] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-690c96d5-eb4d-48e2-8d5e-d794cdf78fd1" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.596042] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-690c96d5-eb4d-48e2-8d5e-d794cdf78fd1" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.596042] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.596042] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.596042] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.596042] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.596042] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.596042] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-690c96d5-eb4d-48e2-8d5e-d794cdf78fd1" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.596042] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-690c96d5-eb4d-48e2-8d5e-d794cdf78fd1 taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.596042] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-690c96d5-eb4d-48e2-8d5e-d794cdf78fd1" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.596042] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-690c96d5-eb4d-48e2-8d5e-d794cdf78fd1" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.596042] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-690c96d5-eb4d-48e2-8d5e-d794cdf78fd1" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.597017] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.597017] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.597017] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.597017] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.597017] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.597017] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-690c96d5-eb4d-48e2-8d5e-d794cdf78fd1" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.597017] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('690c96d5-eb4d-48e2-8d5e-d794cdf78fd1',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1008.647963] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.648157] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.648299] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.648583] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.648739] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.648906] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Segment Port f084cc0c-779d-4cbc-bb8e-9f2148ef4548 not found, creating... [ 1008.649281] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.649460] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.649584] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.649853] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.650487] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.650880] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.651073] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.651245] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.651486] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.651634] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.651812] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Resource: SegmentPort with ID: f084cc0c-779d-4cbc-bb8e-9f2148ef4548 is going to be created. [ 1008.673774] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.674034] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.674175] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.674461] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.674714] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.675083] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "port-f084cc0c-779d-4cbc-bb8e-9f2148ef4548" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.101128] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 690c96d5-eb4d-48e2-8d5e-d794cdf78fd1: rpc.has_security_group_logging(os_id): False [ 1009.122027] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.122027] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.122027] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.122027] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.122027] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.122027] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.122027] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.122027] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.122027] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.122027] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.122027] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.122027] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.122027] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.122027] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.122027] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.124955] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.127101] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.127101] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.127101] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.127101] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.127101] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 690c96d5-eb4d-48e2-8d5e-d794cdf78fd1 is going to be updated. [ 1009.193745] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.193825] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.193900] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.194146] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.194302] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.221467] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 690c96d5-eb4d-48e2-8d5e-d794cdf78fd1 in Status: IN_PROGRESS for 2s [ 1009.525919] env[69980]: INFO networking_nsxv3.common.synchronization [req-dcbb8a80-2eb0-427e-9a4c-c239dc2b716f req-2bf21886-f526-42f6-b232-616b65278578 service nova] Enqueued Resource ID: 7bc12ce3-2b1a-439c-8e90-f01bd1033c9a with Priority: HIGHEST for action security_group_rules [ 1009.525919] env[69980]: INFO networking_nsxv3.common.synchronization [req-dcbb8a80-2eb0-427e-9a4c-c239dc2b716f req-2bf21886-f526-42f6-b232-616b65278578 service nova] Enqueued Resource ID: 7bc12ce3-2b1a-439c-8e90-f01bd1033c9a with Priority: HIGHEST for action security_group_members [ 1009.525919] env[69980]: INFO networking_nsxv3.common.synchronization [req-dcbb8a80-2eb0-427e-9a4c-c239dc2b716f req-2bf21886-f526-42f6-b232-616b65278578 service nova] Enqueued Resource ID: f084cc0c-779d-4cbc-bb8e-9f2148ef4548 with Priority: HIGHEST for action port [ 1009.525919] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7bc12ce3-2b1a-439c-8e90-f01bd1033c9a with Priority: HIGHEST for action security_group_rules [ 1009.525919] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7bc12ce3-2b1a-439c-8e90-f01bd1033c9a with Priority: HIGHEST for action security_group_members [ 1009.525919] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f084cc0c-779d-4cbc-bb8e-9f2148ef4548 with Priority: HIGHEST for action port [ 1009.529272] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7bc12ce3-2b1a-439c-8e90-f01bd1033c9a taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.529382] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7bc12ce3-2b1a-439c-8e90-f01bd1033c9a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.529418] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7bc12ce3-2b1a-439c-8e90-f01bd1033c9a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.530550] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7bc12ce3-2b1a-439c-8e90-f01bd1033c9a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.530550] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7bc12ce3-2b1a-439c-8e90-f01bd1033c9a',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1009.530550] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-7bc12ce3-2b1a-439c-8e90-f01bd1033c9a taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.530701] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7bc12ce3-2b1a-439c-8e90-f01bd1033c9a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.530734] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7bc12ce3-2b1a-439c-8e90-f01bd1033c9a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.530897] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7bc12ce3-2b1a-439c-8e90-f01bd1033c9a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.531063] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.531136] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.531189] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.531334] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.531421] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.531486] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7bc12ce3-2b1a-439c-8e90-f01bd1033c9a',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1009.533333] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock port-f084cc0c-779d-4cbc-bb8e-9f2148ef4548 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.533435] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f084cc0c-779d-4cbc-bb8e-9f2148ef4548" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.533502] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f084cc0c-779d-4cbc-bb8e-9f2148ef4548" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.533711] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f084cc0c-779d-4cbc-bb8e-9f2148ef4548" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.533806] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f084cc0c-779d-4cbc-bb8e-9f2148ef4548',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1009.537735] env[69980]: INFO networking_nsxv3.common.synchronization [None req-041c375d-7d27-4d1f-8a04-fec19df6c19e None None] Enqueued Resource ID: bef9a59b-9bb7-40eb-9889-795e2eaf5065 with Priority: HIGHEST for action port [ 1009.537957] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bef9a59b-9bb7-40eb-9889-795e2eaf5065 with Priority: HIGHEST for action port [ 1009.540213] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock port-bef9a59b-9bb7-40eb-9889-795e2eaf5065 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.540213] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-bef9a59b-9bb7-40eb-9889-795e2eaf5065" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.540213] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-bef9a59b-9bb7-40eb-9889-795e2eaf5065" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.540213] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-bef9a59b-9bb7-40eb-9889-795e2eaf5065" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.540213] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bef9a59b-9bb7-40eb-9889-795e2eaf5065',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1010.012844] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c894c3c8-4482-4b2e-a8fb-72eb5f6eb886 in Status: SUCCESS [ 1010.013090] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c894c3c8-4482-4b2e-a8fb-72eb5f6eb886" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.040099] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7bc12ce3-2b1a-439c-8e90-f01bd1033c9a',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1010.040099] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-7bc12ce3-2b1a-439c-8e90-f01bd1033c9a taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.040099] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7bc12ce3-2b1a-439c-8e90-f01bd1033c9a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.040099] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f084cc0c-779d-4cbc-bb8e-9f2148ef4548 with status ACTIVE [ 1010.040099] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.040099] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.040099] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.040099] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.040099] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.040099] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.040099] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.040099] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.041157] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.041157] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.041157] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.041157] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.041157] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.041157] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.041157] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.041157] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f084cc0c-779d-4cbc-bb8e-9f2148ef4548 is going to be updated. [ 1010.043707] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port bef9a59b-9bb7-40eb-9889-795e2eaf5065 [ 1010.043707] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.043707] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.043707] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.043707] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.043906] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.044215] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:bef9a59b-9bb7-40eb-9889-795e2eaf5065 already deleted. [ 1010.044276] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-bef9a59b-9bb7-40eb-9889-795e2eaf5065" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.063380] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.063527] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.063602] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.063822] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.064013] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.064203] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f084cc0c-779d-4cbc-bb8e-9f2148ef4548" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.544386] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7bc12ce3-2b1a-439c-8e90-f01bd1033c9a',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1011.050255] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.050255] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.050255] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.050255] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.050255] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.050255] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7bc12ce3-2b1a-439c-8e90-f01bd1033c9a is going to be created. [ 1011.069644] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.069804] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.069885] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.070114] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.070277] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.078601] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7bc12ce3-2b1a-439c-8e90-f01bd1033c9a in Status: UNINITIALIZED for 2s [ 1011.233959] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 690c96d5-eb4d-48e2-8d5e-d794cdf78fd1 in Status: SUCCESS [ 1011.234307] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-690c96d5-eb4d-48e2-8d5e-d794cdf78fd1" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.234702] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-690c96d5-eb4d-48e2-8d5e-d794cdf78fd1" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.235117] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-690c96d5-eb4d-48e2-8d5e-d794cdf78fd1" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.235267] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('690c96d5-eb4d-48e2-8d5e-d794cdf78fd1',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1011.737876] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-690c96d5-eb4d-48e2-8d5e-d794cdf78fd1 taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.738148] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-690c96d5-eb4d-48e2-8d5e-d794cdf78fd1" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.738148] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-690c96d5-eb4d-48e2-8d5e-d794cdf78fd1" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.738341] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-690c96d5-eb4d-48e2-8d5e-d794cdf78fd1" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.738516] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.738618] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.738677] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.738825] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.738921] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.738998] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-690c96d5-eb4d-48e2-8d5e-d794cdf78fd1" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.739100] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('690c96d5-eb4d-48e2-8d5e-d794cdf78fd1',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1012.241855] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-690c96d5-eb4d-48e2-8d5e-d794cdf78fd1 taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.244377] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-690c96d5-eb4d-48e2-8d5e-d794cdf78fd1" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.244488] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-690c96d5-eb4d-48e2-8d5e-d794cdf78fd1" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.244710] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-690c96d5-eb4d-48e2-8d5e-d794cdf78fd1" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.245049] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.245198] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.245265] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.245429] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.245514] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.245682] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-690c96d5-eb4d-48e2-8d5e-d794cdf78fd1" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.245757] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-690c96d5-eb4d-48e2-8d5e-d794cdf78fd1 taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.245852] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-690c96d5-eb4d-48e2-8d5e-d794cdf78fd1" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.245969] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-690c96d5-eb4d-48e2-8d5e-d794cdf78fd1" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.246165] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-690c96d5-eb4d-48e2-8d5e-d794cdf78fd1" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.246322] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.246448] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.246517] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.246677] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.246761] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.246849] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-690c96d5-eb4d-48e2-8d5e-d794cdf78fd1" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.246940] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('690c96d5-eb4d-48e2-8d5e-d794cdf78fd1',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1012.751198] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 690c96d5-eb4d-48e2-8d5e-d794cdf78fd1: rpc.has_security_group_logging(os_id): False [ 1012.771511] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.771819] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.771894] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.772154] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.772251] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.772461] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.772553] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.772613] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.772807] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.772882] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.773081] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.773197] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.773261] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.773409] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.773485] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.773683] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.773777] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.774158] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.774158] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.774158] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.774287] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 690c96d5-eb4d-48e2-8d5e-d794cdf78fd1 is going to be updated. [ 1012.842048] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.842216] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.842286] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.842498] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.842645] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.856935] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 690c96d5-eb4d-48e2-8d5e-d794cdf78fd1 in Status: IN_PROGRESS for 2s [ 1013.088490] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7bc12ce3-2b1a-439c-8e90-f01bd1033c9a in Status: SUCCESS [ 1013.088696] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7bc12ce3-2b1a-439c-8e90-f01bd1033c9a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.088856] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7bc12ce3-2b1a-439c-8e90-f01bd1033c9a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.089071] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7bc12ce3-2b1a-439c-8e90-f01bd1033c9a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.089255] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.089421] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.089537] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.089764] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.089847] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.089933] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7bc12ce3-2b1a-439c-8e90-f01bd1033c9a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.090037] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7bc12ce3-2b1a-439c-8e90-f01bd1033c9a',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1013.105230] env[69980]: INFO networking_nsxv3.common.synchronization [None req-75fe0319-254e-4751-a89b-405096d4e672 None None] Enqueued Resource ID: 0c2e2414-e387-44a8-ba0a-4d14c2ec18bb with Priority: HIGHEST for action port [ 1013.107037] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0c2e2414-e387-44a8-ba0a-4d14c2ec18bb with Priority: HIGHEST for action port [ 1013.110107] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock port-0c2e2414-e387-44a8-ba0a-4d14c2ec18bb taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.110107] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0c2e2414-e387-44a8-ba0a-4d14c2ec18bb" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.110107] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0c2e2414-e387-44a8-ba0a-4d14c2ec18bb" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.110107] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0c2e2414-e387-44a8-ba0a-4d14c2ec18bb" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.110107] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0c2e2414-e387-44a8-ba0a-4d14c2ec18bb',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1013.593006] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-7bc12ce3-2b1a-439c-8e90-f01bd1033c9a taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.593182] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7bc12ce3-2b1a-439c-8e90-f01bd1033c9a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.593568] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7bc12ce3-2b1a-439c-8e90-f01bd1033c9a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.593568] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7bc12ce3-2b1a-439c-8e90-f01bd1033c9a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.593697] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.593776] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.593850] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.594008] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.594105] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.594193] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7bc12ce3-2b1a-439c-8e90-f01bd1033c9a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.595029] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-7bc12ce3-2b1a-439c-8e90-f01bd1033c9a taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.595029] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7bc12ce3-2b1a-439c-8e90-f01bd1033c9a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.595029] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7bc12ce3-2b1a-439c-8e90-f01bd1033c9a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.595029] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7bc12ce3-2b1a-439c-8e90-f01bd1033c9a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.595029] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.595029] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.595029] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.595298] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.595298] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.595298] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7bc12ce3-2b1a-439c-8e90-f01bd1033c9a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.595380] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7bc12ce3-2b1a-439c-8e90-f01bd1033c9a',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1013.614442] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 0c2e2414-e387-44a8-ba0a-4d14c2ec18bb [ 1013.614665] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.614846] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.614983] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.615142] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.615231] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.615330] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:0c2e2414-e387-44a8-ba0a-4d14c2ec18bb already deleted. [ 1013.615430] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0c2e2414-e387-44a8-ba0a-4d14c2ec18bb" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.098873] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7bc12ce3-2b1a-439c-8e90-f01bd1033c9a: rpc.has_security_group_logging(os_id): False [ 1014.120885] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.120885] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.120885] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.120885] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.120885] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.120885] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.120885] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.120885] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.120885] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.120885] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.120885] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.120885] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.120885] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.120885] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.120885] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.121377] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.121377] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.121377] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.121377] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.121377] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.121377] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7bc12ce3-2b1a-439c-8e90-f01bd1033c9a is going to be created. [ 1014.194373] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.194373] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.194373] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.194373] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.194373] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.216812] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7bc12ce3-2b1a-439c-8e90-f01bd1033c9a in Status: IN_PROGRESS for 2s [ 1014.871503] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 690c96d5-eb4d-48e2-8d5e-d794cdf78fd1 in Status: SUCCESS [ 1014.871739] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-690c96d5-eb4d-48e2-8d5e-d794cdf78fd1" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.953418] env[69980]: INFO networking_nsxv3.common.synchronization [req-dcbb8a80-2eb0-427e-9a4c-c239dc2b716f req-c436f6ce-8928-4fd7-88f6-6179a4c5fb69 tempest-MultipleCreateTestJSON-827335919 tempest-MultipleCreateTestJSON-827335919-project-member] Enqueued Resource ID: 7bc12ce3-2b1a-439c-8e90-f01bd1033c9a with Priority: HIGHEST for action security_group_members [ 1014.953418] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7bc12ce3-2b1a-439c-8e90-f01bd1033c9a with Priority: HIGHEST for action security_group_members [ 1014.953699] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-7bc12ce3-2b1a-439c-8e90-f01bd1033c9a taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.953826] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7bc12ce3-2b1a-439c-8e90-f01bd1033c9a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.953890] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7bc12ce3-2b1a-439c-8e90-f01bd1033c9a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.954200] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7bc12ce3-2b1a-439c-8e90-f01bd1033c9a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.954266] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.954354] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.954412] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.954560] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.954658] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.954727] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7bc12ce3-2b1a-439c-8e90-f01bd1033c9a',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1015.335797] env[69980]: INFO networking_nsxv3.common.synchronization [None req-3f66a717-6619-4bdf-a228-f1fe2e45d9e3 None None] Enqueued Resource ID: d76d5ef0-d62d-40ef-a9be-6c32f1bfc6f9 with Priority: HIGHEST for action port [ 1015.336812] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d76d5ef0-d62d-40ef-a9be-6c32f1bfc6f9 with Priority: HIGHEST for action port [ 1015.336812] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock port-d76d5ef0-d62d-40ef-a9be-6c32f1bfc6f9 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.336812] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d76d5ef0-d62d-40ef-a9be-6c32f1bfc6f9" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.336950] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d76d5ef0-d62d-40ef-a9be-6c32f1bfc6f9" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.337881] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d76d5ef0-d62d-40ef-a9be-6c32f1bfc6f9" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.337881] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d76d5ef0-d62d-40ef-a9be-6c32f1bfc6f9',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1015.456995] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7bc12ce3-2b1a-439c-8e90-f01bd1033c9a',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1015.778121] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock network-834 taken with stack trace [, , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.778342] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "network-834" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.778467] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "network-834" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.778737] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "network-834" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.778997] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.779166] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.779285] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.781824] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.781824] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.781824] env[69980]: DEBUG dogpile.cache.region [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] No value present for key: 'zone-id' {{(pid=69980) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1015.781824] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] NeedRegenerationException {{(pid=69980) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1015.781824] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] no value, waiting for create lock {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1015.781824] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] value creation lock acquired {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1015.781824] env[69980]: DEBUG dogpile.cache.region [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] No value present for key: 'zone-id' {{(pid=69980) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1015.781824] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Calling creation function for not-yet-present value {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1015.781824] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1015.800899] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1015.801154] env[69980]: DEBUG dogpile.cache.region [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=69980) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1015.801352] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Released creation lock {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1015.801577] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "network-834" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.801998] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock port-d8534b49-5f43-4d3a-982d-eb13d79db32a taken with stack trace [, , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.802209] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "port-d8534b49-5f43-4d3a-982d-eb13d79db32a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.802348] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "port-d8534b49-5f43-4d3a-982d-eb13d79db32a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.802659] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "port-d8534b49-5f43-4d3a-982d-eb13d79db32a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.802862] env[69980]: DEBUG networking_nsxv3.api.rpc [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d8534b49-5f43-4d3a-982d-eb13d79db32a',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1015.840015] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port d76d5ef0-d62d-40ef-a9be-6c32f1bfc6f9 [ 1015.840247] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.840381] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.840446] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.840658] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.840749] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.840817] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:d76d5ef0-d62d-40ef-a9be-6c32f1bfc6f9 already deleted. [ 1015.840895] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d76d5ef0-d62d-40ef-a9be-6c32f1bfc6f9" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.935797] env[69980]: INFO networking_nsxv3.common.synchronization [req-56457714-d4f8-4419-bcba-adf20c5cd53f req-cd7db2ce-90fe-4c75-b7bd-89e4ceec1785 tempest-ServersTestMultiNic-322776819 tempest-ServersTestMultiNic-322776819-project-member] Enqueued Resource ID: 690c96d5-eb4d-48e2-8d5e-d794cdf78fd1 with Priority: HIGHEST for action security_group_members [ 1015.935797] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 690c96d5-eb4d-48e2-8d5e-d794cdf78fd1 with Priority: HIGHEST for action security_group_members [ 1015.935797] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-690c96d5-eb4d-48e2-8d5e-d794cdf78fd1 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.935797] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-690c96d5-eb4d-48e2-8d5e-d794cdf78fd1" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.935797] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-690c96d5-eb4d-48e2-8d5e-d794cdf78fd1" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.936182] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-690c96d5-eb4d-48e2-8d5e-d794cdf78fd1" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.936742] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.936875] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.936942] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.937148] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.938345] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.938345] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('690c96d5-eb4d-48e2-8d5e-d794cdf78fd1',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1015.960068] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7bc12ce3-2b1a-439c-8e90-f01bd1033c9a',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1016.199022] env[69980]: INFO networking_nsxv3.common.synchronization [req-56457714-d4f8-4419-bcba-adf20c5cd53f req-f13f3165-6cdc-4287-bed7-a617897d41b2 tempest-ServersTestMultiNic-322776819 tempest-ServersTestMultiNic-322776819-project-member] Enqueued Resource ID: 690c96d5-eb4d-48e2-8d5e-d794cdf78fd1 with Priority: HIGHEST for action security_group_members [ 1016.199022] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 690c96d5-eb4d-48e2-8d5e-d794cdf78fd1 with Priority: HIGHEST for action security_group_members [ 1016.199022] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-690c96d5-eb4d-48e2-8d5e-d794cdf78fd1 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.199022] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-690c96d5-eb4d-48e2-8d5e-d794cdf78fd1" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.236033] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7bc12ce3-2b1a-439c-8e90-f01bd1033c9a in Status: SUCCESS [ 1016.236033] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7bc12ce3-2b1a-439c-8e90-f01bd1033c9a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.306584] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.306823] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.306953] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.307249] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.307399] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.307556] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Segment Port d8534b49-5f43-4d3a-982d-eb13d79db32a not found, creating... [ 1016.308074] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.308168] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.308388] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.308615] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.308758] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.309057] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.309224] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.310729] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.310973] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.311137] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.311288] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Resource: SegmentPort with ID: d8534b49-5f43-4d3a-982d-eb13d79db32a is going to be created. [ 1016.332412] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.332910] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.332910] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.333633] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.333920] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.334207] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "port-d8534b49-5f43-4d3a-982d-eb13d79db32a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.439922] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('690c96d5-eb4d-48e2-8d5e-d794cdf78fd1',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1016.462061] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.462234] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.462296] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.462508] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.462593] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.462737] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7bc12ce3-2b1a-439c-8e90-f01bd1033c9a is going to be updated. [ 1016.471219] env[69980]: INFO networking_nsxv3.common.synchronization [req-56457714-d4f8-4419-bcba-adf20c5cd53f req-762a672a-4345-4a73-8d0f-aaf170b3c821 tempest-ServersTestMultiNic-322776819 tempest-ServersTestMultiNic-322776819-project-member] Enqueued Resource ID: 690c96d5-eb4d-48e2-8d5e-d794cdf78fd1 with Priority: HIGHEST for action security_group_members [ 1016.471898] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 690c96d5-eb4d-48e2-8d5e-d794cdf78fd1 with Priority: HIGHEST for action security_group_members [ 1016.472041] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-690c96d5-eb4d-48e2-8d5e-d794cdf78fd1 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.472159] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-690c96d5-eb4d-48e2-8d5e-d794cdf78fd1" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.497316] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.497316] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.497316] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.497316] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.497316] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.514280] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7bc12ce3-2b1a-439c-8e90-f01bd1033c9a in Status: IN_PROGRESS for 2s [ 1016.942442] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('690c96d5-eb4d-48e2-8d5e-d794cdf78fd1',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1017.444688] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.444978] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.444978] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.445193] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.445393] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.445393] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 690c96d5-eb4d-48e2-8d5e-d794cdf78fd1 is going to be updated. [ 1017.448922] env[69980]: INFO networking_nsxv3.common.synchronization [req-dcbb8a80-2eb0-427e-9a4c-c239dc2b716f req-0c4218b5-fd3c-49fc-9b7e-1f1265060850 service nova] Enqueued Resource ID: 7bc12ce3-2b1a-439c-8e90-f01bd1033c9a with Priority: HIGHEST for action security_group_rules [ 1017.449021] env[69980]: INFO networking_nsxv3.common.synchronization [req-dcbb8a80-2eb0-427e-9a4c-c239dc2b716f req-0c4218b5-fd3c-49fc-9b7e-1f1265060850 service nova] Enqueued Resource ID: 7bc12ce3-2b1a-439c-8e90-f01bd1033c9a with Priority: HIGHEST for action security_group_members [ 1017.449185] env[69980]: INFO networking_nsxv3.common.synchronization [req-dcbb8a80-2eb0-427e-9a4c-c239dc2b716f req-0c4218b5-fd3c-49fc-9b7e-1f1265060850 service nova] Enqueued Resource ID: d8534b49-5f43-4d3a-982d-eb13d79db32a with Priority: HIGHEST for action port [ 1017.449404] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7bc12ce3-2b1a-439c-8e90-f01bd1033c9a with Priority: HIGHEST for action security_group_rules [ 1017.449529] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7bc12ce3-2b1a-439c-8e90-f01bd1033c9a with Priority: HIGHEST for action security_group_members [ 1017.449623] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d8534b49-5f43-4d3a-982d-eb13d79db32a with Priority: HIGHEST for action port [ 1017.450242] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7bc12ce3-2b1a-439c-8e90-f01bd1033c9a taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.450349] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7bc12ce3-2b1a-439c-8e90-f01bd1033c9a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.450349] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7bc12ce3-2b1a-439c-8e90-f01bd1033c9a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.450515] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7bc12ce3-2b1a-439c-8e90-f01bd1033c9a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.450593] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7bc12ce3-2b1a-439c-8e90-f01bd1033c9a',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1017.452127] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-7bc12ce3-2b1a-439c-8e90-f01bd1033c9a taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.452599] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7bc12ce3-2b1a-439c-8e90-f01bd1033c9a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.452742] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock port-d8534b49-5f43-4d3a-982d-eb13d79db32a taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.452910] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d8534b49-5f43-4d3a-982d-eb13d79db32a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.453033] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d8534b49-5f43-4d3a-982d-eb13d79db32a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.453246] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d8534b49-5f43-4d3a-982d-eb13d79db32a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.453347] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d8534b49-5f43-4d3a-982d-eb13d79db32a',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1017.459075] env[69980]: INFO networking_nsxv3.common.synchronization [req-cc5b83fe-78e5-401b-ba32-e06e904796ac req-c9eca7b2-abdf-4494-94b4-f034da87abf0 tempest-ServerGroupTestJSON-148683231 tempest-ServerGroupTestJSON-148683231-project-member] Enqueued Resource ID: c894c3c8-4482-4b2e-a8fb-72eb5f6eb886 with Priority: HIGHEST for action security_group_members [ 1017.459075] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c894c3c8-4482-4b2e-a8fb-72eb5f6eb886 with Priority: HIGHEST for action security_group_members [ 1017.459075] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-c894c3c8-4482-4b2e-a8fb-72eb5f6eb886 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.459075] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c894c3c8-4482-4b2e-a8fb-72eb5f6eb886" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.459075] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c894c3c8-4482-4b2e-a8fb-72eb5f6eb886" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.459075] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c894c3c8-4482-4b2e-a8fb-72eb5f6eb886" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.459075] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.459075] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.459075] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.459447] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.459447] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.459447] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c894c3c8-4482-4b2e-a8fb-72eb5f6eb886',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1017.469668] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.469835] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.469890] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.470204] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.471165] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.479040] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 690c96d5-eb4d-48e2-8d5e-d794cdf78fd1 in Status: IN_PROGRESS for 2s [ 1017.955016] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-7bc12ce3-2b1a-439c-8e90-f01bd1033c9a taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.955189] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7bc12ce3-2b1a-439c-8e90-f01bd1033c9a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.958930] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d8534b49-5f43-4d3a-982d-eb13d79db32a with status ACTIVE [ 1017.959147] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.959254] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.959323] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.959529] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.959619] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.959785] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.959880] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.959945] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.960107] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.960218] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.960360] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.960442] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.960504] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.960638] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.960713] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.960796] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d8534b49-5f43-4d3a-982d-eb13d79db32a is going to be updated. [ 1017.961886] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.961998] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.962121] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.962278] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.962375] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.962543] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.962636] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.962697] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.962885] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.962969] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.963064] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c894c3c8-4482-4b2e-a8fb-72eb5f6eb886 is going to be updated. [ 1017.981816] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.981935] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.982011] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.982192] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.982320] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.982474] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d8534b49-5f43-4d3a-982d-eb13d79db32a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.987166] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.987295] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.987347] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.987512] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.987638] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.994605] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c894c3c8-4482-4b2e-a8fb-72eb5f6eb886 in Status: IN_PROGRESS for 2s [ 1018.522621] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7bc12ce3-2b1a-439c-8e90-f01bd1033c9a in Status: SUCCESS [ 1018.522920] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7bc12ce3-2b1a-439c-8e90-f01bd1033c9a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.523081] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7bc12ce3-2b1a-439c-8e90-f01bd1033c9a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.523308] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7bc12ce3-2b1a-439c-8e90-f01bd1033c9a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.523500] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.523620] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.523685] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.523845] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.523928] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.524127] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7bc12ce3-2b1a-439c-8e90-f01bd1033c9a',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1019.026865] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7bc12ce3-2b1a-439c-8e90-f01bd1033c9a',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1019.490094] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 690c96d5-eb4d-48e2-8d5e-d794cdf78fd1 in Status: SUCCESS [ 1019.490094] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-690c96d5-eb4d-48e2-8d5e-d794cdf78fd1" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.490411] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-690c96d5-eb4d-48e2-8d5e-d794cdf78fd1" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.490542] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-690c96d5-eb4d-48e2-8d5e-d794cdf78fd1" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.490752] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.491366] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.491366] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.491366] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.491366] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.491366] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('690c96d5-eb4d-48e2-8d5e-d794cdf78fd1',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1019.529228] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7bc12ce3-2b1a-439c-8e90-f01bd1033c9a',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1019.993384] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.993452] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.993512] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.993728] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.993821] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.994120] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.994188] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.994230] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.994351] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.994429] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.994519] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 690c96d5-eb4d-48e2-8d5e-d794cdf78fd1 is going to be updated. [ 1020.003901] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c894c3c8-4482-4b2e-a8fb-72eb5f6eb886 in Status: SUCCESS [ 1020.004104] env[69980]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c894c3c8-4482-4b2e-a8fb-72eb5f6eb886 deletion is rescheduled due to dependency. [ 1020.004205] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c894c3c8-4482-4b2e-a8fb-72eb5f6eb886" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.019392] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.019599] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.019743] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.019994] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.020219] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.029089] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 690c96d5-eb4d-48e2-8d5e-d794cdf78fd1 in Status: IN_PROGRESS for 2s [ 1020.032399] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.032565] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.032642] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.032845] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.032926] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.033033] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7bc12ce3-2b1a-439c-8e90-f01bd1033c9a is going to be updated. [ 1020.056434] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.056806] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.056954] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.057253] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.057468] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.065131] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7bc12ce3-2b1a-439c-8e90-f01bd1033c9a in Status: IN_PROGRESS for 2s [ 1020.126038] env[69980]: INFO networking_nsxv3.common.synchronization [req-3e638d88-c681-4566-8a55-22c9ecb40767 req-943a82ef-0c5d-4cb5-8e3f-ee65bffeb136 tempest-ImagesTestJSON-600722714 tempest-ImagesTestJSON-600722714-project-member] Enqueued Resource ID: 80e3ea48-91a5-4863-b1c2-f3e887204e39 with Priority: HIGHEST for action security_group_members [ 1020.126641] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 80e3ea48-91a5-4863-b1c2-f3e887204e39 with Priority: HIGHEST for action security_group_members [ 1020.126997] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-80e3ea48-91a5-4863-b1c2-f3e887204e39 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.127202] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-80e3ea48-91a5-4863-b1c2-f3e887204e39" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.127323] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-80e3ea48-91a5-4863-b1c2-f3e887204e39" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.127577] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-80e3ea48-91a5-4863-b1c2-f3e887204e39" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.127961] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.128184] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.128296] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.128490] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.128617] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.128749] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('80e3ea48-91a5-4863-b1c2-f3e887204e39',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1020.575242] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock network-136 taken with stack trace [, , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.575651] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "network-136" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.576245] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "network-136" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.576321] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "network-136" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.576915] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.577167] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.577352] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.577735] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.577929] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.578201] env[69980]: DEBUG dogpile.cache.region [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] No value present for key: 'zone-id' {{(pid=69980) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1020.578362] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] NeedRegenerationException {{(pid=69980) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1020.578514] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] no value, waiting for create lock {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1020.578652] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] value creation lock acquired {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1020.578806] env[69980]: DEBUG dogpile.cache.region [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] No value present for key: 'zone-id' {{(pid=69980) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1020.578965] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Calling creation function for not-yet-present value {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1020.579153] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1020.598556] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1020.598730] env[69980]: DEBUG dogpile.cache.region [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=69980) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1020.598943] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Released creation lock {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1020.599191] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "network-136" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.599581] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock port-d77230e5-23f7-4f7b-8e1d-139dcbe50145 taken with stack trace [, , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.599886] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "port-d77230e5-23f7-4f7b-8e1d-139dcbe50145" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.599963] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "port-d77230e5-23f7-4f7b-8e1d-139dcbe50145" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.600398] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "port-d77230e5-23f7-4f7b-8e1d-139dcbe50145" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.600726] env[69980]: DEBUG networking_nsxv3.api.rpc [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d77230e5-23f7-4f7b-8e1d-139dcbe50145',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1020.631078] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('80e3ea48-91a5-4863-b1c2-f3e887204e39',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1021.103595] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.103968] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.105334] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.107551] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.107551] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.107551] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Segment Port d77230e5-23f7-4f7b-8e1d-139dcbe50145 not found, creating... [ 1021.107551] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.107551] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.107551] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.107893] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.107959] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.112021] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.112021] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.112994] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.112994] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.112994] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.113581] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Resource: SegmentPort with ID: d77230e5-23f7-4f7b-8e1d-139dcbe50145 is going to be created. [ 1021.134742] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.135459] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.135736] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.136196] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.136479] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.136732] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "port-d77230e5-23f7-4f7b-8e1d-139dcbe50145" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.138261] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('80e3ea48-91a5-4863-b1c2-f3e887204e39',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1021.640043] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.640043] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.642228] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.642228] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.642228] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.642228] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 80e3ea48-91a5-4863-b1c2-f3e887204e39 is going to be updated. [ 1021.672282] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.672529] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.672529] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.672701] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.672842] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.681526] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 80e3ea48-91a5-4863-b1c2-f3e887204e39 in Status: IN_PROGRESS for 2s [ 1022.042568] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 690c96d5-eb4d-48e2-8d5e-d794cdf78fd1 in Status: SUCCESS [ 1022.043752] env[69980]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 690c96d5-eb4d-48e2-8d5e-d794cdf78fd1 deletion is rescheduled due to dependency. [ 1022.043752] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-690c96d5-eb4d-48e2-8d5e-d794cdf78fd1" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.043752] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-690c96d5-eb4d-48e2-8d5e-d794cdf78fd1" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.043752] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-690c96d5-eb4d-48e2-8d5e-d794cdf78fd1" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.043752] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.045060] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.045060] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.045060] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.046176] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.046176] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('690c96d5-eb4d-48e2-8d5e-d794cdf78fd1',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1022.065299] env[69980]: INFO networking_nsxv3.common.synchronization [req-ef094fdc-39ea-48e8-b9d8-4bb763865b5d req-d47cdc9a-8bb2-44cf-8328-d7fdd6ded99e tempest-DeleteServersTestJSON-1084822395 tempest-DeleteServersTestJSON-1084822395-project-member] Enqueued Resource ID: d0e04be7-8718-489c-8ceb-fe661da4855a with Priority: HIGHEST for action security_group_members [ 1022.065610] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d0e04be7-8718-489c-8ceb-fe661da4855a with Priority: HIGHEST for action security_group_members [ 1022.067075] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-d0e04be7-8718-489c-8ceb-fe661da4855a taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.067075] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d0e04be7-8718-489c-8ceb-fe661da4855a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.067503] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d0e04be7-8718-489c-8ceb-fe661da4855a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.068542] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d0e04be7-8718-489c-8ceb-fe661da4855a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.068755] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.069041] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.069041] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.069352] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.069352] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.069443] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d0e04be7-8718-489c-8ceb-fe661da4855a',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1022.072607] env[69980]: INFO networking_nsxv3.common.synchronization [None req-2c20b285-3ce0-4f6c-9be5-2e2aeb540929 None None] Enqueued Resource ID: c35e6798-4a37-42f8-a35f-da1726566540 with Priority: HIGHEST for action port [ 1022.074316] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c35e6798-4a37-42f8-a35f-da1726566540 with Priority: HIGHEST for action port [ 1022.075393] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock port-c35e6798-4a37-42f8-a35f-da1726566540 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.075647] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c35e6798-4a37-42f8-a35f-da1726566540" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.075647] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c35e6798-4a37-42f8-a35f-da1726566540" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.076038] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c35e6798-4a37-42f8-a35f-da1726566540" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.076101] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c35e6798-4a37-42f8-a35f-da1726566540',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1022.081655] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7bc12ce3-2b1a-439c-8e90-f01bd1033c9a in Status: SUCCESS [ 1022.081904] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7bc12ce3-2b1a-439c-8e90-f01bd1033c9a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.082550] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7bc12ce3-2b1a-439c-8e90-f01bd1033c9a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.082831] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7bc12ce3-2b1a-439c-8e90-f01bd1033c9a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.083086] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.083271] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.083387] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.083632] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.084947] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.085292] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7bc12ce3-2b1a-439c-8e90-f01bd1033c9a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.085292] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7bc12ce3-2b1a-439c-8e90-f01bd1033c9a',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1022.179974] env[69980]: INFO networking_nsxv3.common.synchronization [req-3e638d88-c681-4566-8a55-22c9ecb40767 req-43c8fb68-28a7-4fd6-9c37-dccd3151840d service nova] Enqueued Resource ID: 80e3ea48-91a5-4863-b1c2-f3e887204e39 with Priority: HIGHEST for action security_group_rules [ 1022.179974] env[69980]: INFO networking_nsxv3.common.synchronization [req-3e638d88-c681-4566-8a55-22c9ecb40767 req-43c8fb68-28a7-4fd6-9c37-dccd3151840d service nova] Enqueued Resource ID: 80e3ea48-91a5-4863-b1c2-f3e887204e39 with Priority: HIGHEST for action security_group_members [ 1022.179974] env[69980]: INFO networking_nsxv3.common.synchronization [req-3e638d88-c681-4566-8a55-22c9ecb40767 req-43c8fb68-28a7-4fd6-9c37-dccd3151840d service nova] Enqueued Resource ID: d77230e5-23f7-4f7b-8e1d-139dcbe50145 with Priority: HIGHEST for action port [ 1022.179974] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 80e3ea48-91a5-4863-b1c2-f3e887204e39 with Priority: HIGHEST for action security_group_rules [ 1022.179974] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 80e3ea48-91a5-4863-b1c2-f3e887204e39 with Priority: HIGHEST for action security_group_members [ 1022.179974] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d77230e5-23f7-4f7b-8e1d-139dcbe50145 with Priority: HIGHEST for action port [ 1022.183765] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock rules-80e3ea48-91a5-4863-b1c2-f3e887204e39 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.183765] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-80e3ea48-91a5-4863-b1c2-f3e887204e39" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.183765] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-80e3ea48-91a5-4863-b1c2-f3e887204e39" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.184074] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-80e3ea48-91a5-4863-b1c2-f3e887204e39" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.184074] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('80e3ea48-91a5-4863-b1c2-f3e887204e39',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1022.185043] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-80e3ea48-91a5-4863-b1c2-f3e887204e39 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.185139] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-80e3ea48-91a5-4863-b1c2-f3e887204e39" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.185350] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock port-d77230e5-23f7-4f7b-8e1d-139dcbe50145 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.185446] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d77230e5-23f7-4f7b-8e1d-139dcbe50145" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.185495] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d77230e5-23f7-4f7b-8e1d-139dcbe50145" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.185664] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d77230e5-23f7-4f7b-8e1d-139dcbe50145" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.185759] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d77230e5-23f7-4f7b-8e1d-139dcbe50145',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1022.551533] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.551690] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.551773] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.552011] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.552201] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.552343] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.552448] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.552510] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.552852] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.552990] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.553272] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 690c96d5-eb4d-48e2-8d5e-d794cdf78fd1 is going to be updated. [ 1022.576158] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.576158] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.576158] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.576158] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.576158] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.576158] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.576158] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.576158] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.576158] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.576158] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.576158] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d0e04be7-8718-489c-8ceb-fe661da4855a is going to be updated. [ 1022.583104] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.583104] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.583104] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.583104] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.583104] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.583490] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port c35e6798-4a37-42f8-a35f-da1726566540 [ 1022.583659] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.583760] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.583825] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.583982] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.584103] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.584190] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:c35e6798-4a37-42f8-a35f-da1726566540 already deleted. [ 1022.584269] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c35e6798-4a37-42f8-a35f-da1726566540" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.587258] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-7bc12ce3-2b1a-439c-8e90-f01bd1033c9a taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.587367] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7bc12ce3-2b1a-439c-8e90-f01bd1033c9a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.587438] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7bc12ce3-2b1a-439c-8e90-f01bd1033c9a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.587841] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7bc12ce3-2b1a-439c-8e90-f01bd1033c9a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.587841] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.587841] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.587978] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.588313] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.588313] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.588313] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7bc12ce3-2b1a-439c-8e90-f01bd1033c9a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.588313] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-7bc12ce3-2b1a-439c-8e90-f01bd1033c9a taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.588457] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7bc12ce3-2b1a-439c-8e90-f01bd1033c9a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.588457] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7bc12ce3-2b1a-439c-8e90-f01bd1033c9a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.588665] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7bc12ce3-2b1a-439c-8e90-f01bd1033c9a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.588718] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.588793] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.588849] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.590020] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.590436] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.590436] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7bc12ce3-2b1a-439c-8e90-f01bd1033c9a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.590436] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7bc12ce3-2b1a-439c-8e90-f01bd1033c9a',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1022.593699] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 690c96d5-eb4d-48e2-8d5e-d794cdf78fd1 in Status: IN_PROGRESS for 2s [ 1022.606128] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.606402] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.606402] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.606523] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.606798] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.613864] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d0e04be7-8718-489c-8ceb-fe661da4855a in Status: IN_PROGRESS for 2s [ 1022.687632] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-80e3ea48-91a5-4863-b1c2-f3e887204e39 taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.687951] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-80e3ea48-91a5-4863-b1c2-f3e887204e39" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.688042] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d77230e5-23f7-4f7b-8e1d-139dcbe50145 with status ACTIVE [ 1022.688221] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.688327] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.688393] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.688661] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.688707] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.688850] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.689132] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.689255] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.689394] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.689472] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.689706] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.689770] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.689803] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.689934] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.690012] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.690104] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d77230e5-23f7-4f7b-8e1d-139dcbe50145 is going to be updated. [ 1022.716248] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.716432] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.716432] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.716630] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.716764] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.716924] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d77230e5-23f7-4f7b-8e1d-139dcbe50145" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.834934] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock network-478 taken with stack trace [, , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.835206] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "network-478" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.835351] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "network-478" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.835692] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "network-478" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.836023] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.836217] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.836360] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.836597] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.836769] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.836998] env[69980]: DEBUG dogpile.cache.region [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] No value present for key: 'zone-id' {{(pid=69980) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1022.837144] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] NeedRegenerationException {{(pid=69980) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1022.837262] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] no value, waiting for create lock {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1022.837411] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] value creation lock acquired {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1022.837532] env[69980]: DEBUG dogpile.cache.region [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] No value present for key: 'zone-id' {{(pid=69980) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1022.837660] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Calling creation function for not-yet-present value {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1022.837805] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1022.867263] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1022.868023] env[69980]: DEBUG dogpile.cache.region [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Cache value generated in 0.030 seconds for key(s): 'zone-id' {{(pid=69980) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1022.868023] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Released creation lock {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1022.868023] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "network-478" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.868191] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock port-e5716769-cf14-487f-b2e0-97bd26e8d2c4 taken with stack trace [, , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.868293] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "port-e5716769-cf14-487f-b2e0-97bd26e8d2c4" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.868420] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "port-e5716769-cf14-487f-b2e0-97bd26e8d2c4" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.868766] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "port-e5716769-cf14-487f-b2e0-97bd26e8d2c4" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.868915] env[69980]: DEBUG networking_nsxv3.api.rpc [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e5716769-cf14-487f-b2e0-97bd26e8d2c4',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1023.093558] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7bc12ce3-2b1a-439c-8e90-f01bd1033c9a: rpc.has_security_group_logging(os_id): False [ 1023.117057] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.117348] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.117486] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.117826] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.117999] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.118391] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.118610] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.118717] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.118965] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.119123] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.119448] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.119588] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.119680] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.119931] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.120079] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.120327] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.120441] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.120543] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.120786] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.120920] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.121066] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7bc12ce3-2b1a-439c-8e90-f01bd1033c9a is going to be updated. [ 1023.176843] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.177046] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.177145] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.177489] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.177706] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.199348] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7bc12ce3-2b1a-439c-8e90-f01bd1033c9a in Status: IN_PROGRESS for 2s [ 1023.372441] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.375494] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.375937] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.376452] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.376701] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.376811] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Segment Port e5716769-cf14-487f-b2e0-97bd26e8d2c4 not found, creating... [ 1023.377421] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.377629] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.377757] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.378244] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.378432] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.378758] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.380572] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.380572] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.380572] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.380572] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.382019] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Resource: SegmentPort with ID: e5716769-cf14-487f-b2e0-97bd26e8d2c4 is going to be created. [ 1023.400524] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.400739] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.400986] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.401163] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.401402] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.402472] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "port-e5716769-cf14-487f-b2e0-97bd26e8d2c4" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.692737] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 80e3ea48-91a5-4863-b1c2-f3e887204e39 in Status: SUCCESS [ 1023.692737] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-80e3ea48-91a5-4863-b1c2-f3e887204e39" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.692737] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-80e3ea48-91a5-4863-b1c2-f3e887204e39" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.692737] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-80e3ea48-91a5-4863-b1c2-f3e887204e39" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.692737] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.692737] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.692737] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.692737] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.692737] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.692737] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('80e3ea48-91a5-4863-b1c2-f3e887204e39',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1023.997454] env[69980]: INFO networking_nsxv3.common.synchronization [None req-8cff3c37-5a5d-4791-bd7d-7e64ce219087 None None] Enqueued Resource ID: 4014369f-ef75-411d-87ee-6fcb67ad1e28 with Priority: HIGHEST for action port [ 1023.997726] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4014369f-ef75-411d-87ee-6fcb67ad1e28 with Priority: HIGHEST for action port [ 1023.998419] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock port-4014369f-ef75-411d-87ee-6fcb67ad1e28 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.998569] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4014369f-ef75-411d-87ee-6fcb67ad1e28" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.998714] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4014369f-ef75-411d-87ee-6fcb67ad1e28" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.998850] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4014369f-ef75-411d-87ee-6fcb67ad1e28" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.998931] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4014369f-ef75-411d-87ee-6fcb67ad1e28',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1024.078449] env[69980]: INFO networking_nsxv3.common.synchronization [req-ef094fdc-39ea-48e8-b9d8-4bb763865b5d req-cea852a7-a282-487d-b40a-f1ae6e1efa44 service nova] Enqueued Resource ID: d0e04be7-8718-489c-8ceb-fe661da4855a with Priority: HIGHEST for action security_group_rules [ 1024.078627] env[69980]: INFO networking_nsxv3.common.synchronization [req-ef094fdc-39ea-48e8-b9d8-4bb763865b5d req-cea852a7-a282-487d-b40a-f1ae6e1efa44 service nova] Enqueued Resource ID: d0e04be7-8718-489c-8ceb-fe661da4855a with Priority: HIGHEST for action security_group_members [ 1024.078764] env[69980]: INFO networking_nsxv3.common.synchronization [req-ef094fdc-39ea-48e8-b9d8-4bb763865b5d req-cea852a7-a282-487d-b40a-f1ae6e1efa44 service nova] Enqueued Resource ID: e5716769-cf14-487f-b2e0-97bd26e8d2c4 with Priority: HIGHEST for action port [ 1024.079562] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d0e04be7-8718-489c-8ceb-fe661da4855a with Priority: HIGHEST for action security_group_rules [ 1024.079636] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d0e04be7-8718-489c-8ceb-fe661da4855a with Priority: HIGHEST for action security_group_members [ 1024.079741] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e5716769-cf14-487f-b2e0-97bd26e8d2c4 with Priority: HIGHEST for action port [ 1024.082777] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d0e04be7-8718-489c-8ceb-fe661da4855a taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.082777] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d0e04be7-8718-489c-8ceb-fe661da4855a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.082777] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d0e04be7-8718-489c-8ceb-fe661da4855a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.083034] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d0e04be7-8718-489c-8ceb-fe661da4855a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.083034] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d0e04be7-8718-489c-8ceb-fe661da4855a',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1024.083911] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-d0e04be7-8718-489c-8ceb-fe661da4855a taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.084031] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d0e04be7-8718-489c-8ceb-fe661da4855a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.084254] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock port-e5716769-cf14-487f-b2e0-97bd26e8d2c4 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.084368] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e5716769-cf14-487f-b2e0-97bd26e8d2c4" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.084431] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e5716769-cf14-487f-b2e0-97bd26e8d2c4" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.084624] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e5716769-cf14-487f-b2e0-97bd26e8d2c4" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.084703] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e5716769-cf14-487f-b2e0-97bd26e8d2c4',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1024.195045] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('80e3ea48-91a5-4863-b1c2-f3e887204e39',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1024.501251] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 4014369f-ef75-411d-87ee-6fcb67ad1e28 [ 1024.503033] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.503033] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.503033] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.503033] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.503033] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.503033] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:4014369f-ef75-411d-87ee-6fcb67ad1e28 already deleted. [ 1024.503033] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4014369f-ef75-411d-87ee-6fcb67ad1e28" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.587835] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e5716769-cf14-487f-b2e0-97bd26e8d2c4 with status ACTIVE [ 1024.588095] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.588240] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.588383] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.588525] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.588626] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.588810] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.588911] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.588964] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.589148] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.589225] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.589407] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.589497] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.589552] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.589688] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.589762] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.589846] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e5716769-cf14-487f-b2e0-97bd26e8d2c4 is going to be updated. [ 1024.591177] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-d0e04be7-8718-489c-8ceb-fe661da4855a taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.591293] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d0e04be7-8718-489c-8ceb-fe661da4855a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.601867] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 690c96d5-eb4d-48e2-8d5e-d794cdf78fd1 in Status: SUCCESS [ 1024.602047] env[69980]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 690c96d5-eb4d-48e2-8d5e-d794cdf78fd1 deletion is rescheduled due to dependency. [ 1024.602151] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-690c96d5-eb4d-48e2-8d5e-d794cdf78fd1" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.613434] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.613591] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.613650] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.614262] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.614262] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.614262] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e5716769-cf14-487f-b2e0-97bd26e8d2c4" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.620977] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d0e04be7-8718-489c-8ceb-fe661da4855a in Status: SUCCESS [ 1024.621153] env[69980]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d0e04be7-8718-489c-8ceb-fe661da4855a deletion is rescheduled due to dependency. [ 1024.621247] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d0e04be7-8718-489c-8ceb-fe661da4855a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.621379] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d0e04be7-8718-489c-8ceb-fe661da4855a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.621550] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d0e04be7-8718-489c-8ceb-fe661da4855a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.621710] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.621812] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.621876] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.622025] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.622107] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.622201] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d0e04be7-8718-489c-8ceb-fe661da4855a',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1024.696786] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('80e3ea48-91a5-4863-b1c2-f3e887204e39',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1025.124830] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d0e04be7-8718-489c-8ceb-fe661da4855a',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1025.202233] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.203035] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.203035] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.203297] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.203403] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.203512] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 80e3ea48-91a5-4863-b1c2-f3e887204e39 is going to be updated. [ 1025.219075] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7bc12ce3-2b1a-439c-8e90-f01bd1033c9a in Status: SUCCESS [ 1025.219312] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7bc12ce3-2b1a-439c-8e90-f01bd1033c9a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.229854] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.230073] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.230150] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.230409] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.230588] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.238714] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 80e3ea48-91a5-4863-b1c2-f3e887204e39 in Status: IN_PROGRESS for 2s [ 1025.627505] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d0e04be7-8718-489c-8ceb-fe661da4855a',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1026.131040] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.131040] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.131040] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.131466] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.131466] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.131466] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d0e04be7-8718-489c-8ceb-fe661da4855a is going to be updated. [ 1026.162645] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.163672] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.163672] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.163672] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.163672] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.171330] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d0e04be7-8718-489c-8ceb-fe661da4855a in Status: IN_PROGRESS for 2s [ 1027.249880] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 80e3ea48-91a5-4863-b1c2-f3e887204e39 in Status: SUCCESS [ 1027.249880] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-80e3ea48-91a5-4863-b1c2-f3e887204e39" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.249880] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-80e3ea48-91a5-4863-b1c2-f3e887204e39" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.249880] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-80e3ea48-91a5-4863-b1c2-f3e887204e39" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.249880] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.249880] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.249880] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.249880] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.249880] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.249880] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-80e3ea48-91a5-4863-b1c2-f3e887204e39" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.249880] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('80e3ea48-91a5-4863-b1c2-f3e887204e39',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1027.755030] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-80e3ea48-91a5-4863-b1c2-f3e887204e39 taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.755030] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-80e3ea48-91a5-4863-b1c2-f3e887204e39" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.755030] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-80e3ea48-91a5-4863-b1c2-f3e887204e39" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.755030] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-80e3ea48-91a5-4863-b1c2-f3e887204e39" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.755030] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.755030] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.755030] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.755030] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.755030] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.755030] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-80e3ea48-91a5-4863-b1c2-f3e887204e39" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.755030] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-80e3ea48-91a5-4863-b1c2-f3e887204e39 taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.755030] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-80e3ea48-91a5-4863-b1c2-f3e887204e39" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.755030] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-80e3ea48-91a5-4863-b1c2-f3e887204e39" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.755030] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-80e3ea48-91a5-4863-b1c2-f3e887204e39" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.755030] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.755030] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.755686] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.755686] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.755686] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.755686] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-80e3ea48-91a5-4863-b1c2-f3e887204e39" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.755686] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('80e3ea48-91a5-4863-b1c2-f3e887204e39',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1028.181157] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d0e04be7-8718-489c-8ceb-fe661da4855a in Status: SUCCESS [ 1028.181157] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d0e04be7-8718-489c-8ceb-fe661da4855a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.181284] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d0e04be7-8718-489c-8ceb-fe661da4855a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.182029] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d0e04be7-8718-489c-8ceb-fe661da4855a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.182029] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.182029] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.182029] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.182281] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.182281] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.182749] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d0e04be7-8718-489c-8ceb-fe661da4855a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.182749] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d0e04be7-8718-489c-8ceb-fe661da4855a',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1028.260646] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 80e3ea48-91a5-4863-b1c2-f3e887204e39: rpc.has_security_group_logging(os_id): False [ 1028.278479] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.278754] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.278862] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.279207] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.279334] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.279565] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.279674] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.279767] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.279947] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.280066] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.280280] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.280381] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.280442] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.280585] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.280661] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.280850] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.280941] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.281009] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.281168] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.281260] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.281326] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 80e3ea48-91a5-4863-b1c2-f3e887204e39 is going to be updated. [ 1028.352600] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.352861] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.352861] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.353191] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.353297] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.374039] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 80e3ea48-91a5-4863-b1c2-f3e887204e39 in Status: IN_PROGRESS for 2s [ 1028.691999] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-d0e04be7-8718-489c-8ceb-fe661da4855a taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.691999] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d0e04be7-8718-489c-8ceb-fe661da4855a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.691999] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d0e04be7-8718-489c-8ceb-fe661da4855a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.691999] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d0e04be7-8718-489c-8ceb-fe661da4855a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.691999] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.691999] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.691999] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.691999] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.691999] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.691999] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d0e04be7-8718-489c-8ceb-fe661da4855a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.691999] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-d0e04be7-8718-489c-8ceb-fe661da4855a taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.691999] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d0e04be7-8718-489c-8ceb-fe661da4855a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.691999] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d0e04be7-8718-489c-8ceb-fe661da4855a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.691999] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d0e04be7-8718-489c-8ceb-fe661da4855a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.692735] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.692735] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.692735] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.692940] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.693362] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.693581] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d0e04be7-8718-489c-8ceb-fe661da4855a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.693738] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d0e04be7-8718-489c-8ceb-fe661da4855a',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1028.843069] env[69980]: INFO networking_nsxv3.common.synchronization [req-3526d7bd-5806-47da-991e-a2a2cbaad87a req-7a0dcd5a-0b8c-4f0b-8202-88f4e736d12f tempest-MultipleCreateTestJSON-827335919 tempest-MultipleCreateTestJSON-827335919-project-member] Enqueued Resource ID: 7bc12ce3-2b1a-439c-8e90-f01bd1033c9a with Priority: HIGHEST for action security_group_members [ 1028.843883] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7bc12ce3-2b1a-439c-8e90-f01bd1033c9a with Priority: HIGHEST for action security_group_members [ 1028.844264] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-7bc12ce3-2b1a-439c-8e90-f01bd1033c9a taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.844731] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7bc12ce3-2b1a-439c-8e90-f01bd1033c9a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.844731] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7bc12ce3-2b1a-439c-8e90-f01bd1033c9a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.844731] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7bc12ce3-2b1a-439c-8e90-f01bd1033c9a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.844851] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.844906] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.844994] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.845289] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.845347] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.845449] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7bc12ce3-2b1a-439c-8e90-f01bd1033c9a',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1028.924348] env[69980]: INFO networking_nsxv3.common.synchronization [req-4355a6a3-a5f7-40c7-83ee-4f3bb8684e24 req-3f19f8e3-2155-498c-84a7-f0c58111ead8 tempest-MultipleCreateTestJSON-827335919 tempest-MultipleCreateTestJSON-827335919-project-member] Enqueued Resource ID: 7bc12ce3-2b1a-439c-8e90-f01bd1033c9a with Priority: HIGHEST for action security_group_members [ 1028.924883] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7bc12ce3-2b1a-439c-8e90-f01bd1033c9a with Priority: HIGHEST for action security_group_members [ 1028.925223] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-7bc12ce3-2b1a-439c-8e90-f01bd1033c9a taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.926183] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7bc12ce3-2b1a-439c-8e90-f01bd1033c9a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.197687] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d0e04be7-8718-489c-8ceb-fe661da4855a: rpc.has_security_group_logging(os_id): False [ 1029.217963] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.218447] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.218684] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.219076] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.219296] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.219901] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.220158] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.220416] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.220889] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.221115] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.221567] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.221951] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.222159] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.222449] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.222742] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.223203] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.223575] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.223864] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.224197] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.224475] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.224701] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d0e04be7-8718-489c-8ceb-fe661da4855a is going to be updated. [ 1029.289050] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.289050] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.289050] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.289050] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.289690] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.307593] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d0e04be7-8718-489c-8ceb-fe661da4855a in Status: IN_PROGRESS for 2s [ 1029.350904] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7bc12ce3-2b1a-439c-8e90-f01bd1033c9a',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1029.850567] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7bc12ce3-2b1a-439c-8e90-f01bd1033c9a',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1030.354054] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.354527] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.354527] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.354643] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.354694] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.354784] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7bc12ce3-2b1a-439c-8e90-f01bd1033c9a is going to be updated. [ 1030.382117] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.382301] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.382343] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.382626] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.382802] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.389568] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7bc12ce3-2b1a-439c-8e90-f01bd1033c9a in Status: IN_PROGRESS for 2s [ 1030.391061] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 80e3ea48-91a5-4863-b1c2-f3e887204e39 in Status: SUCCESS [ 1030.391322] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-80e3ea48-91a5-4863-b1c2-f3e887204e39" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.321594] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d0e04be7-8718-489c-8ceb-fe661da4855a in Status: SUCCESS [ 1031.321816] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d0e04be7-8718-489c-8ceb-fe661da4855a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.505154] env[69980]: INFO networking_nsxv3.common.synchronization [req-d4ba2a18-e7c3-4644-8332-093c552d8c01 req-887453ea-e822-4094-aa07-8e67e951caf3 tempest-ServersAdminTestJSON-1581544378 tempest-ServersAdminTestJSON-1581544378-project-member] Enqueued Resource ID: 700dc02a-f3c2-4363-9a0e-d7cdcb13a5b8 with Priority: HIGHEST for action security_group_members [ 1031.505740] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 700dc02a-f3c2-4363-9a0e-d7cdcb13a5b8 with Priority: HIGHEST for action security_group_members [ 1031.507327] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-700dc02a-f3c2-4363-9a0e-d7cdcb13a5b8 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.507327] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-700dc02a-f3c2-4363-9a0e-d7cdcb13a5b8" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.507434] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-700dc02a-f3c2-4363-9a0e-d7cdcb13a5b8" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.511018] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-700dc02a-f3c2-4363-9a0e-d7cdcb13a5b8" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.511018] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.511018] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.511018] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.511018] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.511018] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.511018] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('700dc02a-f3c2-4363-9a0e-d7cdcb13a5b8',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1032.011220] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('700dc02a-f3c2-4363-9a0e-d7cdcb13a5b8',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1032.399373] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7bc12ce3-2b1a-439c-8e90-f01bd1033c9a in Status: SUCCESS [ 1032.399649] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7bc12ce3-2b1a-439c-8e90-f01bd1033c9a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.399766] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7bc12ce3-2b1a-439c-8e90-f01bd1033c9a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.399998] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7bc12ce3-2b1a-439c-8e90-f01bd1033c9a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.401038] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.401038] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.401038] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.401038] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.401038] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.401038] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7bc12ce3-2b1a-439c-8e90-f01bd1033c9a',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1032.513640] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('700dc02a-f3c2-4363-9a0e-d7cdcb13a5b8',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1032.904171] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.904171] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.904171] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.904319] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.904450] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.904586] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.904696] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.904760] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.904925] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.905040] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.905161] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7bc12ce3-2b1a-439c-8e90-f01bd1033c9a is going to be updated. [ 1032.929572] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.929766] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.929766] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.929989] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.930175] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.938802] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7bc12ce3-2b1a-439c-8e90-f01bd1033c9a in Status: IN_PROGRESS for 2s [ 1033.016428] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.016584] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.016656] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.016879] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.016973] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.017112] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 700dc02a-f3c2-4363-9a0e-d7cdcb13a5b8 is going to be updated. [ 1033.041083] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.041245] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.041317] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.041503] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.041643] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.049737] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 700dc02a-f3c2-4363-9a0e-d7cdcb13a5b8 in Status: IN_PROGRESS for 2s [ 1034.949267] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7bc12ce3-2b1a-439c-8e90-f01bd1033c9a in Status: SUCCESS [ 1034.949267] env[69980]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7bc12ce3-2b1a-439c-8e90-f01bd1033c9a deletion is rescheduled due to dependency. [ 1034.949267] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7bc12ce3-2b1a-439c-8e90-f01bd1033c9a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.059706] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 700dc02a-f3c2-4363-9a0e-d7cdcb13a5b8 in Status: SUCCESS [ 1035.061350] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-700dc02a-f3c2-4363-9a0e-d7cdcb13a5b8" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.506823] env[69980]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1036.506823] env[69980]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1036.742375] env[69980]: INFO networking_nsxv3.common.synchronization [req-bc1b7a56-753e-4838-9394-0385d271284c req-b9eb31bd-3417-44b9-82ca-be9a23e080b3 tempest-MigrationsAdminTest-1290478568 tempest-MigrationsAdminTest-1290478568-project-member] Enqueued Resource ID: 462431af-62e3-426c-a50e-a61604f20358 with Priority: HIGHEST for action security_group_members [ 1036.743081] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 462431af-62e3-426c-a50e-a61604f20358 with Priority: HIGHEST for action security_group_members [ 1036.743081] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-462431af-62e3-426c-a50e-a61604f20358 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.747182] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-462431af-62e3-426c-a50e-a61604f20358" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.747289] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-462431af-62e3-426c-a50e-a61604f20358" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.747520] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-462431af-62e3-426c-a50e-a61604f20358" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.747701] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.747811] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.747873] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.748032] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.748152] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.748256] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('462431af-62e3-426c-a50e-a61604f20358',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1037.251230] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('462431af-62e3-426c-a50e-a61604f20358',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1037.752965] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('462431af-62e3-426c-a50e-a61604f20358',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1038.255842] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.256042] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.256111] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.256319] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.256409] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.256521] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 462431af-62e3-426c-a50e-a61604f20358 is going to be updated. [ 1038.285494] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.285643] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.285714] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.285973] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.286161] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.295151] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 462431af-62e3-426c-a50e-a61604f20358 in Status: IN_PROGRESS for 2s [ 1040.308344] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 462431af-62e3-426c-a50e-a61604f20358 in Status: SUCCESS [ 1040.308641] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-462431af-62e3-426c-a50e-a61604f20358" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.303891] env[69980]: INFO networking_nsxv3.common.synchronization [req-66fbb0f4-13f7-47cf-905f-61668323327c req-25814cfb-8f86-4848-b3eb-2ce8d3fedf52 tempest-ServerRescueTestJSON-1726562689 tempest-ServerRescueTestJSON-1726562689-project-member] Enqueued Resource ID: 4eb0fe0d-cd04-4189-9b26-953ab87885bd with Priority: HIGHEST for action security_group_members [ 1041.304544] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4eb0fe0d-cd04-4189-9b26-953ab87885bd with Priority: HIGHEST for action security_group_members [ 1041.304889] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-4eb0fe0d-cd04-4189-9b26-953ab87885bd taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.306055] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4eb0fe0d-cd04-4189-9b26-953ab87885bd" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.306166] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4eb0fe0d-cd04-4189-9b26-953ab87885bd" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.310019] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4eb0fe0d-cd04-4189-9b26-953ab87885bd" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.310019] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.310019] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.310019] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.310019] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.310019] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.310019] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4eb0fe0d-cd04-4189-9b26-953ab87885bd',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1041.695969] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock network-877 taken with stack trace [, , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.696206] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "network-877" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.696332] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "network-877" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.696655] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "network-877" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.696918] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.697649] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.697649] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.697649] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.697649] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.697844] env[69980]: DEBUG dogpile.cache.region [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] No value present for key: 'zone-id' {{(pid=69980) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1041.697939] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] NeedRegenerationException {{(pid=69980) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1041.698035] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] no value, waiting for create lock {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1041.698150] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] value creation lock acquired {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1041.698263] env[69980]: DEBUG dogpile.cache.region [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] No value present for key: 'zone-id' {{(pid=69980) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1041.698372] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Calling creation function for not-yet-present value {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1041.698516] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1041.716364] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1041.716614] env[69980]: DEBUG dogpile.cache.region [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=69980) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1041.716777] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Released creation lock {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1041.716957] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "network-877" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.717284] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock port-0ffbdc58-b190-4359-a691-088294cbf0b2 taken with stack trace [, , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.717516] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "port-0ffbdc58-b190-4359-a691-088294cbf0b2" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.717577] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "port-0ffbdc58-b190-4359-a691-088294cbf0b2" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.717883] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "port-0ffbdc58-b190-4359-a691-088294cbf0b2" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.718109] env[69980]: DEBUG networking_nsxv3.api.rpc [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0ffbdc58-b190-4359-a691-088294cbf0b2',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1041.812314] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.812314] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.812314] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.812314] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.812314] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.812314] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.812314] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.812314] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.812314] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.812314] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.812314] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4eb0fe0d-cd04-4189-9b26-953ab87885bd already deleted. [ 1041.812719] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4eb0fe0d-cd04-4189-9b26-953ab87885bd" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.191135] env[69980]: INFO networking_nsxv3.common.synchronization [req-e10b84d2-a6e6-45c0-b902-8671c6fa2741 req-a85cd512-24fa-4cf9-8584-9a3c0ca11bf9 tempest-ServersWithSpecificFlavorTestJSON-977701913 tempest-ServersWithSpecificFlavorTestJSON-977701913-project-member] Enqueued Resource ID: 3b94a139-70f4-4b1b-82e2-803c78f509bf with Priority: HIGHEST for action security_group_members [ 1042.191805] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3b94a139-70f4-4b1b-82e2-803c78f509bf with Priority: HIGHEST for action security_group_members [ 1042.192158] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-3b94a139-70f4-4b1b-82e2-803c78f509bf taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.193015] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3b94a139-70f4-4b1b-82e2-803c78f509bf" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.193015] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3b94a139-70f4-4b1b-82e2-803c78f509bf" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.193015] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3b94a139-70f4-4b1b-82e2-803c78f509bf" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.193015] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.193015] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.193015] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.193290] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.193290] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.193356] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3b94a139-70f4-4b1b-82e2-803c78f509bf',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1042.221562] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.222252] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.222543] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.223070] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.223353] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.223821] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Segment Port 0ffbdc58-b190-4359-a691-088294cbf0b2 not found, creating... [ 1042.224085] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.224345] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.224717] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.225962] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.225962] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.225962] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.225962] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.226182] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.226895] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.226895] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.227037] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Resource: SegmentPort with ID: 0ffbdc58-b190-4359-a691-088294cbf0b2 is going to be created. [ 1042.251706] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.251706] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.251915] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.252212] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.255222] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.255222] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "port-0ffbdc58-b190-4359-a691-088294cbf0b2" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.692130] env[69980]: INFO networking_nsxv3.common.synchronization [req-66d604f8-a353-4dcd-9659-0293da8d6d09 req-c25ccad7-d142-4b7e-ac8c-7df39e6b8f18 tempest-ImagesTestJSON-600722714 tempest-ImagesTestJSON-600722714-project-member] Enqueued Resource ID: 80e3ea48-91a5-4863-b1c2-f3e887204e39 with Priority: HIGHEST for action security_group_members [ 1042.692130] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 80e3ea48-91a5-4863-b1c2-f3e887204e39 with Priority: HIGHEST for action security_group_members [ 1042.692130] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-80e3ea48-91a5-4863-b1c2-f3e887204e39 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.692130] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-80e3ea48-91a5-4863-b1c2-f3e887204e39" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.692130] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-80e3ea48-91a5-4863-b1c2-f3e887204e39" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.692130] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-80e3ea48-91a5-4863-b1c2-f3e887204e39" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.692787] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.693067] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.693221] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.693514] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.693692] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.693867] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('80e3ea48-91a5-4863-b1c2-f3e887204e39',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1042.700064] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.700280] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.700423] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.700698] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.700909] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.701182] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.701396] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.701549] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.701780] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.701950] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.702140] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3b94a139-70f4-4b1b-82e2-803c78f509bf is going to be updated. [ 1042.728940] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.728940] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.728940] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.728940] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.728940] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.735341] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3b94a139-70f4-4b1b-82e2-803c78f509bf in Status: IN_PROGRESS for 2s [ 1042.953560] env[69980]: INFO networking_nsxv3.common.synchronization [req-66fbb0f4-13f7-47cf-905f-61668323327c req-3fb03784-e424-40b1-9f7e-4792bcc21de9 service nova] Enqueued Resource ID: 4eb0fe0d-cd04-4189-9b26-953ab87885bd with Priority: HIGHEST for action security_group_rules [ 1042.953750] env[69980]: INFO networking_nsxv3.common.synchronization [req-66fbb0f4-13f7-47cf-905f-61668323327c req-3fb03784-e424-40b1-9f7e-4792bcc21de9 service nova] Enqueued Resource ID: 4eb0fe0d-cd04-4189-9b26-953ab87885bd with Priority: HIGHEST for action security_group_members [ 1042.953892] env[69980]: INFO networking_nsxv3.common.synchronization [req-66fbb0f4-13f7-47cf-905f-61668323327c req-3fb03784-e424-40b1-9f7e-4792bcc21de9 service nova] Enqueued Resource ID: 0ffbdc58-b190-4359-a691-088294cbf0b2 with Priority: HIGHEST for action port [ 1042.954136] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4eb0fe0d-cd04-4189-9b26-953ab87885bd with Priority: HIGHEST for action security_group_rules [ 1042.954268] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4eb0fe0d-cd04-4189-9b26-953ab87885bd with Priority: HIGHEST for action security_group_members [ 1042.954364] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0ffbdc58-b190-4359-a691-088294cbf0b2 with Priority: HIGHEST for action port [ 1042.954924] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4eb0fe0d-cd04-4189-9b26-953ab87885bd taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.955125] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4eb0fe0d-cd04-4189-9b26-953ab87885bd" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.955206] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4eb0fe0d-cd04-4189-9b26-953ab87885bd" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.955461] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4eb0fe0d-cd04-4189-9b26-953ab87885bd" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.955547] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4eb0fe0d-cd04-4189-9b26-953ab87885bd',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1042.956593] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-4eb0fe0d-cd04-4189-9b26-953ab87885bd taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.956744] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4eb0fe0d-cd04-4189-9b26-953ab87885bd" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.956790] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4eb0fe0d-cd04-4189-9b26-953ab87885bd" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.956914] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4eb0fe0d-cd04-4189-9b26-953ab87885bd" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.957068] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.957384] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.957384] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.957384] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.957518] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.957552] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4eb0fe0d-cd04-4189-9b26-953ab87885bd',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1042.958352] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock port-0ffbdc58-b190-4359-a691-088294cbf0b2 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.958352] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0ffbdc58-b190-4359-a691-088294cbf0b2" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.958566] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0ffbdc58-b190-4359-a691-088294cbf0b2" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.958566] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0ffbdc58-b190-4359-a691-088294cbf0b2" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.958637] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0ffbdc58-b190-4359-a691-088294cbf0b2',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1043.195668] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('80e3ea48-91a5-4863-b1c2-f3e887204e39',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1043.460783] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-4eb0fe0d-cd04-4189-9b26-953ab87885bd taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.460935] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4eb0fe0d-cd04-4189-9b26-953ab87885bd" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.462497] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4eb0fe0d-cd04-4189-9b26-953ab87885bd',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1043.463255] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 0ffbdc58-b190-4359-a691-088294cbf0b2 with status ACTIVE [ 1043.463820] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.463978] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.464101] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.464324] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.464436] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.464627] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.464707] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.464707] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.468022] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.468022] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.468022] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.468022] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.468022] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.468022] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.468022] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.468022] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 0ffbdc58-b190-4359-a691-088294cbf0b2 is going to be updated. [ 1043.486033] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.486856] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.486856] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.486856] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.486856] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.486990] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0ffbdc58-b190-4359-a691-088294cbf0b2" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.700388] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('80e3ea48-91a5-4863-b1c2-f3e887204e39',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1043.793766] env[69980]: INFO networking_nsxv3.common.synchronization [req-f13c0050-a7cb-4432-b4de-c578d36204e2 req-c94e6b97-155b-4715-a7bc-7f0465f36e78 tempest-ServerActionsV293TestJSON-116352925 tempest-ServerActionsV293TestJSON-116352925-project-member] Enqueued Resource ID: 194841ae-0965-407f-a2bf-6d1f7693c801 with Priority: HIGHEST for action security_group_members [ 1043.794309] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 194841ae-0965-407f-a2bf-6d1f7693c801 with Priority: HIGHEST for action security_group_members [ 1043.794585] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-194841ae-0965-407f-a2bf-6d1f7693c801 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.794710] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-194841ae-0965-407f-a2bf-6d1f7693c801" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.794778] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-194841ae-0965-407f-a2bf-6d1f7693c801" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.795107] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-194841ae-0965-407f-a2bf-6d1f7693c801" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.795290] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.795393] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.795451] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.795597] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.795704] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.795766] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('194841ae-0965-407f-a2bf-6d1f7693c801',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1043.967416] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4eb0fe0d-cd04-4189-9b26-953ab87885bd',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1044.202397] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.202658] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.202769] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.203033] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.203162] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.203299] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 80e3ea48-91a5-4863-b1c2-f3e887204e39 is going to be updated. [ 1044.233543] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.233543] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.233543] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.233543] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.233543] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.242147] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 80e3ea48-91a5-4863-b1c2-f3e887204e39 in Status: IN_PROGRESS for 2s [ 1044.298211] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.298425] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.298583] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.298784] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.298905] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.299192] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.299337] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.299432] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.299641] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.299750] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.299895] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 194841ae-0965-407f-a2bf-6d1f7693c801 already deleted. [ 1044.301684] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-194841ae-0965-407f-a2bf-6d1f7693c801" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.342248] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock network-40 taken with stack trace [, , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.342438] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "network-40" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.342568] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "network-40" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.342905] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "network-40" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.343364] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.343534] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.343702] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.344199] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.344199] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.344311] env[69980]: DEBUG dogpile.cache.region [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] No value present for key: 'zone-id' {{(pid=69980) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1044.344374] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] NeedRegenerationException {{(pid=69980) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1044.344485] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] no value, waiting for create lock {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1044.344965] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] value creation lock acquired {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1044.344965] env[69980]: DEBUG dogpile.cache.region [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] No value present for key: 'zone-id' {{(pid=69980) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1044.344965] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Calling creation function for not-yet-present value {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1044.344965] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1044.366803] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1044.366988] env[69980]: DEBUG dogpile.cache.region [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=69980) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1044.367261] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Released creation lock {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1044.367509] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "network-40" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.367840] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock port-9800f691-7998-4e70-bea8-77b6a22f67f8 taken with stack trace [, , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.368046] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "port-9800f691-7998-4e70-bea8-77b6a22f67f8" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.368206] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "port-9800f691-7998-4e70-bea8-77b6a22f67f8" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.368522] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "port-9800f691-7998-4e70-bea8-77b6a22f67f8" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.368664] env[69980]: DEBUG networking_nsxv3.api.rpc [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9800f691-7998-4e70-bea8-77b6a22f67f8',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1044.469504] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.469709] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.469767] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.469949] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.470053] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.470148] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4eb0fe0d-cd04-4189-9b26-953ab87885bd is going to be created. [ 1044.493299] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.493460] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.493522] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.493711] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.493871] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.503589] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4eb0fe0d-cd04-4189-9b26-953ab87885bd in Status: UNINITIALIZED for 2s [ 1044.748577] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3b94a139-70f4-4b1b-82e2-803c78f509bf in Status: SUCCESS [ 1044.748882] env[69980]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3b94a139-70f4-4b1b-82e2-803c78f509bf deletion is rescheduled due to dependency. [ 1044.748932] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3b94a139-70f4-4b1b-82e2-803c78f509bf" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.871444] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.871690] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.871821] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.872124] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.872281] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.872443] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Segment Port 9800f691-7998-4e70-bea8-77b6a22f67f8 not found, creating... [ 1044.873048] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.873048] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.873048] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.873239] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.873369] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.873656] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.873816] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.873938] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.874166] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.874306] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.874449] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Resource: SegmentPort with ID: 9800f691-7998-4e70-bea8-77b6a22f67f8 is going to be created. [ 1044.893263] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.893497] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.893627] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.893906] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.894156] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.894392] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "port-9800f691-7998-4e70-bea8-77b6a22f67f8" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.788820] env[69980]: INFO networking_nsxv3.common.synchronization [req-f13c0050-a7cb-4432-b4de-c578d36204e2 req-7a5abe13-04b1-486f-a900-f405145a92a6 service nova] Enqueued Resource ID: 194841ae-0965-407f-a2bf-6d1f7693c801 with Priority: HIGHEST for action security_group_rules [ 1045.789111] env[69980]: INFO networking_nsxv3.common.synchronization [req-f13c0050-a7cb-4432-b4de-c578d36204e2 req-7a5abe13-04b1-486f-a900-f405145a92a6 service nova] Enqueued Resource ID: 194841ae-0965-407f-a2bf-6d1f7693c801 with Priority: HIGHEST for action security_group_members [ 1045.789203] env[69980]: INFO networking_nsxv3.common.synchronization [req-f13c0050-a7cb-4432-b4de-c578d36204e2 req-7a5abe13-04b1-486f-a900-f405145a92a6 service nova] Enqueued Resource ID: 9800f691-7998-4e70-bea8-77b6a22f67f8 with Priority: HIGHEST for action port [ 1045.789388] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 194841ae-0965-407f-a2bf-6d1f7693c801 with Priority: HIGHEST for action security_group_rules [ 1045.789516] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 194841ae-0965-407f-a2bf-6d1f7693c801 with Priority: HIGHEST for action security_group_members [ 1045.789609] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9800f691-7998-4e70-bea8-77b6a22f67f8 with Priority: HIGHEST for action port [ 1045.793090] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock rules-194841ae-0965-407f-a2bf-6d1f7693c801 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.793233] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-194841ae-0965-407f-a2bf-6d1f7693c801" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.793308] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-194841ae-0965-407f-a2bf-6d1f7693c801" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.793748] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-194841ae-0965-407f-a2bf-6d1f7693c801" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.793748] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('194841ae-0965-407f-a2bf-6d1f7693c801',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1045.794470] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-194841ae-0965-407f-a2bf-6d1f7693c801 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.794583] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-194841ae-0965-407f-a2bf-6d1f7693c801" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.794651] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-194841ae-0965-407f-a2bf-6d1f7693c801" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.794825] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-194841ae-0965-407f-a2bf-6d1f7693c801" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.794974] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.795104] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.795157] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.795296] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.795379] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.795472] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('194841ae-0965-407f-a2bf-6d1f7693c801',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1045.797302] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock port-9800f691-7998-4e70-bea8-77b6a22f67f8 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.797513] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9800f691-7998-4e70-bea8-77b6a22f67f8" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.797513] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9800f691-7998-4e70-bea8-77b6a22f67f8" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.797661] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9800f691-7998-4e70-bea8-77b6a22f67f8" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.797874] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9800f691-7998-4e70-bea8-77b6a22f67f8',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1045.805289] env[69980]: INFO networking_nsxv3.common.synchronization [req-bf244818-4746-4a41-9866-afa718ced8df req-88f9611a-0a36-42d5-911d-8dc634621c67 tempest-AttachInterfacesTestJSON-1782090316 tempest-AttachInterfacesTestJSON-1782090316-project-member] Enqueued Resource ID: e63cb46c-ccab-4856-bf25-2380514e2780 with Priority: HIGHEST for action security_group_members [ 1045.805756] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e63cb46c-ccab-4856-bf25-2380514e2780 with Priority: HIGHEST for action security_group_members [ 1045.806106] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-e63cb46c-ccab-4856-bf25-2380514e2780 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.806254] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e63cb46c-ccab-4856-bf25-2380514e2780" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.806323] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e63cb46c-ccab-4856-bf25-2380514e2780" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.806552] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e63cb46c-ccab-4856-bf25-2380514e2780" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.806707] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.806919] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.806993] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.807155] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.807446] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.807446] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e63cb46c-ccab-4856-bf25-2380514e2780',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1046.081195] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock network-762 taken with stack trace [, , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.081195] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "network-762" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.081195] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "network-762" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.081195] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "network-762" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.081195] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.082239] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.082398] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.082639] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.082789] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.083039] env[69980]: DEBUG dogpile.cache.region [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] No value present for key: 'zone-id' {{(pid=69980) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1046.083174] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] NeedRegenerationException {{(pid=69980) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1046.083287] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] no value, waiting for create lock {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1046.083675] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] value creation lock acquired {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1046.083867] env[69980]: DEBUG dogpile.cache.region [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] No value present for key: 'zone-id' {{(pid=69980) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1046.083994] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Calling creation function for not-yet-present value {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1046.084154] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1046.102152] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1046.102152] env[69980]: DEBUG dogpile.cache.region [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=69980) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1046.102406] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Released creation lock {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1046.102638] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "network-762" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.103055] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock port-5280f8a2-cee8-4383-b1f9-60debda2725b taken with stack trace [, , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.103788] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "port-5280f8a2-cee8-4383-b1f9-60debda2725b" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.103788] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "port-5280f8a2-cee8-4383-b1f9-60debda2725b" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.103788] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "port-5280f8a2-cee8-4383-b1f9-60debda2725b" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.104801] env[69980]: DEBUG networking_nsxv3.api.rpc [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5280f8a2-cee8-4383-b1f9-60debda2725b',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1046.253101] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 80e3ea48-91a5-4863-b1c2-f3e887204e39 in Status: SUCCESS [ 1046.253101] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-80e3ea48-91a5-4863-b1c2-f3e887204e39" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.301748] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-194841ae-0965-407f-a2bf-6d1f7693c801 taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.301950] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-194841ae-0965-407f-a2bf-6d1f7693c801" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.302161] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('194841ae-0965-407f-a2bf-6d1f7693c801',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1046.303217] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 9800f691-7998-4e70-bea8-77b6a22f67f8 with status ACTIVE [ 1046.303575] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.303575] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.303575] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.303764] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.304993] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.304993] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.304993] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.304993] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.304993] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.304993] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.304993] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.304993] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.304993] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.304993] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.304993] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.306476] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 9800f691-7998-4e70-bea8-77b6a22f67f8 is going to be updated. [ 1046.309291] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.309376] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.309836] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.309836] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.309836] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.310149] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.310149] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.310149] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.310826] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.310826] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.310826] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e63cb46c-ccab-4856-bf25-2380514e2780 already deleted. [ 1046.310826] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e63cb46c-ccab-4856-bf25-2380514e2780" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.323715] env[69980]: INFO networking_nsxv3.common.synchronization [req-e249cd54-4a94-418b-8303-02705509af35 req-232e88cb-f9de-4641-9f8b-f3f65fc06dfc tempest-ImagesOneServerNegativeTestJSON-332667785 tempest-ImagesOneServerNegativeTestJSON-332667785-project-member] Enqueued Resource ID: d53aff15-d6ed-495c-9f29-fdc03bd13622 with Priority: HIGHEST for action security_group_members [ 1046.325893] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.326138] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.326310] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.326640] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.327332] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.328443] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9800f691-7998-4e70-bea8-77b6a22f67f8" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.328754] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d53aff15-d6ed-495c-9f29-fdc03bd13622 with Priority: HIGHEST for action security_group_members [ 1046.328957] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-d53aff15-d6ed-495c-9f29-fdc03bd13622 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.329134] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d53aff15-d6ed-495c-9f29-fdc03bd13622" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.329269] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d53aff15-d6ed-495c-9f29-fdc03bd13622" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.329528] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d53aff15-d6ed-495c-9f29-fdc03bd13622" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.329777] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.329936] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.330040] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.330227] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.330350] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.330474] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d53aff15-d6ed-495c-9f29-fdc03bd13622',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1046.513534] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4eb0fe0d-cd04-4189-9b26-953ab87885bd in Status: SUCCESS [ 1046.513746] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4eb0fe0d-cd04-4189-9b26-953ab87885bd" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.513910] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4eb0fe0d-cd04-4189-9b26-953ab87885bd" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.514144] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4eb0fe0d-cd04-4189-9b26-953ab87885bd" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.517115] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.517115] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.517115] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.517115] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.517115] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.517115] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4eb0fe0d-cd04-4189-9b26-953ab87885bd" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.517115] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('4eb0fe0d-cd04-4189-9b26-953ab87885bd',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1046.606860] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.606860] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.606860] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.607042] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.607145] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.607303] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Segment Port 5280f8a2-cee8-4383-b1f9-60debda2725b not found, creating... [ 1046.607757] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.608601] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.608601] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.608601] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.608601] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.608811] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.608888] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.609018] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.609445] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.609620] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.610062] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Resource: SegmentPort with ID: 5280f8a2-cee8-4383-b1f9-60debda2725b is going to be created. [ 1046.631015] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.631905] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.631905] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.631905] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.631905] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.632155] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "port-5280f8a2-cee8-4383-b1f9-60debda2725b" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.800792] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock network-926 taken with stack trace [, , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.801141] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "network-926" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.801141] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "network-926" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.801386] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "network-926" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.801649] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.801808] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.801926] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.803218] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.803394] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.803608] env[69980]: DEBUG dogpile.cache.region [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] No value present for key: 'zone-id' {{(pid=69980) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1046.803727] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] NeedRegenerationException {{(pid=69980) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1046.803838] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] no value, waiting for create lock {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1046.803947] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] value creation lock acquired {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1046.804070] env[69980]: DEBUG dogpile.cache.region [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] No value present for key: 'zone-id' {{(pid=69980) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1046.804182] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Calling creation function for not-yet-present value {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1046.804315] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1046.809630] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('194841ae-0965-407f-a2bf-6d1f7693c801',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1046.832686] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1046.832862] env[69980]: DEBUG dogpile.cache.region [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Cache value generated in 0.029 seconds for key(s): 'zone-id' {{(pid=69980) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1046.833012] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Released creation lock {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1046.833199] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "network-926" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.833514] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock port-0f61a8fb-406b-46ad-b91e-2f2eb109eb81 taken with stack trace [, , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.833685] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "port-0f61a8fb-406b-46ad-b91e-2f2eb109eb81" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.833807] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "port-0f61a8fb-406b-46ad-b91e-2f2eb109eb81" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.834133] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "port-0f61a8fb-406b-46ad-b91e-2f2eb109eb81" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.834276] env[69980]: DEBUG networking_nsxv3.api.rpc [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0f61a8fb-406b-46ad-b91e-2f2eb109eb81',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1046.838489] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.838622] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.838723] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.838885] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.838950] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.839140] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.839233] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.839290] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.839437] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.839511] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.839595] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d53aff15-d6ed-495c-9f29-fdc03bd13622 is going to be updated. [ 1046.868334] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.868509] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.868570] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.868783] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.868881] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.876577] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d53aff15-d6ed-495c-9f29-fdc03bd13622 in Status: IN_PROGRESS for 2s [ 1047.019816] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-4eb0fe0d-cd04-4189-9b26-953ab87885bd taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.020090] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4eb0fe0d-cd04-4189-9b26-953ab87885bd" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.020174] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4eb0fe0d-cd04-4189-9b26-953ab87885bd" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.020357] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4eb0fe0d-cd04-4189-9b26-953ab87885bd" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.020532] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.020634] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.020692] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.020856] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.020943] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.021042] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4eb0fe0d-cd04-4189-9b26-953ab87885bd" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.021192] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-4eb0fe0d-cd04-4189-9b26-953ab87885bd taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.021292] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4eb0fe0d-cd04-4189-9b26-953ab87885bd" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.021352] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4eb0fe0d-cd04-4189-9b26-953ab87885bd" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.021503] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4eb0fe0d-cd04-4189-9b26-953ab87885bd" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.021628] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.021715] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.021771] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.021904] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.021980] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.022071] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4eb0fe0d-cd04-4189-9b26-953ab87885bd" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.022160] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('4eb0fe0d-cd04-4189-9b26-953ab87885bd',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1047.312383] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.312383] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.312383] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.312383] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.312383] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.312383] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 194841ae-0965-407f-a2bf-6d1f7693c801 is going to be created. [ 1047.324781] env[69980]: INFO networking_nsxv3.common.synchronization [req-bf244818-4746-4a41-9866-afa718ced8df req-106a16b2-cb4c-44d1-91e9-647bc115c521 service nova] Enqueued Resource ID: e63cb46c-ccab-4856-bf25-2380514e2780 with Priority: HIGHEST for action security_group_rules [ 1047.324958] env[69980]: INFO networking_nsxv3.common.synchronization [req-bf244818-4746-4a41-9866-afa718ced8df req-106a16b2-cb4c-44d1-91e9-647bc115c521 service nova] Enqueued Resource ID: e63cb46c-ccab-4856-bf25-2380514e2780 with Priority: HIGHEST for action security_group_members [ 1047.325318] env[69980]: INFO networking_nsxv3.common.synchronization [req-bf244818-4746-4a41-9866-afa718ced8df req-106a16b2-cb4c-44d1-91e9-647bc115c521 service nova] Enqueued Resource ID: 5280f8a2-cee8-4383-b1f9-60debda2725b with Priority: HIGHEST for action port [ 1047.325972] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e63cb46c-ccab-4856-bf25-2380514e2780 with Priority: HIGHEST for action security_group_rules [ 1047.329634] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e63cb46c-ccab-4856-bf25-2380514e2780 with Priority: HIGHEST for action security_group_members [ 1047.329731] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5280f8a2-cee8-4383-b1f9-60debda2725b with Priority: HIGHEST for action port [ 1047.330053] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e63cb46c-ccab-4856-bf25-2380514e2780 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.330201] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e63cb46c-ccab-4856-bf25-2380514e2780" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.330242] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e63cb46c-ccab-4856-bf25-2380514e2780" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.330509] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e63cb46c-ccab-4856-bf25-2380514e2780" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.330596] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e63cb46c-ccab-4856-bf25-2380514e2780',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1047.332483] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-e63cb46c-ccab-4856-bf25-2380514e2780 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.332483] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e63cb46c-ccab-4856-bf25-2380514e2780" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.332483] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e63cb46c-ccab-4856-bf25-2380514e2780" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.332483] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e63cb46c-ccab-4856-bf25-2380514e2780" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.332750] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.332750] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.333376] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.333376] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.333502] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.333901] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e63cb46c-ccab-4856-bf25-2380514e2780',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1047.335508] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock port-5280f8a2-cee8-4383-b1f9-60debda2725b taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.335508] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5280f8a2-cee8-4383-b1f9-60debda2725b" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.335508] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5280f8a2-cee8-4383-b1f9-60debda2725b" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.335710] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5280f8a2-cee8-4383-b1f9-60debda2725b" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.338915] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5280f8a2-cee8-4383-b1f9-60debda2725b',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1047.338915] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.338915] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.338915] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.338915] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.338915] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.341970] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.342209] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.342371] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.342616] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.342769] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.343019] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Segment Port 0f61a8fb-406b-46ad-b91e-2f2eb109eb81 not found, creating... [ 1047.343275] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.343442] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.343563] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.343844] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.343911] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.344206] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.344365] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.344486] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.344692] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.344838] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.344979] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Resource: SegmentPort with ID: 0f61a8fb-406b-46ad-b91e-2f2eb109eb81 is going to be created. [ 1047.350290] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 194841ae-0965-407f-a2bf-6d1f7693c801 in Status: UNINITIALIZED for 2s [ 1047.363695] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.363695] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.363695] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.363998] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.364298] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.364541] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "port-0f61a8fb-406b-46ad-b91e-2f2eb109eb81" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.524505] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 4eb0fe0d-cd04-4189-9b26-953ab87885bd: rpc.has_security_group_logging(os_id): False [ 1047.543877] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.544045] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.544125] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.544340] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.544429] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.544646] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.544790] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.544869] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.545032] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.545032] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.545266] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.545378] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.545435] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.545560] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.545757] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.546022] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.546022] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.546215] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.546448] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.546561] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.546680] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4eb0fe0d-cd04-4189-9b26-953ab87885bd is going to be created. [ 1047.622025] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.622025] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.622025] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.622025] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.622025] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.631674] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4eb0fe0d-cd04-4189-9b26-953ab87885bd in Status: IN_PROGRESS for 2s [ 1047.840291] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e63cb46c-ccab-4856-bf25-2380514e2780',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1047.842513] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-e63cb46c-ccab-4856-bf25-2380514e2780 taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.842513] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e63cb46c-ccab-4856-bf25-2380514e2780" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.842513] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 5280f8a2-cee8-4383-b1f9-60debda2725b with status ACTIVE [ 1047.842513] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.842513] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.842513] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.842513] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.842513] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.842513] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.842513] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.842513] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.842938] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.842938] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.842938] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.842938] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.842938] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.843107] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.843162] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.843237] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 5280f8a2-cee8-4383-b1f9-60debda2725b is going to be updated. [ 1047.863072] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.863364] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.863473] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.863784] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.864039] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.864297] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5280f8a2-cee8-4383-b1f9-60debda2725b" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.131587] env[69980]: INFO networking_nsxv3.common.synchronization [req-e249cd54-4a94-418b-8303-02705509af35 req-4bc48e92-825e-4606-a0c8-34f84e3c019e service nova] Enqueued Resource ID: d53aff15-d6ed-495c-9f29-fdc03bd13622 with Priority: HIGHEST for action security_group_rules [ 1048.131587] env[69980]: INFO networking_nsxv3.common.synchronization [req-e249cd54-4a94-418b-8303-02705509af35 req-4bc48e92-825e-4606-a0c8-34f84e3c019e service nova] Enqueued Resource ID: d53aff15-d6ed-495c-9f29-fdc03bd13622 with Priority: HIGHEST for action security_group_members [ 1048.131587] env[69980]: INFO networking_nsxv3.common.synchronization [req-e249cd54-4a94-418b-8303-02705509af35 req-4bc48e92-825e-4606-a0c8-34f84e3c019e service nova] Enqueued Resource ID: 0f61a8fb-406b-46ad-b91e-2f2eb109eb81 with Priority: HIGHEST for action port [ 1048.132384] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d53aff15-d6ed-495c-9f29-fdc03bd13622 with Priority: HIGHEST for action security_group_rules [ 1048.132384] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d53aff15-d6ed-495c-9f29-fdc03bd13622 with Priority: HIGHEST for action security_group_members [ 1048.132384] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0f61a8fb-406b-46ad-b91e-2f2eb109eb81 with Priority: HIGHEST for action port [ 1048.132663] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d53aff15-d6ed-495c-9f29-fdc03bd13622 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.132663] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d53aff15-d6ed-495c-9f29-fdc03bd13622" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.132663] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d53aff15-d6ed-495c-9f29-fdc03bd13622" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.133283] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d53aff15-d6ed-495c-9f29-fdc03bd13622" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.133283] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d53aff15-d6ed-495c-9f29-fdc03bd13622',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1048.133778] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-d53aff15-d6ed-495c-9f29-fdc03bd13622 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.133870] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d53aff15-d6ed-495c-9f29-fdc03bd13622" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.134070] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock port-0f61a8fb-406b-46ad-b91e-2f2eb109eb81 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.134163] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0f61a8fb-406b-46ad-b91e-2f2eb109eb81" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.134219] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0f61a8fb-406b-46ad-b91e-2f2eb109eb81" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.134385] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0f61a8fb-406b-46ad-b91e-2f2eb109eb81" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.134454] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0f61a8fb-406b-46ad-b91e-2f2eb109eb81',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1048.345780] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e63cb46c-ccab-4856-bf25-2380514e2780',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1048.640140] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-d53aff15-d6ed-495c-9f29-fdc03bd13622 taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.640140] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d53aff15-d6ed-495c-9f29-fdc03bd13622" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.640140] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 0f61a8fb-406b-46ad-b91e-2f2eb109eb81 with status ACTIVE [ 1048.640140] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.640140] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.640140] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.640140] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.640140] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.640140] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.640140] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.640140] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.640140] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.640140] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.640140] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.640918] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.640918] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.640918] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.640918] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.640918] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 0f61a8fb-406b-46ad-b91e-2f2eb109eb81 is going to be updated. [ 1048.663903] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.663903] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.663903] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.663903] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.663903] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.663903] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0f61a8fb-406b-46ad-b91e-2f2eb109eb81" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.789050] env[69980]: INFO networking_nsxv3.common.synchronization [req-d433e262-29f2-4b47-b3d5-5174bf64330b req-92915c63-0aa7-46a3-8183-ead008bcb787 tempest-ServerPasswordTestJSON-1228267695 tempest-ServerPasswordTestJSON-1228267695-project-member] Enqueued Resource ID: b258b5de-7d19-4a1e-b1cf-37eaaefe0a00 with Priority: HIGHEST for action security_group_members [ 1048.789474] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b258b5de-7d19-4a1e-b1cf-37eaaefe0a00 with Priority: HIGHEST for action security_group_members [ 1048.789843] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-b258b5de-7d19-4a1e-b1cf-37eaaefe0a00 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.790020] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b258b5de-7d19-4a1e-b1cf-37eaaefe0a00" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.790113] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b258b5de-7d19-4a1e-b1cf-37eaaefe0a00" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.790381] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b258b5de-7d19-4a1e-b1cf-37eaaefe0a00" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.790580] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.790712] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.790821] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.791016] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.791159] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.791301] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b258b5de-7d19-4a1e-b1cf-37eaaefe0a00',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1048.848172] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.848485] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.848485] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.848921] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.849090] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.849206] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e63cb46c-ccab-4856-bf25-2380514e2780 is going to be created. [ 1048.872964] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.873202] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.873299] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.873520] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.873707] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.881922] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e63cb46c-ccab-4856-bf25-2380514e2780 in Status: UNINITIALIZED for 2s [ 1048.884411] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d53aff15-d6ed-495c-9f29-fdc03bd13622 in Status: SUCCESS [ 1048.884505] env[69980]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d53aff15-d6ed-495c-9f29-fdc03bd13622 deletion is rescheduled due to dependency. [ 1048.885600] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d53aff15-d6ed-495c-9f29-fdc03bd13622" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.885600] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d53aff15-d6ed-495c-9f29-fdc03bd13622" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.885600] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d53aff15-d6ed-495c-9f29-fdc03bd13622" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.885600] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.885600] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.885600] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.885600] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.885600] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.885926] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d53aff15-d6ed-495c-9f29-fdc03bd13622',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1049.077050] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock network-803 taken with stack trace [, , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.077408] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "network-803" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.077494] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "network-803" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.077762] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "network-803" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.078239] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.078769] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.078769] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.078908] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.078957] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.079647] env[69980]: DEBUG dogpile.cache.region [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] No value present for key: 'zone-id' {{(pid=69980) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1049.079647] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] NeedRegenerationException {{(pid=69980) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1049.079647] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] no value, waiting for create lock {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1049.079647] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] value creation lock acquired {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1049.079647] env[69980]: DEBUG dogpile.cache.region [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] No value present for key: 'zone-id' {{(pid=69980) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1049.079829] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Calling creation function for not-yet-present value {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1049.080831] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1049.097758] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1049.097758] env[69980]: DEBUG dogpile.cache.region [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=69980) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1049.097758] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Released creation lock {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1049.098057] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "network-803" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.098439] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock port-7cf44972-f8fb-4fbb-96be-9c517695d8f2 taken with stack trace [, , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.099191] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "port-7cf44972-f8fb-4fbb-96be-9c517695d8f2" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.099191] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "port-7cf44972-f8fb-4fbb-96be-9c517695d8f2" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.099191] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "port-7cf44972-f8fb-4fbb-96be-9c517695d8f2" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.099388] env[69980]: DEBUG networking_nsxv3.api.rpc [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7cf44972-f8fb-4fbb-96be-9c517695d8f2',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1049.293982] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.293982] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.293982] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.293982] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.293982] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.293982] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.293982] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.294416] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.294416] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.294416] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.294544] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b258b5de-7d19-4a1e-b1cf-37eaaefe0a00 already deleted. [ 1049.294618] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b258b5de-7d19-4a1e-b1cf-37eaaefe0a00" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.361228] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 194841ae-0965-407f-a2bf-6d1f7693c801 in Status: SUCCESS [ 1049.361483] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-194841ae-0965-407f-a2bf-6d1f7693c801" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.361672] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-194841ae-0965-407f-a2bf-6d1f7693c801" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.361933] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-194841ae-0965-407f-a2bf-6d1f7693c801" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.362158] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.362281] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.362342] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.362619] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.362685] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.362725] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-194841ae-0965-407f-a2bf-6d1f7693c801" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.362914] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('194841ae-0965-407f-a2bf-6d1f7693c801',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1049.390660] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d53aff15-d6ed-495c-9f29-fdc03bd13622',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1049.602869] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.603143] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.603534] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.603607] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.603714] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.603970] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Segment Port 7cf44972-f8fb-4fbb-96be-9c517695d8f2 not found, creating... [ 1049.604188] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.604467] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.604703] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.605055] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.605311] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.605705] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.605880] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.606014] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.606250] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.606447] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.606637] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Resource: SegmentPort with ID: 7cf44972-f8fb-4fbb-96be-9c517695d8f2 is going to be created. [ 1049.625197] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.625474] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.625663] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.625945] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.626348] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.626615] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "port-7cf44972-f8fb-4fbb-96be-9c517695d8f2" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.642744] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4eb0fe0d-cd04-4189-9b26-953ab87885bd in Status: SUCCESS [ 1049.642989] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4eb0fe0d-cd04-4189-9b26-953ab87885bd" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.865842] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('194841ae-0965-407f-a2bf-6d1f7693c801',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1049.894254] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d53aff15-d6ed-495c-9f29-fdc03bd13622',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1050.369029] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 194841ae-0965-407f-a2bf-6d1f7693c801: rpc.has_security_group_logging(os_id): False [ 1050.386341] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.386491] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.386561] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.386776] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.386866] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.387128] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.387225] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.387301] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.387481] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.387563] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.387650] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 194841ae-0965-407f-a2bf-6d1f7693c801 is going to be created. [ 1050.400811] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.400951] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.401022] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.401224] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.401300] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.401393] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d53aff15-d6ed-495c-9f29-fdc03bd13622 is going to be updated. [ 1050.424176] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.424383] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.424383] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.424595] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.424740] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.437162] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d53aff15-d6ed-495c-9f29-fdc03bd13622 in Status: IN_PROGRESS for 2s [ 1050.448629] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.448782] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.448849] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.449091] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.449294] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.458439] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 194841ae-0965-407f-a2bf-6d1f7693c801 in Status: IN_PROGRESS for 2s [ 1050.528587] env[69980]: INFO networking_nsxv3.common.synchronization [req-d433e262-29f2-4b47-b3d5-5174bf64330b req-76103716-6787-4cca-b1a7-2a73a786c857 service nova] Enqueued Resource ID: b258b5de-7d19-4a1e-b1cf-37eaaefe0a00 with Priority: HIGHEST for action security_group_rules [ 1050.528782] env[69980]: INFO networking_nsxv3.common.synchronization [req-d433e262-29f2-4b47-b3d5-5174bf64330b req-76103716-6787-4cca-b1a7-2a73a786c857 service nova] Enqueued Resource ID: b258b5de-7d19-4a1e-b1cf-37eaaefe0a00 with Priority: HIGHEST for action security_group_members [ 1050.528918] env[69980]: INFO networking_nsxv3.common.synchronization [req-d433e262-29f2-4b47-b3d5-5174bf64330b req-76103716-6787-4cca-b1a7-2a73a786c857 service nova] Enqueued Resource ID: 7cf44972-f8fb-4fbb-96be-9c517695d8f2 with Priority: HIGHEST for action port [ 1050.529466] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b258b5de-7d19-4a1e-b1cf-37eaaefe0a00 with Priority: HIGHEST for action security_group_rules [ 1050.529597] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b258b5de-7d19-4a1e-b1cf-37eaaefe0a00 with Priority: HIGHEST for action security_group_members [ 1050.529693] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7cf44972-f8fb-4fbb-96be-9c517695d8f2 with Priority: HIGHEST for action port [ 1050.529982] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b258b5de-7d19-4a1e-b1cf-37eaaefe0a00 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.530144] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b258b5de-7d19-4a1e-b1cf-37eaaefe0a00" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.530261] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b258b5de-7d19-4a1e-b1cf-37eaaefe0a00" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.530462] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b258b5de-7d19-4a1e-b1cf-37eaaefe0a00" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.530535] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b258b5de-7d19-4a1e-b1cf-37eaaefe0a00',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1050.531383] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-b258b5de-7d19-4a1e-b1cf-37eaaefe0a00 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.531497] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b258b5de-7d19-4a1e-b1cf-37eaaefe0a00" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.531568] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b258b5de-7d19-4a1e-b1cf-37eaaefe0a00" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.531732] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b258b5de-7d19-4a1e-b1cf-37eaaefe0a00" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.531884] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.531980] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.532071] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.532304] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.532304] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.532370] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b258b5de-7d19-4a1e-b1cf-37eaaefe0a00',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1050.534141] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock port-7cf44972-f8fb-4fbb-96be-9c517695d8f2 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.534249] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7cf44972-f8fb-4fbb-96be-9c517695d8f2" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.534317] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7cf44972-f8fb-4fbb-96be-9c517695d8f2" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.534484] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7cf44972-f8fb-4fbb-96be-9c517695d8f2" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.534562] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7cf44972-f8fb-4fbb-96be-9c517695d8f2',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1050.897885] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e63cb46c-ccab-4856-bf25-2380514e2780 in Status: SUCCESS [ 1050.897885] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e63cb46c-ccab-4856-bf25-2380514e2780" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.897885] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e63cb46c-ccab-4856-bf25-2380514e2780" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.897885] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e63cb46c-ccab-4856-bf25-2380514e2780" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.897885] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.897885] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.897885] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.897885] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.897885] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.897885] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e63cb46c-ccab-4856-bf25-2380514e2780" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.897885] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e63cb46c-ccab-4856-bf25-2380514e2780',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1051.037460] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-b258b5de-7d19-4a1e-b1cf-37eaaefe0a00 taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.037460] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b258b5de-7d19-4a1e-b1cf-37eaaefe0a00" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.037460] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b258b5de-7d19-4a1e-b1cf-37eaaefe0a00',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1051.038652] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 7cf44972-f8fb-4fbb-96be-9c517695d8f2 with status ACTIVE [ 1051.039010] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.041448] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.041448] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.041448] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.041448] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.041448] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.041448] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.041448] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.041448] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.041448] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.041448] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.041448] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.041448] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.041448] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.041448] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.041448] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 7cf44972-f8fb-4fbb-96be-9c517695d8f2 is going to be updated. [ 1051.063749] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.063749] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.063749] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.063749] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.063749] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.063749] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7cf44972-f8fb-4fbb-96be-9c517695d8f2" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.399888] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-e63cb46c-ccab-4856-bf25-2380514e2780 taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.400094] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e63cb46c-ccab-4856-bf25-2380514e2780" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.400153] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e63cb46c-ccab-4856-bf25-2380514e2780" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.400347] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e63cb46c-ccab-4856-bf25-2380514e2780" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.400521] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.400614] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.400666] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.400823] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.400901] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.400983] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e63cb46c-ccab-4856-bf25-2380514e2780" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.401149] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-e63cb46c-ccab-4856-bf25-2380514e2780 taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.401246] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e63cb46c-ccab-4856-bf25-2380514e2780" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.401318] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e63cb46c-ccab-4856-bf25-2380514e2780" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.401435] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e63cb46c-ccab-4856-bf25-2380514e2780" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.401593] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.401695] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.401750] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.401889] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.401961] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.402052] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e63cb46c-ccab-4856-bf25-2380514e2780" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.402130] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e63cb46c-ccab-4856-bf25-2380514e2780',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1051.540481] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b258b5de-7d19-4a1e-b1cf-37eaaefe0a00',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1051.904300] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e63cb46c-ccab-4856-bf25-2380514e2780: rpc.has_security_group_logging(os_id): False [ 1051.922111] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.922287] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.922371] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.922668] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.922812] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.923134] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.923258] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.923331] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.923510] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.923592] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.923819] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.923925] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.923993] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.924161] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.924239] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.924419] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.924513] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.924572] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.924876] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.924876] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.924876] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e63cb46c-ccab-4856-bf25-2380514e2780 is going to be created. [ 1051.976148] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.977238] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.977238] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.977238] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.977238] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.986913] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e63cb46c-ccab-4856-bf25-2380514e2780 in Status: IN_PROGRESS for 2s [ 1052.042553] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.042721] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.042793] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.043059] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.043164] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.043267] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b258b5de-7d19-4a1e-b1cf-37eaaefe0a00 is going to be created. [ 1052.083267] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.083455] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.083520] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.083689] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.083845] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.104023] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b258b5de-7d19-4a1e-b1cf-37eaaefe0a00 in Status: UNINITIALIZED for 2s [ 1052.448206] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d53aff15-d6ed-495c-9f29-fdc03bd13622 in Status: SUCCESS [ 1052.448438] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d53aff15-d6ed-495c-9f29-fdc03bd13622" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.448614] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d53aff15-d6ed-495c-9f29-fdc03bd13622" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.448849] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d53aff15-d6ed-495c-9f29-fdc03bd13622" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.449113] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.449214] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.449269] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.449414] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.449481] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.449567] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d53aff15-d6ed-495c-9f29-fdc03bd13622" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.449664] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d53aff15-d6ed-495c-9f29-fdc03bd13622',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1052.468952] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 194841ae-0965-407f-a2bf-6d1f7693c801 in Status: SUCCESS [ 1052.469276] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-194841ae-0965-407f-a2bf-6d1f7693c801" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.953498] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-d53aff15-d6ed-495c-9f29-fdc03bd13622 taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.954522] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d53aff15-d6ed-495c-9f29-fdc03bd13622" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.954739] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d53aff15-d6ed-495c-9f29-fdc03bd13622" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.955025] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d53aff15-d6ed-495c-9f29-fdc03bd13622" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.955483] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.955648] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.955750] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.956074] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.956298] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.956457] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d53aff15-d6ed-495c-9f29-fdc03bd13622" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.956624] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-d53aff15-d6ed-495c-9f29-fdc03bd13622 taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.956718] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d53aff15-d6ed-495c-9f29-fdc03bd13622" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.956795] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d53aff15-d6ed-495c-9f29-fdc03bd13622" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.956921] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d53aff15-d6ed-495c-9f29-fdc03bd13622" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.957125] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.957221] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.957280] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.957432] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.957509] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.957583] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d53aff15-d6ed-495c-9f29-fdc03bd13622" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.957727] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d53aff15-d6ed-495c-9f29-fdc03bd13622',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1053.410681] env[69980]: INFO networking_nsxv3.common.synchronization [req-cf01bd1c-a000-47c6-a656-93fa0c5e5576 req-67c60b8b-f110-441f-a800-2118c78e788d tempest-DeleteServersTestJSON-1084822395 tempest-DeleteServersTestJSON-1084822395-project-member] Enqueued Resource ID: d0e04be7-8718-489c-8ceb-fe661da4855a with Priority: HIGHEST for action security_group_members [ 1053.411303] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d0e04be7-8718-489c-8ceb-fe661da4855a with Priority: HIGHEST for action security_group_members [ 1053.411626] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-d0e04be7-8718-489c-8ceb-fe661da4855a taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.412061] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d0e04be7-8718-489c-8ceb-fe661da4855a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.412061] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d0e04be7-8718-489c-8ceb-fe661da4855a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.412061] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d0e04be7-8718-489c-8ceb-fe661da4855a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.413463] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.413463] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.413463] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.413463] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.413463] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.413463] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d0e04be7-8718-489c-8ceb-fe661da4855a',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1053.460790] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d53aff15-d6ed-495c-9f29-fdc03bd13622: rpc.has_security_group_logging(os_id): False [ 1053.477591] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.477786] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.477847] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.478019] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.478359] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.478359] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.478521] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.478521] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.478629] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.478712] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.478913] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.479017] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.479084] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.479246] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.479323] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.479514] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.479611] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.479666] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.479806] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.479881] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.479963] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d53aff15-d6ed-495c-9f29-fdc03bd13622 is going to be updated. [ 1053.523648] env[69980]: INFO networking_nsxv3.common.synchronization [None req-c60b1ca7-46b7-4270-a46c-d36fa6dab50c tempest-ServerDiskConfigTestJSON-214268531 tempest-ServerDiskConfigTestJSON-214268531-project-member] Enqueued Resource ID: 1290c844-10bc-401c-880f-ca9832281871 with Priority: HIGHEST for action security_group_rules [ 1053.524232] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1290c844-10bc-401c-880f-ca9832281871 with Priority: HIGHEST for action security_group_rules [ 1053.524489] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1290c844-10bc-401c-880f-ca9832281871 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.524615] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1290c844-10bc-401c-880f-ca9832281871" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.524684] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1290c844-10bc-401c-880f-ca9832281871" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.525556] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1290c844-10bc-401c-880f-ca9832281871" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.525875] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1290c844-10bc-401c-880f-ca9832281871',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1053.613082] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.613274] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.613391] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.613786] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.613786] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.626257] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d53aff15-d6ed-495c-9f29-fdc03bd13622 in Status: IN_PROGRESS for 2s [ 1053.704596] env[69980]: INFO networking_nsxv3.common.synchronization [None req-f117c5bf-0313-4539-8039-12dd8221bcd0 tempest-ServerDiskConfigTestJSON-214268531 tempest-ServerDiskConfigTestJSON-214268531-project-member] Enqueued Resource ID: 1290c844-10bc-401c-880f-ca9832281871 with Priority: HIGHEST for action security_group_rules [ 1053.704596] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1290c844-10bc-401c-880f-ca9832281871 with Priority: HIGHEST for action security_group_rules [ 1053.704596] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1290c844-10bc-401c-880f-ca9832281871 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.704596] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1290c844-10bc-401c-880f-ca9832281871" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.915790] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.915790] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.915790] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.916043] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.917031] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.917031] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.917031] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.917031] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.917031] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.917031] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.917031] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d0e04be7-8718-489c-8ceb-fe661da4855a is going to be updated. [ 1053.942073] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.942249] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.942318] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.942543] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.942691] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.951165] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d0e04be7-8718-489c-8ceb-fe661da4855a in Status: IN_PROGRESS for 2s [ 1054.000400] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e63cb46c-ccab-4856-bf25-2380514e2780 in Status: SUCCESS [ 1054.000703] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e63cb46c-ccab-4856-bf25-2380514e2780" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.044966] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.044966] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.044966] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.044966] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.044966] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.044966] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1290c844-10bc-401c-880f-ca9832281871 already deleted. [ 1054.045331] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1290c844-10bc-401c-880f-ca9832281871" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.045331] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1290c844-10bc-401c-880f-ca9832281871" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.045593] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1290c844-10bc-401c-880f-ca9832281871" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.045593] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1290c844-10bc-401c-880f-ca9832281871',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1054.114726] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b258b5de-7d19-4a1e-b1cf-37eaaefe0a00 in Status: SUCCESS [ 1054.114994] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b258b5de-7d19-4a1e-b1cf-37eaaefe0a00" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.115219] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b258b5de-7d19-4a1e-b1cf-37eaaefe0a00" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.115467] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b258b5de-7d19-4a1e-b1cf-37eaaefe0a00" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.115698] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.115805] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.115872] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.116048] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.116149] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.116273] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b258b5de-7d19-4a1e-b1cf-37eaaefe0a00" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.116376] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b258b5de-7d19-4a1e-b1cf-37eaaefe0a00',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1054.569161] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.569161] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.569161] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.569161] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.569161] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.569161] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1290c844-10bc-401c-880f-ca9832281871 already deleted. [ 1054.569161] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1290c844-10bc-401c-880f-ca9832281871" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.619139] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-b258b5de-7d19-4a1e-b1cf-37eaaefe0a00 taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.619301] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b258b5de-7d19-4a1e-b1cf-37eaaefe0a00" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.619374] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b258b5de-7d19-4a1e-b1cf-37eaaefe0a00" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.619579] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b258b5de-7d19-4a1e-b1cf-37eaaefe0a00" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.621191] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.621191] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.621191] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.621191] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.621191] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.621191] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b258b5de-7d19-4a1e-b1cf-37eaaefe0a00" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.621191] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-b258b5de-7d19-4a1e-b1cf-37eaaefe0a00 taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.621191] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b258b5de-7d19-4a1e-b1cf-37eaaefe0a00" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.621191] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b258b5de-7d19-4a1e-b1cf-37eaaefe0a00" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.621191] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b258b5de-7d19-4a1e-b1cf-37eaaefe0a00" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.621191] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.621191] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.621191] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.621191] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.621191] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.621191] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b258b5de-7d19-4a1e-b1cf-37eaaefe0a00" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.622019] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b258b5de-7d19-4a1e-b1cf-37eaaefe0a00',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1055.128301] env[69980]: INFO networking_nsxv3.common.synchronization [req-120ba44a-0559-4834-9068-319918bdbc25 req-78be43f8-0599-46d7-9f2f-3cf9bc9e06c5 tempest-InstanceActionsTestJSON-709991009 tempest-InstanceActionsTestJSON-709991009-project-member] Enqueued Resource ID: 4191fccf-dc75-4be2-9ec5-2d6447dbdbd8 with Priority: HIGHEST for action security_group_members [ 1055.128596] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b258b5de-7d19-4a1e-b1cf-37eaaefe0a00: rpc.has_security_group_logging(os_id): False [ 1055.130840] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4191fccf-dc75-4be2-9ec5-2d6447dbdbd8 with Priority: HIGHEST for action security_group_members [ 1055.132919] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-4191fccf-dc75-4be2-9ec5-2d6447dbdbd8 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.133194] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4191fccf-dc75-4be2-9ec5-2d6447dbdbd8" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.133383] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4191fccf-dc75-4be2-9ec5-2d6447dbdbd8" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.133672] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4191fccf-dc75-4be2-9ec5-2d6447dbdbd8" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.133969] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.134257] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.134456] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.134679] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.134908] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.135059] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4191fccf-dc75-4be2-9ec5-2d6447dbdbd8',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1055.155038] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.155038] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.155038] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.155038] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.155038] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.155038] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.155038] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.155038] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.155038] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.155038] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.155038] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.155038] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.155038] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.155583] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.155583] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.155583] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.155693] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.155798] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.155967] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.155967] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.156181] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b258b5de-7d19-4a1e-b1cf-37eaaefe0a00 is going to be created. [ 1055.212530] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.212662] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.212662] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.212873] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.213060] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.249316] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b258b5de-7d19-4a1e-b1cf-37eaaefe0a00 in Status: IN_PROGRESS for 2s [ 1055.639110] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.639303] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.639303] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.641219] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.641219] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.641219] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.641219] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.641219] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.641219] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.641219] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.641219] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4191fccf-dc75-4be2-9ec5-2d6447dbdbd8 already deleted. [ 1055.641219] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4191fccf-dc75-4be2-9ec5-2d6447dbdbd8" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.644935] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d53aff15-d6ed-495c-9f29-fdc03bd13622 in Status: SUCCESS [ 1055.645090] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d53aff15-d6ed-495c-9f29-fdc03bd13622" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.960473] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d0e04be7-8718-489c-8ceb-fe661da4855a in Status: SUCCESS [ 1055.960670] env[69980]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d0e04be7-8718-489c-8ceb-fe661da4855a deletion is rescheduled due to dependency. [ 1055.960791] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d0e04be7-8718-489c-8ceb-fe661da4855a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.109341] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock network-851 taken with stack trace [, , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.109832] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "network-851" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.109832] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "network-851" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.110133] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "network-851" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.110427] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.110646] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.110732] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.110984] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.115067] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.115347] env[69980]: DEBUG dogpile.cache.region [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] No value present for key: 'zone-id' {{(pid=69980) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1056.116929] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] NeedRegenerationException {{(pid=69980) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1056.117300] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] no value, waiting for create lock {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1056.117300] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] value creation lock acquired {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1056.117410] env[69980]: DEBUG dogpile.cache.region [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] No value present for key: 'zone-id' {{(pid=69980) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1056.117571] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Calling creation function for not-yet-present value {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1056.117737] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1056.138641] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1056.138945] env[69980]: DEBUG dogpile.cache.region [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=69980) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1056.139095] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Released creation lock {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1056.139354] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "network-851" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.139709] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock port-5100e520-3c54-4e53-a8a9-9c7e9d97069e taken with stack trace [, , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.140023] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "port-5100e520-3c54-4e53-a8a9-9c7e9d97069e" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.140150] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "port-5100e520-3c54-4e53-a8a9-9c7e9d97069e" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.141393] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "port-5100e520-3c54-4e53-a8a9-9c7e9d97069e" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.141393] env[69980]: DEBUG networking_nsxv3.api.rpc [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5100e520-3c54-4e53-a8a9-9c7e9d97069e',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1056.644934] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.645240] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.645383] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.645662] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.645835] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.646018] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Segment Port 5100e520-3c54-4e53-a8a9-9c7e9d97069e not found, creating... [ 1056.646372] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.646732] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.646937] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.647330] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.647428] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.647779] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.648015] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.648142] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.648413] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.648566] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.648714] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Resource: SegmentPort with ID: 5100e520-3c54-4e53-a8a9-9c7e9d97069e is going to be created. [ 1056.670425] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.670743] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.670878] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.671203] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.671479] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.671754] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "port-5100e520-3c54-4e53-a8a9-9c7e9d97069e" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.262513] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b258b5de-7d19-4a1e-b1cf-37eaaefe0a00 in Status: SUCCESS [ 1057.262851] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b258b5de-7d19-4a1e-b1cf-37eaaefe0a00" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.444855] env[69980]: INFO networking_nsxv3.common.synchronization [req-3a57e53c-5720-4b57-a284-c5991a51662a req-b2fb5ab5-4d4c-44ef-8a15-b5b5216268b3 tempest-ServerDiskConfigTestJSON-214268531 tempest-ServerDiskConfigTestJSON-214268531-project-member] Enqueued Resource ID: 0dbf2bcd-0572-43ef-b18d-cc3cca7fcfd5 with Priority: HIGHEST for action security_group_members [ 1057.445437] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0dbf2bcd-0572-43ef-b18d-cc3cca7fcfd5 with Priority: HIGHEST for action security_group_members [ 1057.446238] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-0dbf2bcd-0572-43ef-b18d-cc3cca7fcfd5 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.446238] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0dbf2bcd-0572-43ef-b18d-cc3cca7fcfd5" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.446238] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0dbf2bcd-0572-43ef-b18d-cc3cca7fcfd5" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.446510] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0dbf2bcd-0572-43ef-b18d-cc3cca7fcfd5" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.446510] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.446625] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.446625] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.446777] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.446862] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.446954] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0dbf2bcd-0572-43ef-b18d-cc3cca7fcfd5',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1057.553543] env[69980]: INFO networking_nsxv3.common.synchronization [req-120ba44a-0559-4834-9068-319918bdbc25 req-a5744d5c-9e8e-4fe7-96b6-949ad02cd479 service nova] Enqueued Resource ID: 4191fccf-dc75-4be2-9ec5-2d6447dbdbd8 with Priority: HIGHEST for action security_group_rules [ 1057.553832] env[69980]: INFO networking_nsxv3.common.synchronization [req-120ba44a-0559-4834-9068-319918bdbc25 req-a5744d5c-9e8e-4fe7-96b6-949ad02cd479 service nova] Enqueued Resource ID: 4191fccf-dc75-4be2-9ec5-2d6447dbdbd8 with Priority: HIGHEST for action security_group_members [ 1057.554988] env[69980]: INFO networking_nsxv3.common.synchronization [req-120ba44a-0559-4834-9068-319918bdbc25 req-a5744d5c-9e8e-4fe7-96b6-949ad02cd479 service nova] Enqueued Resource ID: 5100e520-3c54-4e53-a8a9-9c7e9d97069e with Priority: HIGHEST for action port [ 1057.555799] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4191fccf-dc75-4be2-9ec5-2d6447dbdbd8 with Priority: HIGHEST for action security_group_rules [ 1057.556024] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4191fccf-dc75-4be2-9ec5-2d6447dbdbd8 with Priority: HIGHEST for action security_group_members [ 1057.556200] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5100e520-3c54-4e53-a8a9-9c7e9d97069e with Priority: HIGHEST for action port [ 1057.556560] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4191fccf-dc75-4be2-9ec5-2d6447dbdbd8 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.556689] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4191fccf-dc75-4be2-9ec5-2d6447dbdbd8" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.556799] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4191fccf-dc75-4be2-9ec5-2d6447dbdbd8" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.557169] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4191fccf-dc75-4be2-9ec5-2d6447dbdbd8" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.557223] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4191fccf-dc75-4be2-9ec5-2d6447dbdbd8',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1057.558133] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-4191fccf-dc75-4be2-9ec5-2d6447dbdbd8 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.558296] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4191fccf-dc75-4be2-9ec5-2d6447dbdbd8" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.558395] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4191fccf-dc75-4be2-9ec5-2d6447dbdbd8" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.558477] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4191fccf-dc75-4be2-9ec5-2d6447dbdbd8" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.559434] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.559434] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.559434] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.559434] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.559434] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.559434] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4191fccf-dc75-4be2-9ec5-2d6447dbdbd8',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1057.560500] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock port-5100e520-3c54-4e53-a8a9-9c7e9d97069e taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.560642] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5100e520-3c54-4e53-a8a9-9c7e9d97069e" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.560642] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5100e520-3c54-4e53-a8a9-9c7e9d97069e" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.561364] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5100e520-3c54-4e53-a8a9-9c7e9d97069e" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.561364] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5100e520-3c54-4e53-a8a9-9c7e9d97069e',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1057.950009] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.950187] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.950262] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.950554] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.950705] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.950917] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.951066] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.951141] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.951321] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.951405] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.951505] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0dbf2bcd-0572-43ef-b18d-cc3cca7fcfd5 is going to be updated. [ 1057.975814] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.975936] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.976016] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.977082] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.977082] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.991085] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0dbf2bcd-0572-43ef-b18d-cc3cca7fcfd5 in Status: IN_PROGRESS for 2s [ 1058.062745] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-4191fccf-dc75-4be2-9ec5-2d6447dbdbd8 taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.062882] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4191fccf-dc75-4be2-9ec5-2d6447dbdbd8" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.064676] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4191fccf-dc75-4be2-9ec5-2d6447dbdbd8',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1058.064676] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 5100e520-3c54-4e53-a8a9-9c7e9d97069e with status ACTIVE [ 1058.064676] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.064676] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.064676] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.065104] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.065284] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.065780] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.065780] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.065906] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.066479] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.066479] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.066479] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.066633] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.066633] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.066844] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.067907] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.067907] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 5100e520-3c54-4e53-a8a9-9c7e9d97069e is going to be updated. [ 1058.102030] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.102178] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.102244] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.102470] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.102579] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.102742] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5100e520-3c54-4e53-a8a9-9c7e9d97069e" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.570137] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4191fccf-dc75-4be2-9ec5-2d6447dbdbd8',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1059.072657] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.072822] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.072897] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.073151] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.073269] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.073377] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4191fccf-dc75-4be2-9ec5-2d6447dbdbd8 is going to be created. [ 1059.095272] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.095429] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.095513] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.095727] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.095886] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.104434] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4191fccf-dc75-4be2-9ec5-2d6447dbdbd8 in Status: UNINITIALIZED for 2s [ 1059.998680] env[69980]: INFO networking_nsxv3.common.synchronization [req-e1cc6aee-9dd6-421c-a3f1-9439ca9eab9b req-576646fd-774e-4e7b-a104-b95c21311b5f tempest-ImagesOneServerNegativeTestJSON-332667785 tempest-ImagesOneServerNegativeTestJSON-332667785-project-member] Enqueued Resource ID: d53aff15-d6ed-495c-9f29-fdc03bd13622 with Priority: HIGHEST for action security_group_members [ 1059.999381] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d53aff15-d6ed-495c-9f29-fdc03bd13622 with Priority: HIGHEST for action security_group_members [ 1059.999789] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-d53aff15-d6ed-495c-9f29-fdc03bd13622 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.999921] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d53aff15-d6ed-495c-9f29-fdc03bd13622" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.999989] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d53aff15-d6ed-495c-9f29-fdc03bd13622" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.000213] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d53aff15-d6ed-495c-9f29-fdc03bd13622" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.000366] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.000467] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.000536] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.000686] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.000769] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.000859] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d53aff15-d6ed-495c-9f29-fdc03bd13622',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1060.003996] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0dbf2bcd-0572-43ef-b18d-cc3cca7fcfd5 in Status: SUCCESS [ 1060.003996] env[69980]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0dbf2bcd-0572-43ef-b18d-cc3cca7fcfd5 deletion is rescheduled due to dependency. [ 1060.003996] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0dbf2bcd-0572-43ef-b18d-cc3cca7fcfd5" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.504049] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.504235] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.504325] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.504564] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.504663] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.504879] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.504980] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.505071] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.505322] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.505427] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.505519] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d53aff15-d6ed-495c-9f29-fdc03bd13622 is going to be updated. [ 1060.534464] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.534656] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.534703] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.534949] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.535138] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.543945] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d53aff15-d6ed-495c-9f29-fdc03bd13622 in Status: IN_PROGRESS for 2s [ 1061.114616] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4191fccf-dc75-4be2-9ec5-2d6447dbdbd8 in Status: SUCCESS [ 1061.114914] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4191fccf-dc75-4be2-9ec5-2d6447dbdbd8" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.115150] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4191fccf-dc75-4be2-9ec5-2d6447dbdbd8" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.115455] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4191fccf-dc75-4be2-9ec5-2d6447dbdbd8" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.115708] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.115871] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.115963] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.116149] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.116287] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.116361] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4191fccf-dc75-4be2-9ec5-2d6447dbdbd8" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.116417] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('4191fccf-dc75-4be2-9ec5-2d6447dbdbd8',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1061.271693] env[69980]: INFO networking_nsxv3.common.synchronization [req-47cdd48d-90b2-4ac0-9e50-a19b9fb86121 req-56b0698d-88ba-4ac3-97a1-de3ebb3222d7 tempest-AttachInterfacesTestJSON-1782090316 tempest-AttachInterfacesTestJSON-1782090316-project-member] Enqueued Resource ID: e63cb46c-ccab-4856-bf25-2380514e2780 with Priority: HIGHEST for action security_group_members [ 1061.271830] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e63cb46c-ccab-4856-bf25-2380514e2780 with Priority: HIGHEST for action security_group_members [ 1061.272071] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-e63cb46c-ccab-4856-bf25-2380514e2780 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.272203] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e63cb46c-ccab-4856-bf25-2380514e2780" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.272268] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e63cb46c-ccab-4856-bf25-2380514e2780" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.273030] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e63cb46c-ccab-4856-bf25-2380514e2780" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.273030] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.273030] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.273030] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.273289] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.273387] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.273482] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e63cb46c-ccab-4856-bf25-2380514e2780',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1061.619253] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-4191fccf-dc75-4be2-9ec5-2d6447dbdbd8 taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.619426] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4191fccf-dc75-4be2-9ec5-2d6447dbdbd8" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.619509] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4191fccf-dc75-4be2-9ec5-2d6447dbdbd8" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.620938] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4191fccf-dc75-4be2-9ec5-2d6447dbdbd8" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.620938] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.620938] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.620938] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.620938] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.620938] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.620938] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4191fccf-dc75-4be2-9ec5-2d6447dbdbd8" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.620938] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-4191fccf-dc75-4be2-9ec5-2d6447dbdbd8 taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.620938] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4191fccf-dc75-4be2-9ec5-2d6447dbdbd8" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.620938] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4191fccf-dc75-4be2-9ec5-2d6447dbdbd8" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.620938] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4191fccf-dc75-4be2-9ec5-2d6447dbdbd8" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.621579] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.621579] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.621579] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.621579] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.621579] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.621579] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4191fccf-dc75-4be2-9ec5-2d6447dbdbd8" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.621865] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('4191fccf-dc75-4be2-9ec5-2d6447dbdbd8',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1061.775507] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.775670] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.775742] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.775952] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.776055] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.776257] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.776367] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.776428] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.776625] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.776692] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.776778] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e63cb46c-ccab-4856-bf25-2380514e2780 is going to be updated. [ 1061.803766] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.803912] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.804009] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.804235] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.804372] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.812677] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e63cb46c-ccab-4856-bf25-2380514e2780 in Status: IN_PROGRESS for 2s [ 1062.124280] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 4191fccf-dc75-4be2-9ec5-2d6447dbdbd8: rpc.has_security_group_logging(os_id): False [ 1062.146023] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.146023] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.146023] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.146023] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.146023] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.146023] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.146023] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.146023] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.146023] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.146023] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.146023] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.146023] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.146023] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.146023] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.146023] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.146815] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.146815] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.146815] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.146815] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.146815] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.146815] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4191fccf-dc75-4be2-9ec5-2d6447dbdbd8 is going to be created. [ 1062.203664] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.203664] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.203664] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.203664] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.203664] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.213168] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4191fccf-dc75-4be2-9ec5-2d6447dbdbd8 in Status: IN_PROGRESS for 2s [ 1062.279237] env[69980]: INFO networking_nsxv3.common.synchronization [req-7ac4a25f-0a0c-4ec8-a3cf-800360d39fdd req-d6702829-852c-4c46-a111-70a58076a758 tempest-ServerPasswordTestJSON-1228267695 tempest-ServerPasswordTestJSON-1228267695-project-member] Enqueued Resource ID: b258b5de-7d19-4a1e-b1cf-37eaaefe0a00 with Priority: HIGHEST for action security_group_members [ 1062.279237] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b258b5de-7d19-4a1e-b1cf-37eaaefe0a00 with Priority: HIGHEST for action security_group_members [ 1062.279237] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-b258b5de-7d19-4a1e-b1cf-37eaaefe0a00 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.279237] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b258b5de-7d19-4a1e-b1cf-37eaaefe0a00" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.279237] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b258b5de-7d19-4a1e-b1cf-37eaaefe0a00" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.279237] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b258b5de-7d19-4a1e-b1cf-37eaaefe0a00" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.280445] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.280600] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.280766] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.280988] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.281162] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.281280] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b258b5de-7d19-4a1e-b1cf-37eaaefe0a00',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1062.556167] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d53aff15-d6ed-495c-9f29-fdc03bd13622 in Status: SUCCESS [ 1062.556167] env[69980]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d53aff15-d6ed-495c-9f29-fdc03bd13622 deletion is rescheduled due to dependency. [ 1062.556167] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d53aff15-d6ed-495c-9f29-fdc03bd13622" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.784320] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.788634] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.788634] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.788634] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.788634] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.788634] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.788634] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.788634] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.788634] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.788634] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.788634] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b258b5de-7d19-4a1e-b1cf-37eaaefe0a00 is going to be updated. [ 1062.813377] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.813536] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.813601] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.813812] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.813956] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.822805] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b258b5de-7d19-4a1e-b1cf-37eaaefe0a00 in Status: IN_PROGRESS for 2s [ 1063.822213] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e63cb46c-ccab-4856-bf25-2380514e2780 in Status: SUCCESS [ 1063.822572] env[69980]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e63cb46c-ccab-4856-bf25-2380514e2780 deletion is rescheduled due to dependency. [ 1063.822572] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e63cb46c-ccab-4856-bf25-2380514e2780" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.228179] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4191fccf-dc75-4be2-9ec5-2d6447dbdbd8 in Status: SUCCESS [ 1064.228802] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4191fccf-dc75-4be2-9ec5-2d6447dbdbd8" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.729445] env[69980]: INFO networking_nsxv3.common.synchronization [req-6fe501d8-004e-4758-b6e4-aeedb8346bec req-dfb172ff-7289-4428-a387-66fdd7d876af tempest-AttachInterfacesTestJSON-1782090316 tempest-AttachInterfacesTestJSON-1782090316-project-member] Enqueued Resource ID: 7f2e833b-9263-48ef-ba09-f0afee0fa4af with Priority: HIGHEST for action security_group_members [ 1064.730012] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7f2e833b-9263-48ef-ba09-f0afee0fa4af with Priority: HIGHEST for action security_group_members [ 1064.730311] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-7f2e833b-9263-48ef-ba09-f0afee0fa4af taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.730437] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7f2e833b-9263-48ef-ba09-f0afee0fa4af" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.730504] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7f2e833b-9263-48ef-ba09-f0afee0fa4af" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.730705] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7f2e833b-9263-48ef-ba09-f0afee0fa4af" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.730857] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.730954] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.731123] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.731293] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.731621] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.731621] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7f2e833b-9263-48ef-ba09-f0afee0fa4af',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1064.832493] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b258b5de-7d19-4a1e-b1cf-37eaaefe0a00 in Status: SUCCESS [ 1064.832840] env[69980]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b258b5de-7d19-4a1e-b1cf-37eaaefe0a00 deletion is rescheduled due to dependency. [ 1064.832840] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b258b5de-7d19-4a1e-b1cf-37eaaefe0a00" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.235402] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.238929] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.239074] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.240821] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.240821] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.240821] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.240821] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.240821] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.240821] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.240821] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.240821] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7f2e833b-9263-48ef-ba09-f0afee0fa4af is going to be updated. [ 1065.294308] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.294677] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.294763] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.294998] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.295174] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.308929] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7f2e833b-9263-48ef-ba09-f0afee0fa4af in Status: IN_PROGRESS for 2s [ 1065.680084] env[69980]: INFO networking_nsxv3.common.synchronization [req-59dc4641-1e14-4e62-bf4e-457e907c7317 req-ae1fbd9d-6aa4-4773-87ae-81e10d8dab54 tempest-ServersAdminTestJSON-1581544378 tempest-ServersAdminTestJSON-1581544378-project-member] Enqueued Resource ID: 700dc02a-f3c2-4363-9a0e-d7cdcb13a5b8 with Priority: HIGHEST for action security_group_members [ 1065.680656] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 700dc02a-f3c2-4363-9a0e-d7cdcb13a5b8 with Priority: HIGHEST for action security_group_members [ 1065.681333] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-700dc02a-f3c2-4363-9a0e-d7cdcb13a5b8 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.681333] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-700dc02a-f3c2-4363-9a0e-d7cdcb13a5b8" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.681333] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-700dc02a-f3c2-4363-9a0e-d7cdcb13a5b8" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.681453] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-700dc02a-f3c2-4363-9a0e-d7cdcb13a5b8" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.681765] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.681765] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.681881] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.681960] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.683339] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.683468] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('700dc02a-f3c2-4363-9a0e-d7cdcb13a5b8',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1066.024235] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock network-278 taken with stack trace [, , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.024525] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "network-278" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.024575] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "network-278" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.024864] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "network-278" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.025150] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.025337] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.025509] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.025766] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.025933] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.027195] env[69980]: DEBUG dogpile.cache.region [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] No value present for key: 'zone-id' {{(pid=69980) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1066.027195] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] NeedRegenerationException {{(pid=69980) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1066.027195] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] no value, waiting for create lock {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1066.027195] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] value creation lock acquired {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1066.027195] env[69980]: DEBUG dogpile.cache.region [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] No value present for key: 'zone-id' {{(pid=69980) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1066.027195] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Calling creation function for not-yet-present value {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1066.027195] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1066.046131] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1066.046386] env[69980]: DEBUG dogpile.cache.region [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=69980) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1066.046579] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Released creation lock {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1066.046774] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "network-278" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.047810] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock port-51de4fcc-04eb-42fa-8638-3547d84351b0 taken with stack trace [, , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.047810] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "port-51de4fcc-04eb-42fa-8638-3547d84351b0" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.047810] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "port-51de4fcc-04eb-42fa-8638-3547d84351b0" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.047810] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "port-51de4fcc-04eb-42fa-8638-3547d84351b0" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.048060] env[69980]: DEBUG networking_nsxv3.api.rpc [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('51de4fcc-04eb-42fa-8638-3547d84351b0',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1066.071016] env[69980]: INFO networking_nsxv3.common.synchronization [None req-6300c13f-dcd0-4ff1-94c7-aa745d450f96 None None] Enqueued Resource ID: f3539598-86c9-427a-8013-dbb7715b4fa5 with Priority: HIGHEST for action port [ 1066.072946] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f3539598-86c9-427a-8013-dbb7715b4fa5 with Priority: HIGHEST for action port [ 1066.072946] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock port-f3539598-86c9-427a-8013-dbb7715b4fa5 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.072946] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f3539598-86c9-427a-8013-dbb7715b4fa5" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.072946] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f3539598-86c9-427a-8013-dbb7715b4fa5" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.072946] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f3539598-86c9-427a-8013-dbb7715b4fa5" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.072946] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f3539598-86c9-427a-8013-dbb7715b4fa5',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1066.186546] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('700dc02a-f3c2-4363-9a0e-d7cdcb13a5b8',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1066.552688] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.553606] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.553847] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.554175] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.554341] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.554659] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.554859] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.554987] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.555272] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.555415] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.555740] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.555952] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.560159] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.560452] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.560623] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.560780] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Resource: SegmentPort with ID: 51de4fcc-04eb-42fa-8638-3547d84351b0 is going to be updated. [ 1066.576632] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f3539598-86c9-427a-8013-dbb7715b4fa5 [ 1066.576872] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.577309] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.577309] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.577441] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.577542] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.577641] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f3539598-86c9-427a-8013-dbb7715b4fa5 already deleted. [ 1066.577721] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f3539598-86c9-427a-8013-dbb7715b4fa5" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.583474] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.583694] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.583822] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.584092] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.584289] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.584522] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "port-51de4fcc-04eb-42fa-8638-3547d84351b0" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.690443] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('700dc02a-f3c2-4363-9a0e-d7cdcb13a5b8',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1067.193549] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.193825] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.193825] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.194092] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.194223] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.194349] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 700dc02a-f3c2-4363-9a0e-d7cdcb13a5b8 is going to be updated. [ 1067.220836] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.221966] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.221966] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.225986] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.225986] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.232119] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 700dc02a-f3c2-4363-9a0e-d7cdcb13a5b8 in Status: IN_PROGRESS for 2s [ 1067.319413] env[69980]: INFO networking_nsxv3.common.synchronization [req-83bd74e2-6c52-4e7c-99f3-bb91aed7fb0a req-76a3cf8f-038e-4036-a687-02b3a3d45f74 service nova] Enqueued Resource ID: f44b2d06-c9ca-4621-a354-74c006769956 with Priority: HIGHEST for action security_group_rules [ 1067.319413] env[69980]: INFO networking_nsxv3.common.synchronization [req-83bd74e2-6c52-4e7c-99f3-bb91aed7fb0a req-76a3cf8f-038e-4036-a687-02b3a3d45f74 service nova] Enqueued Resource ID: f44b2d06-c9ca-4621-a354-74c006769956 with Priority: HIGHEST for action security_group_members [ 1067.319413] env[69980]: INFO networking_nsxv3.common.synchronization [req-83bd74e2-6c52-4e7c-99f3-bb91aed7fb0a req-76a3cf8f-038e-4036-a687-02b3a3d45f74 service nova] Enqueued Resource ID: 51de4fcc-04eb-42fa-8638-3547d84351b0 with Priority: HIGHEST for action port [ 1067.319413] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f44b2d06-c9ca-4621-a354-74c006769956 with Priority: HIGHEST for action security_group_rules [ 1067.319413] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f44b2d06-c9ca-4621-a354-74c006769956 with Priority: HIGHEST for action security_group_members [ 1067.319413] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 51de4fcc-04eb-42fa-8638-3547d84351b0 with Priority: HIGHEST for action port [ 1067.321774] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7f2e833b-9263-48ef-ba09-f0afee0fa4af in Status: SUCCESS [ 1067.321914] env[69980]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7f2e833b-9263-48ef-ba09-f0afee0fa4af deletion is rescheduled due to dependency. [ 1067.321980] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7f2e833b-9263-48ef-ba09-f0afee0fa4af" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.322676] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f44b2d06-c9ca-4621-a354-74c006769956 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.322676] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f44b2d06-c9ca-4621-a354-74c006769956" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.322676] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f44b2d06-c9ca-4621-a354-74c006769956" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.322676] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f44b2d06-c9ca-4621-a354-74c006769956" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.322881] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f44b2d06-c9ca-4621-a354-74c006769956',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1067.323560] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-f44b2d06-c9ca-4621-a354-74c006769956 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.323673] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f44b2d06-c9ca-4621-a354-74c006769956" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.323751] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f44b2d06-c9ca-4621-a354-74c006769956" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.323893] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f44b2d06-c9ca-4621-a354-74c006769956" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.324044] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.324137] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.324198] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.324335] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.324420] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.324524] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f44b2d06-c9ca-4621-a354-74c006769956',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1067.325278] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock port-51de4fcc-04eb-42fa-8638-3547d84351b0 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.325380] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-51de4fcc-04eb-42fa-8638-3547d84351b0" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.325454] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-51de4fcc-04eb-42fa-8638-3547d84351b0" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.325609] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-51de4fcc-04eb-42fa-8638-3547d84351b0" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.325694] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('51de4fcc-04eb-42fa-8638-3547d84351b0',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1067.828563] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f44b2d06-c9ca-4621-a354-74c006769956',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1067.828563] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-f44b2d06-c9ca-4621-a354-74c006769956 taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.828950] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f44b2d06-c9ca-4621-a354-74c006769956" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.830947] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 51de4fcc-04eb-42fa-8638-3547d84351b0 with status ACTIVE [ 1067.831145] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.831265] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.831339] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.831542] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.831634] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.831805] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.831954] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.831954] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.832129] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.836186] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.836436] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.836552] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.836619] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.836776] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.836856] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.836945] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 51de4fcc-04eb-42fa-8638-3547d84351b0 is going to be updated. [ 1067.866349] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.866520] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.866593] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.866806] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.866941] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.867118] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-51de4fcc-04eb-42fa-8638-3547d84351b0" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.878851] env[69980]: INFO networking_nsxv3.common.synchronization [None req-8be24703-5f5f-4789-83ae-2476e220abc6 None None] Enqueued Resource ID: a9938994-bcd3-4baa-8e51-d669b7670f21 with Priority: HIGHEST for action port [ 1067.878851] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a9938994-bcd3-4baa-8e51-d669b7670f21 with Priority: HIGHEST for action port [ 1067.879109] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock port-a9938994-bcd3-4baa-8e51-d669b7670f21 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.879176] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a9938994-bcd3-4baa-8e51-d669b7670f21" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.879725] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a9938994-bcd3-4baa-8e51-d669b7670f21" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.879725] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a9938994-bcd3-4baa-8e51-d669b7670f21" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.881244] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a9938994-bcd3-4baa-8e51-d669b7670f21',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1068.339599] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f44b2d06-c9ca-4621-a354-74c006769956',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1068.384214] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a9938994-bcd3-4baa-8e51-d669b7670f21 [ 1068.384214] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.384214] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.384214] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.384426] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.384426] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.384546] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a9938994-bcd3-4baa-8e51-d669b7670f21 already deleted. [ 1068.384590] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a9938994-bcd3-4baa-8e51-d669b7670f21" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.841988] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.842181] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.842254] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.842463] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.842552] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.842731] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f44b2d06-c9ca-4621-a354-74c006769956 is going to be updated. [ 1068.869205] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.869404] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.869481] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.869698] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.869839] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.878341] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f44b2d06-c9ca-4621-a354-74c006769956 in Status: IN_PROGRESS for 2s [ 1069.241509] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 700dc02a-f3c2-4363-9a0e-d7cdcb13a5b8 in Status: SUCCESS [ 1069.241928] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-700dc02a-f3c2-4363-9a0e-d7cdcb13a5b8" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.825905] env[69980]: INFO networking_nsxv3.common.synchronization [req-b9a5a82b-1d69-4e1e-870a-8b729673d03e req-4d34f03d-840c-4802-85c4-5310dc8ac7d1 tempest-MigrationsAdminTest-1290478568 tempest-MigrationsAdminTest-1290478568-project-member] Enqueued Resource ID: 462431af-62e3-426c-a50e-a61604f20358 with Priority: HIGHEST for action security_group_members [ 1070.827304] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 462431af-62e3-426c-a50e-a61604f20358 with Priority: HIGHEST for action security_group_members [ 1070.827304] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-462431af-62e3-426c-a50e-a61604f20358 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.827304] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-462431af-62e3-426c-a50e-a61604f20358" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.827304] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-462431af-62e3-426c-a50e-a61604f20358" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.827304] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-462431af-62e3-426c-a50e-a61604f20358" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.828087] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.828087] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.828087] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.828258] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.828366] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.828489] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('462431af-62e3-426c-a50e-a61604f20358',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1070.892041] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f44b2d06-c9ca-4621-a354-74c006769956 in Status: SUCCESS [ 1070.892041] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f44b2d06-c9ca-4621-a354-74c006769956" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.892041] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f44b2d06-c9ca-4621-a354-74c006769956" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.892041] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f44b2d06-c9ca-4621-a354-74c006769956" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.892041] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.892041] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.892041] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.892041] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.892041] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.892041] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f44b2d06-c9ca-4621-a354-74c006769956" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.892041] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f44b2d06-c9ca-4621-a354-74c006769956',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1071.331648] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.331876] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.331876] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.332038] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.355836] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.356207] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.356444] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.356553] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.356827] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.357080] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.357165] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 462431af-62e3-426c-a50e-a61604f20358 is going to be updated. [ 1071.381248] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.381525] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.381525] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.382060] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.382176] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.390288] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 462431af-62e3-426c-a50e-a61604f20358 in Status: IN_PROGRESS for 2s [ 1071.395129] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-f44b2d06-c9ca-4621-a354-74c006769956 taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.395420] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f44b2d06-c9ca-4621-a354-74c006769956" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.395420] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f44b2d06-c9ca-4621-a354-74c006769956" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.395777] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f44b2d06-c9ca-4621-a354-74c006769956" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.396106] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.396324] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.396439] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.396814] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.396814] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.396921] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f44b2d06-c9ca-4621-a354-74c006769956" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.397116] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-f44b2d06-c9ca-4621-a354-74c006769956 taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.397254] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f44b2d06-c9ca-4621-a354-74c006769956" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.397343] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f44b2d06-c9ca-4621-a354-74c006769956" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.397559] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f44b2d06-c9ca-4621-a354-74c006769956" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.397717] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.397906] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.398074] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.398358] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.398456] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.398565] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f44b2d06-c9ca-4621-a354-74c006769956" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.398688] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f44b2d06-c9ca-4621-a354-74c006769956',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1071.901069] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f44b2d06-c9ca-4621-a354-74c006769956: rpc.has_security_group_logging(os_id): False [ 1071.919705] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.919850] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.920017] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.920151] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.920341] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.920462] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.920568] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.920691] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.920783] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.920863] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.921072] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.921178] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.921242] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.921386] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.921465] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.921668] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.921762] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.921825] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.921968] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.927789] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.932023] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f44b2d06-c9ca-4621-a354-74c006769956 is going to be updated. [ 1071.999700] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.999885] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.000111] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.000313] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.000487] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.015233] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f44b2d06-c9ca-4621-a354-74c006769956 in Status: IN_PROGRESS for 2s [ 1073.401343] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 462431af-62e3-426c-a50e-a61604f20358 in Status: SUCCESS [ 1073.401703] env[69980]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 462431af-62e3-426c-a50e-a61604f20358 deletion is rescheduled due to dependency. [ 1073.401703] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-462431af-62e3-426c-a50e-a61604f20358" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.030367] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f44b2d06-c9ca-4621-a354-74c006769956 in Status: SUCCESS [ 1074.030688] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f44b2d06-c9ca-4621-a354-74c006769956" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.790477] env[69980]: INFO networking_nsxv3.common.synchronization [req-4294e819-847a-4f3a-be9c-11ad4dbb4a3c req-cc64986a-e0f3-4181-9f1e-4647da56e22d tempest-ServerActionsTestOtherA-1240783872 tempest-ServerActionsTestOtherA-1240783872-project-member] Enqueued Resource ID: 724b248c-fcba-4659-94d6-7aefe563ad89 with Priority: HIGHEST for action security_group_members [ 1074.791065] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 724b248c-fcba-4659-94d6-7aefe563ad89 with Priority: HIGHEST for action security_group_members [ 1074.791372] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-724b248c-fcba-4659-94d6-7aefe563ad89 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.797031] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-724b248c-fcba-4659-94d6-7aefe563ad89" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.797031] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-724b248c-fcba-4659-94d6-7aefe563ad89" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.797031] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-724b248c-fcba-4659-94d6-7aefe563ad89" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.797031] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.797031] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.797031] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.797031] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.797031] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.797031] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('724b248c-fcba-4659-94d6-7aefe563ad89',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1075.241178] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock network-714 taken with stack trace [, , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.241178] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "network-714" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.241178] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "network-714" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.241178] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "network-714" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.241178] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.241178] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.241178] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.241178] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.241178] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.241178] env[69980]: DEBUG dogpile.cache.region [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] No value present for key: 'zone-id' {{(pid=69980) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1075.241178] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] NeedRegenerationException {{(pid=69980) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1075.241178] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] no value, waiting for create lock {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1075.241178] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] value creation lock acquired {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1075.241748] env[69980]: DEBUG dogpile.cache.region [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] No value present for key: 'zone-id' {{(pid=69980) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1075.241748] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Calling creation function for not-yet-present value {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1075.241748] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1075.260496] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1075.260749] env[69980]: DEBUG dogpile.cache.region [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=69980) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1075.260898] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Released creation lock {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1075.261097] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "network-714" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.261517] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock port-c9f8fd8c-d527-4efe-9701-99170ff2ff43 taken with stack trace [, , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.261722] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "port-c9f8fd8c-d527-4efe-9701-99170ff2ff43" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.261939] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "port-c9f8fd8c-d527-4efe-9701-99170ff2ff43" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.262272] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "port-c9f8fd8c-d527-4efe-9701-99170ff2ff43" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.262419] env[69980]: DEBUG networking_nsxv3.api.rpc [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c9f8fd8c-d527-4efe-9701-99170ff2ff43',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1075.274114] env[69980]: INFO networking_nsxv3.common.synchronization [req-382a14d8-a1e2-426d-bd7f-b3f0d013b1bb req-daa641f4-601a-4446-a397-95d96f9faf7e tempest-ImagesTestJSON-600722714 tempest-ImagesTestJSON-600722714-project-member] Enqueued Resource ID: 80e3ea48-91a5-4863-b1c2-f3e887204e39 with Priority: HIGHEST for action security_group_members [ 1075.275497] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 80e3ea48-91a5-4863-b1c2-f3e887204e39 with Priority: HIGHEST for action security_group_members [ 1075.276209] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-80e3ea48-91a5-4863-b1c2-f3e887204e39 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.276426] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-80e3ea48-91a5-4863-b1c2-f3e887204e39" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.276545] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-80e3ea48-91a5-4863-b1c2-f3e887204e39" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.276863] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-80e3ea48-91a5-4863-b1c2-f3e887204e39" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.277166] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.277306] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.277385] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.277946] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.277946] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.277946] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('80e3ea48-91a5-4863-b1c2-f3e887204e39',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1075.299579] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.299740] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.299867] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.300139] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.300245] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.300452] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.300557] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.300668] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.300830] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.300907] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.300995] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 724b248c-fcba-4659-94d6-7aefe563ad89 already deleted. [ 1075.301101] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-724b248c-fcba-4659-94d6-7aefe563ad89" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.764679] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.765350] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.765350] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.765489] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.765623] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.765797] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Segment Port c9f8fd8c-d527-4efe-9701-99170ff2ff43 not found, creating... [ 1075.766082] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.766254] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.766387] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.766654] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.766846] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.767184] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.767377] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.767482] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.767812] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.767904] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.768011] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Resource: SegmentPort with ID: c9f8fd8c-d527-4efe-9701-99170ff2ff43 is going to be created. [ 1075.779915] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.780101] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.780158] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.780370] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.780483] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.780682] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.780780] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.780844] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.781048] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.781088] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.781159] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 80e3ea48-91a5-4863-b1c2-f3e887204e39 is going to be updated. [ 1075.790755] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.791147] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.791147] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.791353] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.791600] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.791870] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "port-c9f8fd8c-d527-4efe-9701-99170ff2ff43" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.808265] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.808382] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.808461] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.808654] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.808816] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.819062] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 80e3ea48-91a5-4863-b1c2-f3e887204e39 in Status: IN_PROGRESS for 2s [ 1076.352956] env[69980]: INFO networking_nsxv3.common.synchronization [req-53798d9f-736d-4c96-ae18-b56729d79181 req-76cbae6a-4b7e-4ba5-988a-7533c2172c60 tempest-InstanceActionsTestJSON-709991009 tempest-InstanceActionsTestJSON-709991009-project-member] Enqueued Resource ID: 4191fccf-dc75-4be2-9ec5-2d6447dbdbd8 with Priority: HIGHEST for action security_group_members [ 1076.352956] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4191fccf-dc75-4be2-9ec5-2d6447dbdbd8 with Priority: HIGHEST for action security_group_members [ 1076.355173] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-4191fccf-dc75-4be2-9ec5-2d6447dbdbd8 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.355353] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4191fccf-dc75-4be2-9ec5-2d6447dbdbd8" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.355407] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4191fccf-dc75-4be2-9ec5-2d6447dbdbd8" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.355611] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4191fccf-dc75-4be2-9ec5-2d6447dbdbd8" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.355775] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.355877] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.355976] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.356187] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.356286] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.356376] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4191fccf-dc75-4be2-9ec5-2d6447dbdbd8',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1076.577960] env[69980]: INFO networking_nsxv3.common.synchronization [req-4294e819-847a-4f3a-be9c-11ad4dbb4a3c req-54347c0d-00af-4836-8bfd-269541372254 service nova] Enqueued Resource ID: 724b248c-fcba-4659-94d6-7aefe563ad89 with Priority: HIGHEST for action security_group_rules [ 1076.577960] env[69980]: INFO networking_nsxv3.common.synchronization [req-4294e819-847a-4f3a-be9c-11ad4dbb4a3c req-54347c0d-00af-4836-8bfd-269541372254 service nova] Enqueued Resource ID: 724b248c-fcba-4659-94d6-7aefe563ad89 with Priority: HIGHEST for action security_group_members [ 1076.577960] env[69980]: INFO networking_nsxv3.common.synchronization [req-4294e819-847a-4f3a-be9c-11ad4dbb4a3c req-54347c0d-00af-4836-8bfd-269541372254 service nova] Enqueued Resource ID: c9f8fd8c-d527-4efe-9701-99170ff2ff43 with Priority: HIGHEST for action port [ 1076.577960] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 724b248c-fcba-4659-94d6-7aefe563ad89 with Priority: HIGHEST for action security_group_rules [ 1076.577960] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 724b248c-fcba-4659-94d6-7aefe563ad89 with Priority: HIGHEST for action security_group_members [ 1076.577960] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c9f8fd8c-d527-4efe-9701-99170ff2ff43 with Priority: HIGHEST for action port [ 1076.577960] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock rules-724b248c-fcba-4659-94d6-7aefe563ad89 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.577960] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-724b248c-fcba-4659-94d6-7aefe563ad89" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.577960] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-724b248c-fcba-4659-94d6-7aefe563ad89" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.577960] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-724b248c-fcba-4659-94d6-7aefe563ad89" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.577960] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('724b248c-fcba-4659-94d6-7aefe563ad89',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1076.579051] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-724b248c-fcba-4659-94d6-7aefe563ad89 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.579093] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-724b248c-fcba-4659-94d6-7aefe563ad89" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.579984] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-724b248c-fcba-4659-94d6-7aefe563ad89" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.579984] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-724b248c-fcba-4659-94d6-7aefe563ad89" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.579984] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.579984] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.579984] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.580316] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.580495] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.587139] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('724b248c-fcba-4659-94d6-7aefe563ad89',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1076.587556] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock port-c9f8fd8c-d527-4efe-9701-99170ff2ff43 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.587677] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c9f8fd8c-d527-4efe-9701-99170ff2ff43" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.587735] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c9f8fd8c-d527-4efe-9701-99170ff2ff43" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.587907] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c9f8fd8c-d527-4efe-9701-99170ff2ff43" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.587999] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c9f8fd8c-d527-4efe-9701-99170ff2ff43',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1076.859575] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.860350] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.860563] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.860936] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.861181] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.861546] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.864016] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.864016] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.864016] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.864016] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.864016] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4191fccf-dc75-4be2-9ec5-2d6447dbdbd8 is going to be updated. [ 1076.890721] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.891126] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.893016] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.893016] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.893016] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.901575] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4191fccf-dc75-4be2-9ec5-2d6447dbdbd8 in Status: IN_PROGRESS for 2s [ 1077.092522] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('724b248c-fcba-4659-94d6-7aefe563ad89',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1077.092522] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-724b248c-fcba-4659-94d6-7aefe563ad89 taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.092522] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-724b248c-fcba-4659-94d6-7aefe563ad89" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.094055] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c9f8fd8c-d527-4efe-9701-99170ff2ff43 with status ACTIVE [ 1077.094480] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.094762] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.095279] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.095720] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.095990] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.096449] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.096797] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.097777] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.098215] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.098440] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.098900] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.099215] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.099376] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.099636] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.099821] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.100201] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c9f8fd8c-d527-4efe-9701-99170ff2ff43 is going to be updated. [ 1077.138330] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.138330] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.138330] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.138330] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.138330] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.138330] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c9f8fd8c-d527-4efe-9701-99170ff2ff43" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.594822] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('724b248c-fcba-4659-94d6-7aefe563ad89',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1077.731210] env[69980]: INFO networking_nsxv3.common.synchronization [req-98681916-2060-467e-8196-c2c94d1d737f req-e983c59e-f3df-4687-86a3-6034f3e6d496 tempest-ServersTestMultiNic-322776819 tempest-ServersTestMultiNic-322776819-project-member] Enqueued Resource ID: 690c96d5-eb4d-48e2-8d5e-d794cdf78fd1 with Priority: HIGHEST for action security_group_members [ 1077.731210] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 690c96d5-eb4d-48e2-8d5e-d794cdf78fd1 with Priority: HIGHEST for action security_group_members [ 1077.731210] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-690c96d5-eb4d-48e2-8d5e-d794cdf78fd1 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.732051] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-690c96d5-eb4d-48e2-8d5e-d794cdf78fd1" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.732327] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-690c96d5-eb4d-48e2-8d5e-d794cdf78fd1" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.732856] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-690c96d5-eb4d-48e2-8d5e-d794cdf78fd1" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.733181] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.733470] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.733657] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.733979] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.734203] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.734510] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('690c96d5-eb4d-48e2-8d5e-d794cdf78fd1',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1077.832204] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 80e3ea48-91a5-4863-b1c2-f3e887204e39 in Status: SUCCESS [ 1077.832204] env[69980]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 80e3ea48-91a5-4863-b1c2-f3e887204e39 deletion is rescheduled due to dependency. [ 1077.832204] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-80e3ea48-91a5-4863-b1c2-f3e887204e39" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.185119] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.185119] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.185119] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.185119] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.185119] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.185119] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 724b248c-fcba-4659-94d6-7aefe563ad89 is going to be created. [ 1078.185119] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.185119] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.185119] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.185119] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.185119] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.185119] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 724b248c-fcba-4659-94d6-7aefe563ad89 in Status: UNINITIALIZED for 2s [ 1078.238666] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.238666] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.238666] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.238666] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.238666] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.239077] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.239136] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.240790] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.240790] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.240790] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.240790] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 690c96d5-eb4d-48e2-8d5e-d794cdf78fd1 is going to be updated. [ 1078.266984] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.267223] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.267223] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.267424] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.267601] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.277306] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 690c96d5-eb4d-48e2-8d5e-d794cdf78fd1 in Status: IN_PROGRESS for 2s [ 1078.356130] env[69980]: INFO networking_nsxv3.common.synchronization [req-98681916-2060-467e-8196-c2c94d1d737f req-ce4c4557-00a8-4611-a945-b7a75fe5fcc6 tempest-ServersTestMultiNic-322776819 tempest-ServersTestMultiNic-322776819-project-member] Enqueued Resource ID: 690c96d5-eb4d-48e2-8d5e-d794cdf78fd1 with Priority: HIGHEST for action security_group_members [ 1078.357140] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 690c96d5-eb4d-48e2-8d5e-d794cdf78fd1 with Priority: HIGHEST for action security_group_members [ 1078.357252] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-690c96d5-eb4d-48e2-8d5e-d794cdf78fd1 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.357324] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-690c96d5-eb4d-48e2-8d5e-d794cdf78fd1" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.748945] env[69980]: INFO networking_nsxv3.common.synchronization [None req-972cf2ed-5e32-4f04-9c11-f2f858e13b92 None None] Enqueued Resource ID: fc9ad7b9-83a5-43c0-be40-b32f238149f6 with Priority: HIGHEST for action port [ 1078.749926] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fc9ad7b9-83a5-43c0-be40-b32f238149f6 with Priority: HIGHEST for action port [ 1078.754046] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock port-fc9ad7b9-83a5-43c0-be40-b32f238149f6 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.754219] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fc9ad7b9-83a5-43c0-be40-b32f238149f6" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.754270] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fc9ad7b9-83a5-43c0-be40-b32f238149f6" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.754685] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fc9ad7b9-83a5-43c0-be40-b32f238149f6" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.754886] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fc9ad7b9-83a5-43c0-be40-b32f238149f6',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1078.912728] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4191fccf-dc75-4be2-9ec5-2d6447dbdbd8 in Status: SUCCESS [ 1078.913206] env[69980]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4191fccf-dc75-4be2-9ec5-2d6447dbdbd8 deletion is rescheduled due to dependency. [ 1078.913463] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4191fccf-dc75-4be2-9ec5-2d6447dbdbd8" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.102425] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock network-192 taken with stack trace [, , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.102652] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "network-192" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.102831] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "network-192" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.104610] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "network-192" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.104907] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.105443] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.105443] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.105579] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.105748] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.106027] env[69980]: DEBUG dogpile.cache.region [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] No value present for key: 'zone-id' {{(pid=69980) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1079.106153] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] NeedRegenerationException {{(pid=69980) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1079.106273] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] no value, waiting for create lock {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1079.106449] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] value creation lock acquired {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1079.106640] env[69980]: DEBUG dogpile.cache.region [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] No value present for key: 'zone-id' {{(pid=69980) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1079.106764] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Calling creation function for not-yet-present value {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1079.106954] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1079.128494] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1079.128671] env[69980]: DEBUG dogpile.cache.region [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=69980) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1079.128814] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Released creation lock {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1079.129114] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "network-192" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.129339] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock port-274f9a72-90f2-4fb5-ae2b-af956b7805d8 taken with stack trace [, , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.129553] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "port-274f9a72-90f2-4fb5-ae2b-af956b7805d8" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.129681] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "port-274f9a72-90f2-4fb5-ae2b-af956b7805d8" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.130023] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "port-274f9a72-90f2-4fb5-ae2b-af956b7805d8" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.130162] env[69980]: DEBUG networking_nsxv3.api.rpc [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('274f9a72-90f2-4fb5-ae2b-af956b7805d8',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1079.258781] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port fc9ad7b9-83a5-43c0-be40-b32f238149f6 [ 1079.259127] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.259204] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.259240] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.259454] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.259528] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.259620] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:fc9ad7b9-83a5-43c0-be40-b32f238149f6 already deleted. [ 1079.259702] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fc9ad7b9-83a5-43c0-be40-b32f238149f6" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.633791] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.633791] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.633791] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.633791] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.633791] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.633791] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Segment Port 274f9a72-90f2-4fb5-ae2b-af956b7805d8 not found, creating... [ 1079.634611] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.634611] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.634611] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.634611] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.634611] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.634941] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.635038] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.636858] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.637169] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.637333] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.637483] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Resource: SegmentPort with ID: 274f9a72-90f2-4fb5-ae2b-af956b7805d8 is going to be created. [ 1079.657450] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.657689] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.657820] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.658129] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.658930] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.658930] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "port-274f9a72-90f2-4fb5-ae2b-af956b7805d8" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.142981] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 724b248c-fcba-4659-94d6-7aefe563ad89 in Status: SUCCESS [ 1080.143240] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-724b248c-fcba-4659-94d6-7aefe563ad89" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.143412] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-724b248c-fcba-4659-94d6-7aefe563ad89" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.143634] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-724b248c-fcba-4659-94d6-7aefe563ad89" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.143854] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.144055] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.144145] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.144482] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.144577] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.144658] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-724b248c-fcba-4659-94d6-7aefe563ad89" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.145468] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('724b248c-fcba-4659-94d6-7aefe563ad89',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1080.174019] env[69980]: INFO networking_nsxv3.common.synchronization [req-303ebb17-2594-4741-a2da-771f45f78208 req-470e0f9d-5d81-411a-89e4-84b98db1fb3c tempest-ServersTestFqdnHostnames-1390135796 tempest-ServersTestFqdnHostnames-1390135796-project-member] Enqueued Resource ID: 98819590-8807-4667-9ed7-ac1964aca5fa with Priority: HIGHEST for action security_group_members [ 1080.174019] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 98819590-8807-4667-9ed7-ac1964aca5fa with Priority: HIGHEST for action security_group_members [ 1080.174019] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-98819590-8807-4667-9ed7-ac1964aca5fa taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.174019] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-98819590-8807-4667-9ed7-ac1964aca5fa" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.174019] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-98819590-8807-4667-9ed7-ac1964aca5fa" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.174019] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-98819590-8807-4667-9ed7-ac1964aca5fa" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.174439] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.174616] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.174716] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.174920] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.175057] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.175183] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('98819590-8807-4667-9ed7-ac1964aca5fa',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1080.286878] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 690c96d5-eb4d-48e2-8d5e-d794cdf78fd1 in Status: SUCCESS [ 1080.287551] env[69980]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 690c96d5-eb4d-48e2-8d5e-d794cdf78fd1 deletion is rescheduled due to dependency. [ 1080.287551] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-690c96d5-eb4d-48e2-8d5e-d794cdf78fd1" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.287551] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-690c96d5-eb4d-48e2-8d5e-d794cdf78fd1" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.287551] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-690c96d5-eb4d-48e2-8d5e-d794cdf78fd1" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.287864] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.287864] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.287948] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.288041] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.288124] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.288376] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('690c96d5-eb4d-48e2-8d5e-d794cdf78fd1',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1080.655051] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-724b248c-fcba-4659-94d6-7aefe563ad89 taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.655051] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-724b248c-fcba-4659-94d6-7aefe563ad89" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.655051] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-724b248c-fcba-4659-94d6-7aefe563ad89" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.655051] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-724b248c-fcba-4659-94d6-7aefe563ad89" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.655051] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.655051] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.655051] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.655051] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.655051] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.655051] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-724b248c-fcba-4659-94d6-7aefe563ad89" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.655051] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-724b248c-fcba-4659-94d6-7aefe563ad89 taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.655051] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-724b248c-fcba-4659-94d6-7aefe563ad89" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.655051] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-724b248c-fcba-4659-94d6-7aefe563ad89" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.655051] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-724b248c-fcba-4659-94d6-7aefe563ad89" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.655051] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.655051] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.656570] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.656570] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.656570] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.656570] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-724b248c-fcba-4659-94d6-7aefe563ad89" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.656570] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('724b248c-fcba-4659-94d6-7aefe563ad89',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1080.671226] env[69980]: INFO networking_nsxv3.common.synchronization [req-98681916-2060-467e-8196-c2c94d1d737f req-390f6524-3b6b-4547-b974-a93a9d6221fc service nova] Enqueued Resource ID: 690c96d5-eb4d-48e2-8d5e-d794cdf78fd1 with Priority: HIGHEST for action security_group_rules [ 1080.671226] env[69980]: INFO networking_nsxv3.common.synchronization [req-98681916-2060-467e-8196-c2c94d1d737f req-390f6524-3b6b-4547-b974-a93a9d6221fc service nova] Enqueued Resource ID: 690c96d5-eb4d-48e2-8d5e-d794cdf78fd1 with Priority: HIGHEST for action security_group_members [ 1080.671226] env[69980]: INFO networking_nsxv3.common.synchronization [req-98681916-2060-467e-8196-c2c94d1d737f req-390f6524-3b6b-4547-b974-a93a9d6221fc service nova] Enqueued Resource ID: 274f9a72-90f2-4fb5-ae2b-af956b7805d8 with Priority: HIGHEST for action port [ 1080.671226] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 690c96d5-eb4d-48e2-8d5e-d794cdf78fd1 with Priority: HIGHEST for action security_group_rules [ 1080.671226] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 690c96d5-eb4d-48e2-8d5e-d794cdf78fd1 with Priority: HIGHEST for action security_group_members [ 1080.671226] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 274f9a72-90f2-4fb5-ae2b-af956b7805d8 with Priority: HIGHEST for action port [ 1080.671880] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock rules-690c96d5-eb4d-48e2-8d5e-d794cdf78fd1 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.672143] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-690c96d5-eb4d-48e2-8d5e-d794cdf78fd1" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.672382] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-690c96d5-eb4d-48e2-8d5e-d794cdf78fd1" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.672762] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-690c96d5-eb4d-48e2-8d5e-d794cdf78fd1" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.672917] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('690c96d5-eb4d-48e2-8d5e-d794cdf78fd1',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1080.674065] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-690c96d5-eb4d-48e2-8d5e-d794cdf78fd1 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.674425] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-690c96d5-eb4d-48e2-8d5e-d794cdf78fd1" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.674732] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock port-274f9a72-90f2-4fb5-ae2b-af956b7805d8 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.674956] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-274f9a72-90f2-4fb5-ae2b-af956b7805d8" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.675151] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-274f9a72-90f2-4fb5-ae2b-af956b7805d8" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.675447] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-274f9a72-90f2-4fb5-ae2b-af956b7805d8" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.675631] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('274f9a72-90f2-4fb5-ae2b-af956b7805d8',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1080.682021] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.682021] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.682021] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.682021] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.682021] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.682021] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.682021] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.682021] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.682021] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.682021] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.682021] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 98819590-8807-4667-9ed7-ac1964aca5fa is going to be updated. [ 1080.722818] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.723486] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.723614] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.723771] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.723911] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.736675] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 98819590-8807-4667-9ed7-ac1964aca5fa in Status: IN_PROGRESS for 2s [ 1080.794885] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('690c96d5-eb4d-48e2-8d5e-d794cdf78fd1',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1081.156616] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 724b248c-fcba-4659-94d6-7aefe563ad89: rpc.has_security_group_logging(os_id): False [ 1081.174268] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.174425] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.174474] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.175493] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.175719] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.175991] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.176149] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.176258] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.176436] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.176534] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.176756] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.176856] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.176917] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.177075] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.177150] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.177337] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.177439] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.177501] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.177837] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.177837] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.177837] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 724b248c-fcba-4659-94d6-7aefe563ad89 is going to be created. [ 1081.179154] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-690c96d5-eb4d-48e2-8d5e-d794cdf78fd1 taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.179256] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-690c96d5-eb4d-48e2-8d5e-d794cdf78fd1" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.179919] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 274f9a72-90f2-4fb5-ae2b-af956b7805d8 with status ACTIVE [ 1081.179919] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.179919] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.179919] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.179919] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.180162] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.180196] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.180305] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.180383] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.180625] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.180741] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.180949] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.181056] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.181131] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.182040] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.182040] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.182040] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 274f9a72-90f2-4fb5-ae2b-af956b7805d8 is going to be updated. [ 1081.200991] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.201167] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.201216] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.201435] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.201565] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.201727] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-274f9a72-90f2-4fb5-ae2b-af956b7805d8" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.243856] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.243942] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.244034] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.244226] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.244409] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.271368] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 724b248c-fcba-4659-94d6-7aefe563ad89 in Status: IN_PROGRESS for 2s [ 1081.298486] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('690c96d5-eb4d-48e2-8d5e-d794cdf78fd1',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1081.700765] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock network-801 taken with stack trace [, , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.700765] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "network-801" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.700919] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "network-801" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.701205] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "network-801" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.701507] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.701627] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.702160] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.702160] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.702160] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.702377] env[69980]: DEBUG dogpile.cache.region [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] No value present for key: 'zone-id' {{(pid=69980) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1081.702424] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] NeedRegenerationException {{(pid=69980) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1081.702532] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] no value, waiting for create lock {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1081.702643] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] value creation lock acquired {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1081.702754] env[69980]: DEBUG dogpile.cache.region [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] No value present for key: 'zone-id' {{(pid=69980) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1081.702862] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Calling creation function for not-yet-present value {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1081.702998] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1081.721737] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1081.722392] env[69980]: DEBUG dogpile.cache.region [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=69980) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1081.722392] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Released creation lock {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1081.722392] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "network-801" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.722565] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock port-b736a949-11ba-4b71-803a-faf88d99fefa taken with stack trace [, , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.723100] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "port-b736a949-11ba-4b71-803a-faf88d99fefa" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.723100] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "port-b736a949-11ba-4b71-803a-faf88d99fefa" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.723223] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "port-b736a949-11ba-4b71-803a-faf88d99fefa" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.723337] env[69980]: DEBUG networking_nsxv3.api.rpc [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b736a949-11ba-4b71-803a-faf88d99fefa',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1081.803114] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.803114] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.803114] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.803114] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.803675] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.803675] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 690c96d5-eb4d-48e2-8d5e-d794cdf78fd1 is going to be updated. [ 1081.832114] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.832114] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.832114] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.832114] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.832114] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.838811] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 690c96d5-eb4d-48e2-8d5e-d794cdf78fd1 in Status: IN_PROGRESS for 2s [ 1082.202412] env[69980]: INFO networking_nsxv3.common.synchronization [req-68104be6-5d7f-4245-af7f-547d705b01c4 req-142c05df-c379-4648-95ef-c9c96742477d tempest-ServerDiskConfigTestJSON-214268531 tempest-ServerDiskConfigTestJSON-214268531-project-member] Enqueued Resource ID: 0dbf2bcd-0572-43ef-b18d-cc3cca7fcfd5 with Priority: HIGHEST for action security_group_members [ 1082.203761] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0dbf2bcd-0572-43ef-b18d-cc3cca7fcfd5 with Priority: HIGHEST for action security_group_members [ 1082.203761] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-0dbf2bcd-0572-43ef-b18d-cc3cca7fcfd5 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.203761] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0dbf2bcd-0572-43ef-b18d-cc3cca7fcfd5" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.203761] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0dbf2bcd-0572-43ef-b18d-cc3cca7fcfd5" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.203928] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0dbf2bcd-0572-43ef-b18d-cc3cca7fcfd5" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.204039] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.204112] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.204173] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.204478] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.204582] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.204683] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0dbf2bcd-0572-43ef-b18d-cc3cca7fcfd5',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1082.228783] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.228783] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.228783] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.228783] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.228783] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.228783] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Segment Port b736a949-11ba-4b71-803a-faf88d99fefa not found, creating... [ 1082.228783] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.228783] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.228783] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.229452] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.229452] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.229566] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.229727] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.230582] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.230582] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.230582] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.230582] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Resource: SegmentPort with ID: b736a949-11ba-4b71-803a-faf88d99fefa is going to be created. [ 1082.251731] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.251930] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.252020] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.252345] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.252591] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.252822] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "port-b736a949-11ba-4b71-803a-faf88d99fefa" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.664211] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock network-932 taken with stack trace [, , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.664542] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "network-932" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.664542] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "network-932" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.664796] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "network-932" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.665075] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.665244] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.665869] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.665869] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.665869] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.666033] env[69980]: DEBUG dogpile.cache.region [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] No value present for key: 'zone-id' {{(pid=69980) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1082.666083] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] NeedRegenerationException {{(pid=69980) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1082.666179] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] no value, waiting for create lock {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1082.666291] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] value creation lock acquired {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1082.666414] env[69980]: DEBUG dogpile.cache.region [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] No value present for key: 'zone-id' {{(pid=69980) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1082.666586] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Calling creation function for not-yet-present value {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1082.666758] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1082.690020] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1082.690212] env[69980]: DEBUG dogpile.cache.region [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=69980) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1082.690356] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Released creation lock {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1082.690537] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "network-932" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.690906] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock port-d7e2d1dd-8c89-40e0-b522-55eb693fa969 taken with stack trace [, , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.691404] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "port-d7e2d1dd-8c89-40e0-b522-55eb693fa969" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.691404] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "port-d7e2d1dd-8c89-40e0-b522-55eb693fa969" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.691564] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "port-d7e2d1dd-8c89-40e0-b522-55eb693fa969" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.691683] env[69980]: DEBUG networking_nsxv3.api.rpc [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d7e2d1dd-8c89-40e0-b522-55eb693fa969',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1082.711635] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.711853] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.712079] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.712253] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.712389] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.712655] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.712801] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.712898] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.713136] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.713257] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.713384] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0dbf2bcd-0572-43ef-b18d-cc3cca7fcfd5 is going to be updated. [ 1082.744872] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.744872] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.744872] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.744872] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.744872] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.746925] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 98819590-8807-4667-9ed7-ac1964aca5fa in Status: SUCCESS [ 1082.746925] env[69980]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 98819590-8807-4667-9ed7-ac1964aca5fa deletion is rescheduled due to dependency. [ 1082.746925] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-98819590-8807-4667-9ed7-ac1964aca5fa" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.757331] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0dbf2bcd-0572-43ef-b18d-cc3cca7fcfd5 in Status: IN_PROGRESS for 2s [ 1083.152844] env[69980]: INFO networking_nsxv3.common.synchronization [req-98681916-2060-467e-8196-c2c94d1d737f req-3aaac395-8a7c-4580-826d-a48dfd69e8ef service nova] Enqueued Resource ID: 690c96d5-eb4d-48e2-8d5e-d794cdf78fd1 with Priority: HIGHEST for action security_group_rules [ 1083.153042] env[69980]: INFO networking_nsxv3.common.synchronization [req-98681916-2060-467e-8196-c2c94d1d737f req-3aaac395-8a7c-4580-826d-a48dfd69e8ef service nova] Enqueued Resource ID: 690c96d5-eb4d-48e2-8d5e-d794cdf78fd1 with Priority: HIGHEST for action security_group_members [ 1083.153188] env[69980]: INFO networking_nsxv3.common.synchronization [req-98681916-2060-467e-8196-c2c94d1d737f req-3aaac395-8a7c-4580-826d-a48dfd69e8ef service nova] Enqueued Resource ID: b736a949-11ba-4b71-803a-faf88d99fefa with Priority: HIGHEST for action port [ 1083.153456] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 690c96d5-eb4d-48e2-8d5e-d794cdf78fd1 with Priority: HIGHEST for action security_group_rules [ 1083.153589] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 690c96d5-eb4d-48e2-8d5e-d794cdf78fd1 with Priority: HIGHEST for action security_group_members [ 1083.153681] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b736a949-11ba-4b71-803a-faf88d99fefa with Priority: HIGHEST for action port [ 1083.154260] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock rules-690c96d5-eb4d-48e2-8d5e-d794cdf78fd1 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.154361] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-690c96d5-eb4d-48e2-8d5e-d794cdf78fd1" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.154594] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-690c96d5-eb4d-48e2-8d5e-d794cdf78fd1 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.154679] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-690c96d5-eb4d-48e2-8d5e-d794cdf78fd1" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.154867] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock port-b736a949-11ba-4b71-803a-faf88d99fefa taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.155053] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b736a949-11ba-4b71-803a-faf88d99fefa" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.155053] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b736a949-11ba-4b71-803a-faf88d99fefa" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.155227] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b736a949-11ba-4b71-803a-faf88d99fefa" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.155332] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b736a949-11ba-4b71-803a-faf88d99fefa',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1083.196317] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.196317] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.196317] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.196317] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.196317] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.196317] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Segment Port d7e2d1dd-8c89-40e0-b522-55eb693fa969 not found, creating... [ 1083.196317] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.196317] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.196317] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.196317] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.198121] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.198615] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.201026] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.201026] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.201026] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.201026] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.201026] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Resource: SegmentPort with ID: d7e2d1dd-8c89-40e0-b522-55eb693fa969 is going to be created. [ 1083.222389] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.222389] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.222684] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.222849] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.223228] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.223228] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "port-d7e2d1dd-8c89-40e0-b522-55eb693fa969" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.300144] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 724b248c-fcba-4659-94d6-7aefe563ad89 in Status: SUCCESS [ 1083.300144] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-724b248c-fcba-4659-94d6-7aefe563ad89" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.658299] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b736a949-11ba-4b71-803a-faf88d99fefa with status ACTIVE [ 1083.658299] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.658643] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.658643] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.658713] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.658944] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.658944] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.659084] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.659133] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.659266] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.659344] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.659591] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.659894] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.659894] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.660070] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.660070] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.660136] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b736a949-11ba-4b71-803a-faf88d99fefa is going to be updated. [ 1083.680962] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.681337] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.681337] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.681428] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.681544] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.681679] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b736a949-11ba-4b71-803a-faf88d99fefa" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.848563] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 690c96d5-eb4d-48e2-8d5e-d794cdf78fd1 in Status: SUCCESS [ 1083.848852] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-690c96d5-eb4d-48e2-8d5e-d794cdf78fd1" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.849054] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-690c96d5-eb4d-48e2-8d5e-d794cdf78fd1" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.849277] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-690c96d5-eb4d-48e2-8d5e-d794cdf78fd1" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.849468] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.849750] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.849750] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.849911] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.849911] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.850063] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('690c96d5-eb4d-48e2-8d5e-d794cdf78fd1',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1084.023841] env[69980]: INFO networking_nsxv3.common.synchronization [req-68104be6-5d7f-4245-af7f-547d705b01c4 req-5186ab31-178a-42ee-8fcb-1b21307cbd07 service nova] Enqueued Resource ID: 0dbf2bcd-0572-43ef-b18d-cc3cca7fcfd5 with Priority: HIGHEST for action security_group_rules [ 1084.024055] env[69980]: INFO networking_nsxv3.common.synchronization [req-68104be6-5d7f-4245-af7f-547d705b01c4 req-5186ab31-178a-42ee-8fcb-1b21307cbd07 service nova] Enqueued Resource ID: 0dbf2bcd-0572-43ef-b18d-cc3cca7fcfd5 with Priority: HIGHEST for action security_group_members [ 1084.024200] env[69980]: INFO networking_nsxv3.common.synchronization [req-68104be6-5d7f-4245-af7f-547d705b01c4 req-5186ab31-178a-42ee-8fcb-1b21307cbd07 service nova] Enqueued Resource ID: d7e2d1dd-8c89-40e0-b522-55eb693fa969 with Priority: HIGHEST for action port [ 1084.024464] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0dbf2bcd-0572-43ef-b18d-cc3cca7fcfd5 with Priority: HIGHEST for action security_group_rules [ 1084.024650] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0dbf2bcd-0572-43ef-b18d-cc3cca7fcfd5 with Priority: HIGHEST for action security_group_members [ 1084.024761] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d7e2d1dd-8c89-40e0-b522-55eb693fa969 with Priority: HIGHEST for action port [ 1084.027222] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0dbf2bcd-0572-43ef-b18d-cc3cca7fcfd5 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.027222] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0dbf2bcd-0572-43ef-b18d-cc3cca7fcfd5" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.027222] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0dbf2bcd-0572-43ef-b18d-cc3cca7fcfd5" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.027222] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0dbf2bcd-0572-43ef-b18d-cc3cca7fcfd5" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.027222] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0dbf2bcd-0572-43ef-b18d-cc3cca7fcfd5',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1084.027542] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-0dbf2bcd-0572-43ef-b18d-cc3cca7fcfd5 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.027542] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0dbf2bcd-0572-43ef-b18d-cc3cca7fcfd5" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.027696] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock port-d7e2d1dd-8c89-40e0-b522-55eb693fa969 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.027781] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d7e2d1dd-8c89-40e0-b522-55eb693fa969" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.027822] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d7e2d1dd-8c89-40e0-b522-55eb693fa969" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.027992] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d7e2d1dd-8c89-40e0-b522-55eb693fa969" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.028076] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d7e2d1dd-8c89-40e0-b522-55eb693fa969',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1084.353528] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('690c96d5-eb4d-48e2-8d5e-d794cdf78fd1',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1084.530257] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-0dbf2bcd-0572-43ef-b18d-cc3cca7fcfd5 taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.530414] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0dbf2bcd-0572-43ef-b18d-cc3cca7fcfd5" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.534820] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d7e2d1dd-8c89-40e0-b522-55eb693fa969 with status ACTIVE [ 1084.535043] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.535174] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.535255] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.535507] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.535616] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.535797] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.535900] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.535962] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.536138] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.536224] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.536405] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.536501] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.536561] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.536701] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.536776] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.536860] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d7e2d1dd-8c89-40e0-b522-55eb693fa969 is going to be updated. [ 1084.557447] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.557698] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.557778] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.558018] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.558356] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.558356] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d7e2d1dd-8c89-40e0-b522-55eb693fa969" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.766286] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0dbf2bcd-0572-43ef-b18d-cc3cca7fcfd5 in Status: SUCCESS [ 1084.766678] env[69980]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0dbf2bcd-0572-43ef-b18d-cc3cca7fcfd5 deletion is rescheduled due to dependency. [ 1084.766678] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0dbf2bcd-0572-43ef-b18d-cc3cca7fcfd5" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.766763] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0dbf2bcd-0572-43ef-b18d-cc3cca7fcfd5" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.766987] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0dbf2bcd-0572-43ef-b18d-cc3cca7fcfd5" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.767303] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.767303] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.767454] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.767544] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.767626] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.767728] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0dbf2bcd-0572-43ef-b18d-cc3cca7fcfd5',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1084.855840] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('690c96d5-eb4d-48e2-8d5e-d794cdf78fd1',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1085.269804] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0dbf2bcd-0572-43ef-b18d-cc3cca7fcfd5',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1085.358722] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.358722] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.358924] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.358995] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.359327] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.359327] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 690c96d5-eb4d-48e2-8d5e-d794cdf78fd1 is going to be updated. [ 1085.397398] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.397548] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.397607] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.397824] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.397969] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.408232] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 690c96d5-eb4d-48e2-8d5e-d794cdf78fd1 in Status: IN_PROGRESS for 2s [ 1085.772073] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0dbf2bcd-0572-43ef-b18d-cc3cca7fcfd5',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1086.274891] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.275182] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.275280] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.275582] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.275711] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.275868] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0dbf2bcd-0572-43ef-b18d-cc3cca7fcfd5 is going to be updated. [ 1086.303894] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.304730] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.304902] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.305459] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.305666] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.313834] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0dbf2bcd-0572-43ef-b18d-cc3cca7fcfd5 in Status: IN_PROGRESS for 2s [ 1087.418199] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 690c96d5-eb4d-48e2-8d5e-d794cdf78fd1 in Status: SUCCESS [ 1087.418199] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-690c96d5-eb4d-48e2-8d5e-d794cdf78fd1" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.418199] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-690c96d5-eb4d-48e2-8d5e-d794cdf78fd1" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.418199] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-690c96d5-eb4d-48e2-8d5e-d794cdf78fd1" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.418199] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.418199] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.418199] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.418769] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.418769] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.418769] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-690c96d5-eb4d-48e2-8d5e-d794cdf78fd1" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.418769] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('690c96d5-eb4d-48e2-8d5e-d794cdf78fd1',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1087.419566] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-690c96d5-eb4d-48e2-8d5e-d794cdf78fd1" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.419752] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-690c96d5-eb4d-48e2-8d5e-d794cdf78fd1" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.419915] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.421052] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.421052] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.421052] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.421052] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.421052] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('690c96d5-eb4d-48e2-8d5e-d794cdf78fd1',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1087.923969] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-690c96d5-eb4d-48e2-8d5e-d794cdf78fd1 taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.923969] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-690c96d5-eb4d-48e2-8d5e-d794cdf78fd1" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.923969] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('690c96d5-eb4d-48e2-8d5e-d794cdf78fd1',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1088.323956] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0dbf2bcd-0572-43ef-b18d-cc3cca7fcfd5 in Status: SUCCESS [ 1088.324139] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0dbf2bcd-0572-43ef-b18d-cc3cca7fcfd5" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.324316] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0dbf2bcd-0572-43ef-b18d-cc3cca7fcfd5" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.324541] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0dbf2bcd-0572-43ef-b18d-cc3cca7fcfd5" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.324854] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.324988] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.324988] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.325105] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.325232] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.325286] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0dbf2bcd-0572-43ef-b18d-cc3cca7fcfd5" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.325349] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('0dbf2bcd-0572-43ef-b18d-cc3cca7fcfd5',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1088.425720] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('690c96d5-eb4d-48e2-8d5e-d794cdf78fd1',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1088.827833] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-0dbf2bcd-0572-43ef-b18d-cc3cca7fcfd5 taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.828057] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0dbf2bcd-0572-43ef-b18d-cc3cca7fcfd5" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.828124] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0dbf2bcd-0572-43ef-b18d-cc3cca7fcfd5" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.828317] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0dbf2bcd-0572-43ef-b18d-cc3cca7fcfd5" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.828488] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.828594] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.828660] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.828816] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.828901] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.829010] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0dbf2bcd-0572-43ef-b18d-cc3cca7fcfd5" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.829164] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-0dbf2bcd-0572-43ef-b18d-cc3cca7fcfd5 taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.829263] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0dbf2bcd-0572-43ef-b18d-cc3cca7fcfd5" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.829345] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0dbf2bcd-0572-43ef-b18d-cc3cca7fcfd5" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.829457] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0dbf2bcd-0572-43ef-b18d-cc3cca7fcfd5" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.829591] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.829695] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.829770] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.829945] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.829993] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.830065] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0dbf2bcd-0572-43ef-b18d-cc3cca7fcfd5" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.830156] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('0dbf2bcd-0572-43ef-b18d-cc3cca7fcfd5',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1088.927986] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.928198] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.928281] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.928557] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.928662] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.928789] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 690c96d5-eb4d-48e2-8d5e-d794cdf78fd1 is going to be updated. [ 1088.955994] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.956253] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.956328] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.956624] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.956842] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.966591] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 690c96d5-eb4d-48e2-8d5e-d794cdf78fd1 in Status: IN_PROGRESS for 2s [ 1089.026125] env[69980]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1089.026246] env[69980]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=4 [ 1089.332745] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 0dbf2bcd-0572-43ef-b18d-cc3cca7fcfd5: rpc.has_security_group_logging(os_id): False [ 1089.353932] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.354093] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.354182] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.354496] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.354589] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.354838] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.354936] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.355007] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.355166] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.355264] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.355452] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.355575] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.355611] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.355772] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.355847] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.357464] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.357464] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.357464] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.357464] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.357464] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.357464] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0dbf2bcd-0572-43ef-b18d-cc3cca7fcfd5 is going to be updated. [ 1089.447801] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.448125] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.448174] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.449042] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.449042] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.466441] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0dbf2bcd-0572-43ef-b18d-cc3cca7fcfd5 in Status: IN_PROGRESS for 2s [ 1090.549697] env[69980]: INFO networking_nsxv3.common.synchronization [None req-faa0c442-92fe-4de4-afee-9964b4dc3bdd None None] Enqueued Resource ID: c9103dfd-e756-4dbe-916c-ee816183efdd with Priority: HIGHEST for action port [ 1090.550021] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c9103dfd-e756-4dbe-916c-ee816183efdd with Priority: HIGHEST for action port [ 1090.550708] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock port-c9103dfd-e756-4dbe-916c-ee816183efdd taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.550779] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c9103dfd-e756-4dbe-916c-ee816183efdd" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.550875] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c9103dfd-e756-4dbe-916c-ee816183efdd" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.551654] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c9103dfd-e756-4dbe-916c-ee816183efdd" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.551740] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c9103dfd-e756-4dbe-916c-ee816183efdd',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1090.977856] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 690c96d5-eb4d-48e2-8d5e-d794cdf78fd1 in Status: SUCCESS [ 1090.978048] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-690c96d5-eb4d-48e2-8d5e-d794cdf78fd1" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.978236] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-690c96d5-eb4d-48e2-8d5e-d794cdf78fd1" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.979810] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-690c96d5-eb4d-48e2-8d5e-d794cdf78fd1" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.979810] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.979810] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.979810] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.981856] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.981856] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.981856] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-690c96d5-eb4d-48e2-8d5e-d794cdf78fd1" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.981856] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-690c96d5-eb4d-48e2-8d5e-d794cdf78fd1 taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.982086] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-690c96d5-eb4d-48e2-8d5e-d794cdf78fd1" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.982086] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-690c96d5-eb4d-48e2-8d5e-d794cdf78fd1" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.982148] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-690c96d5-eb4d-48e2-8d5e-d794cdf78fd1" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.982733] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.982733] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.982733] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.982733] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.982733] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.982733] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-690c96d5-eb4d-48e2-8d5e-d794cdf78fd1" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.983343] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('690c96d5-eb4d-48e2-8d5e-d794cdf78fd1',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1091.058538] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port c9103dfd-e756-4dbe-916c-ee816183efdd [ 1091.058538] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.058538] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.058538] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.058538] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.058538] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.058538] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:c9103dfd-e756-4dbe-916c-ee816183efdd already deleted. [ 1091.058538] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c9103dfd-e756-4dbe-916c-ee816183efdd" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.486858] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0dbf2bcd-0572-43ef-b18d-cc3cca7fcfd5 in Status: SUCCESS [ 1091.486858] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0dbf2bcd-0572-43ef-b18d-cc3cca7fcfd5" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.487426] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 690c96d5-eb4d-48e2-8d5e-d794cdf78fd1: rpc.has_security_group_logging(os_id): False [ 1091.505509] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.505636] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.505907] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.507051] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.507051] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.507051] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.507051] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.507051] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.507051] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.507051] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.507363] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.507363] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.507363] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.507483] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.507558] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.509317] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.509405] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.509478] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.509688] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.509805] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.509918] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 690c96d5-eb4d-48e2-8d5e-d794cdf78fd1 is going to be updated. [ 1091.565853] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.566272] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.566272] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.566403] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.566469] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.583043] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 690c96d5-eb4d-48e2-8d5e-d794cdf78fd1 in Status: IN_PROGRESS for 2s [ 1091.799390] env[69980]: INFO networking_nsxv3.common.synchronization [req-1a21948c-8103-40f2-a21c-a941fb8b5c31 req-51ef4e35-09bf-4960-9429-f262223a2422 tempest-ServerRescueTestJSON-1726562689 tempest-ServerRescueTestJSON-1726562689-project-member] Enqueued Resource ID: 4eb0fe0d-cd04-4189-9b26-953ab87885bd with Priority: HIGHEST for action security_group_members [ 1091.799390] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4eb0fe0d-cd04-4189-9b26-953ab87885bd with Priority: HIGHEST for action security_group_members [ 1091.799592] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-4eb0fe0d-cd04-4189-9b26-953ab87885bd taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.799686] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4eb0fe0d-cd04-4189-9b26-953ab87885bd" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.799860] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4eb0fe0d-cd04-4189-9b26-953ab87885bd" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.800032] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4eb0fe0d-cd04-4189-9b26-953ab87885bd" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.800217] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.800319] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.800388] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.800584] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.800660] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.800742] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4eb0fe0d-cd04-4189-9b26-953ab87885bd',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1092.298251] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock network-877 taken with stack trace [, , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.298251] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "network-877" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.298251] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "network-877" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.298389] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "network-877" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.298707] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.298872] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.298989] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.300477] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.300747] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.301124] env[69980]: DEBUG dogpile.cache.region [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] No value present for key: 'zone-id' {{(pid=69980) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1092.301297] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] NeedRegenerationException {{(pid=69980) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1092.301455] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] no value, waiting for create lock {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1092.301592] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] value creation lock acquired {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1092.301757] env[69980]: DEBUG dogpile.cache.region [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] No value present for key: 'zone-id' {{(pid=69980) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1092.301915] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Calling creation function for not-yet-present value {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1092.302117] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1092.306415] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4eb0fe0d-cd04-4189-9b26-953ab87885bd',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1092.325011] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1092.325204] env[69980]: DEBUG dogpile.cache.region [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=69980) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1092.325966] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Released creation lock {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1092.325966] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "network-877" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.326296] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock port-9fec77fe-38bd-4be5-85bd-0b4f588780e0 taken with stack trace [, , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.326296] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "port-9fec77fe-38bd-4be5-85bd-0b4f588780e0" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.326414] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "port-9fec77fe-38bd-4be5-85bd-0b4f588780e0" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.326691] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "port-9fec77fe-38bd-4be5-85bd-0b4f588780e0" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.326838] env[69980]: DEBUG networking_nsxv3.api.rpc [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9fec77fe-38bd-4be5-85bd-0b4f588780e0',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1092.811244] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4eb0fe0d-cd04-4189-9b26-953ab87885bd',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1092.832027] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.832027] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.832027] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.832027] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.832027] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.832027] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Segment Port 9fec77fe-38bd-4be5-85bd-0b4f588780e0 not found, creating... [ 1092.832027] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.832027] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.832027] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.832027] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.832027] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.833076] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.833575] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.834415] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.834622] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.834778] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.834929] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Resource: SegmentPort with ID: 9fec77fe-38bd-4be5-85bd-0b4f588780e0 is going to be created. [ 1092.856035] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.856035] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.856035] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.856035] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.856035] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.856035] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "port-9fec77fe-38bd-4be5-85bd-0b4f588780e0" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.142680] env[69980]: INFO networking_nsxv3.common.synchronization [None req-b623e4be-4578-4021-9dd8-5043a052af2f None None] Enqueued Resource ID: 9f23baff-a825-4b18-aec4-48b6156978e0 with Priority: HIGHEST for action port [ 1093.143233] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9f23baff-a825-4b18-aec4-48b6156978e0 with Priority: HIGHEST for action port [ 1093.143626] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock port-9f23baff-a825-4b18-aec4-48b6156978e0 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.143758] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9f23baff-a825-4b18-aec4-48b6156978e0" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.143828] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9f23baff-a825-4b18-aec4-48b6156978e0" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.144105] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9f23baff-a825-4b18-aec4-48b6156978e0" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.144189] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9f23baff-a825-4b18-aec4-48b6156978e0',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1093.315048] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.315048] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.315048] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.315358] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.315358] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.315496] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4eb0fe0d-cd04-4189-9b26-953ab87885bd is going to be updated. [ 1093.346120] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.346313] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.346388] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.346621] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.346773] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.355328] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4eb0fe0d-cd04-4189-9b26-953ab87885bd in Status: IN_PROGRESS for 2s [ 1093.601724] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 690c96d5-eb4d-48e2-8d5e-d794cdf78fd1 in Status: SUCCESS [ 1093.601969] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-690c96d5-eb4d-48e2-8d5e-d794cdf78fd1" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.602187] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-690c96d5-eb4d-48e2-8d5e-d794cdf78fd1" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.602410] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-690c96d5-eb4d-48e2-8d5e-d794cdf78fd1" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.603273] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('690c96d5-eb4d-48e2-8d5e-d794cdf78fd1',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1093.648221] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 9f23baff-a825-4b18-aec4-48b6156978e0 [ 1093.648221] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.648221] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.648221] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.648221] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.648221] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.648221] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:9f23baff-a825-4b18-aec4-48b6156978e0 already deleted. [ 1093.648221] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9f23baff-a825-4b18-aec4-48b6156978e0" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.688073] env[69980]: INFO networking_nsxv3.common.synchronization [req-1a21948c-8103-40f2-a21c-a941fb8b5c31 req-519cd8b2-93c1-40d5-a5be-510db627a1c2 service nova] Enqueued Resource ID: 4eb0fe0d-cd04-4189-9b26-953ab87885bd with Priority: HIGHEST for action security_group_rules [ 1093.688267] env[69980]: INFO networking_nsxv3.common.synchronization [req-1a21948c-8103-40f2-a21c-a941fb8b5c31 req-519cd8b2-93c1-40d5-a5be-510db627a1c2 service nova] Enqueued Resource ID: 4eb0fe0d-cd04-4189-9b26-953ab87885bd with Priority: HIGHEST for action security_group_members [ 1093.688405] env[69980]: INFO networking_nsxv3.common.synchronization [req-1a21948c-8103-40f2-a21c-a941fb8b5c31 req-519cd8b2-93c1-40d5-a5be-510db627a1c2 service nova] Enqueued Resource ID: 9fec77fe-38bd-4be5-85bd-0b4f588780e0 with Priority: HIGHEST for action port [ 1093.689032] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4eb0fe0d-cd04-4189-9b26-953ab87885bd with Priority: HIGHEST for action security_group_rules [ 1093.689232] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4eb0fe0d-cd04-4189-9b26-953ab87885bd with Priority: HIGHEST for action security_group_members [ 1093.689382] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9fec77fe-38bd-4be5-85bd-0b4f588780e0 with Priority: HIGHEST for action port [ 1093.689551] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4eb0fe0d-cd04-4189-9b26-953ab87885bd taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.689692] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4eb0fe0d-cd04-4189-9b26-953ab87885bd" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.689756] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4eb0fe0d-cd04-4189-9b26-953ab87885bd" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.689936] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4eb0fe0d-cd04-4189-9b26-953ab87885bd" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.690017] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4eb0fe0d-cd04-4189-9b26-953ab87885bd',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1093.691037] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-4eb0fe0d-cd04-4189-9b26-953ab87885bd taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.691037] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4eb0fe0d-cd04-4189-9b26-953ab87885bd" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.691215] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock port-9fec77fe-38bd-4be5-85bd-0b4f588780e0 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.691337] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9fec77fe-38bd-4be5-85bd-0b4f588780e0" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.691461] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9fec77fe-38bd-4be5-85bd-0b4f588780e0" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.691683] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9fec77fe-38bd-4be5-85bd-0b4f588780e0" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.691683] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9fec77fe-38bd-4be5-85bd-0b4f588780e0',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1094.105209] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-690c96d5-eb4d-48e2-8d5e-d794cdf78fd1 taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.105589] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-690c96d5-eb4d-48e2-8d5e-d794cdf78fd1" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.105589] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-690c96d5-eb4d-48e2-8d5e-d794cdf78fd1" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.105873] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-690c96d5-eb4d-48e2-8d5e-d794cdf78fd1" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.106071] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.106201] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.106269] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.106439] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.106533] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.106627] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-690c96d5-eb4d-48e2-8d5e-d794cdf78fd1" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.106717] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('690c96d5-eb4d-48e2-8d5e-d794cdf78fd1',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1094.193195] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-4eb0fe0d-cd04-4189-9b26-953ab87885bd taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.193423] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4eb0fe0d-cd04-4189-9b26-953ab87885bd" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.193665] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 9fec77fe-38bd-4be5-85bd-0b4f588780e0 with status ACTIVE [ 1094.193857] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.193991] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.194416] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.194416] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.194416] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.194558] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.194665] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.194705] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.194854] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.194928] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.195164] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.195286] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.195319] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.195729] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.195729] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.195729] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 9fec77fe-38bd-4be5-85bd-0b4f588780e0 is going to be updated. [ 1094.214997] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.215182] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.215821] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.216138] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.216348] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.216564] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9fec77fe-38bd-4be5-85bd-0b4f588780e0" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.609275] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-690c96d5-eb4d-48e2-8d5e-d794cdf78fd1 taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.609503] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-690c96d5-eb4d-48e2-8d5e-d794cdf78fd1" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.609503] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-690c96d5-eb4d-48e2-8d5e-d794cdf78fd1" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.609731] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-690c96d5-eb4d-48e2-8d5e-d794cdf78fd1" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.609906] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.610198] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.610198] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.610367] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.610367] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.610506] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-690c96d5-eb4d-48e2-8d5e-d794cdf78fd1" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.610561] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-690c96d5-eb4d-48e2-8d5e-d794cdf78fd1 taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.610632] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-690c96d5-eb4d-48e2-8d5e-d794cdf78fd1" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.610686] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-690c96d5-eb4d-48e2-8d5e-d794cdf78fd1" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.610818] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-690c96d5-eb4d-48e2-8d5e-d794cdf78fd1" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.610988] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.611082] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.611082] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.611278] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.611372] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.611372] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-690c96d5-eb4d-48e2-8d5e-d794cdf78fd1" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.614237] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('690c96d5-eb4d-48e2-8d5e-d794cdf78fd1',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1094.632521] env[69980]: INFO networking_nsxv3.common.synchronization [None req-cae9e31a-a0ad-4515-b49d-e4ab346da9e4 tempest-AttachInterfacesTestJSON-1782090316 tempest-AttachInterfacesTestJSON-1782090316-project-member] Enqueued Resource ID: 400b642e-7f7e-4993-9916-a3e96af018da with Priority: HIGHEST for action security_group_rules [ 1094.632521] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 400b642e-7f7e-4993-9916-a3e96af018da with Priority: HIGHEST for action security_group_rules [ 1094.632521] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock rules-400b642e-7f7e-4993-9916-a3e96af018da taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.632521] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-400b642e-7f7e-4993-9916-a3e96af018da" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.632521] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-400b642e-7f7e-4993-9916-a3e96af018da" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.632521] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-400b642e-7f7e-4993-9916-a3e96af018da" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.632521] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('400b642e-7f7e-4993-9916-a3e96af018da',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1094.745112] env[69980]: INFO networking_nsxv3.common.synchronization [None req-1be8fd51-10a7-45fd-805e-cb580551aebe tempest-AttachInterfacesTestJSON-1782090316 tempest-AttachInterfacesTestJSON-1782090316-project-member] Enqueued Resource ID: 400b642e-7f7e-4993-9916-a3e96af018da with Priority: HIGHEST for action security_group_rules [ 1094.746591] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 400b642e-7f7e-4993-9916-a3e96af018da with Priority: HIGHEST for action security_group_rules [ 1094.747327] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock rules-400b642e-7f7e-4993-9916-a3e96af018da taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.747327] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-400b642e-7f7e-4993-9916-a3e96af018da" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.117101] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 690c96d5-eb4d-48e2-8d5e-d794cdf78fd1: rpc.has_security_group_logging(os_id): False [ 1095.137022] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.137022] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.137022] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.137022] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.137022] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.137022] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.137022] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.137022] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.137022] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.137022] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.137022] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.137022] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.137022] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.137022] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.137022] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.138103] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.138347] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.138501] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.138731] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.138901] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.139106] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 690c96d5-eb4d-48e2-8d5e-d794cdf78fd1 is going to be updated. [ 1095.156472] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.161384] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.161384] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.161384] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.161384] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.161384] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 400b642e-7f7e-4993-9916-a3e96af018da already deleted. [ 1095.161384] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-400b642e-7f7e-4993-9916-a3e96af018da" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.161384] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-400b642e-7f7e-4993-9916-a3e96af018da" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.161384] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-400b642e-7f7e-4993-9916-a3e96af018da" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.161384] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('400b642e-7f7e-4993-9916-a3e96af018da',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1095.171277] env[69980]: INFO networking_nsxv3.common.synchronization [req-abe92e1b-725c-4fcf-a6b0-41ebb0c554f2 req-fd35dc0f-f1c9-4939-96cf-ee9a5c2f1632 tempest-ServersTestMultiNic-322776819 tempest-ServersTestMultiNic-322776819-project-member] Enqueued Resource ID: 690c96d5-eb4d-48e2-8d5e-d794cdf78fd1 with Priority: HIGHEST for action security_group_members [ 1095.171277] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 690c96d5-eb4d-48e2-8d5e-d794cdf78fd1 with Priority: HIGHEST for action security_group_members [ 1095.171277] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-690c96d5-eb4d-48e2-8d5e-d794cdf78fd1 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.171277] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-690c96d5-eb4d-48e2-8d5e-d794cdf78fd1" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.171277] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-690c96d5-eb4d-48e2-8d5e-d794cdf78fd1" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.171277] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-690c96d5-eb4d-48e2-8d5e-d794cdf78fd1" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.171277] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.171277] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.171277] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.171277] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.171277] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.171277] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('690c96d5-eb4d-48e2-8d5e-d794cdf78fd1',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1095.202300] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.202477] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.202552] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.202797] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.202968] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.221724] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 690c96d5-eb4d-48e2-8d5e-d794cdf78fd1 in Status: IN_PROGRESS for 2s [ 1095.366261] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4eb0fe0d-cd04-4189-9b26-953ab87885bd in Status: SUCCESS [ 1095.366473] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4eb0fe0d-cd04-4189-9b26-953ab87885bd" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.366678] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4eb0fe0d-cd04-4189-9b26-953ab87885bd" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.366905] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4eb0fe0d-cd04-4189-9b26-953ab87885bd" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.367106] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.367226] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.367292] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.367449] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.367533] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.367630] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4eb0fe0d-cd04-4189-9b26-953ab87885bd',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1095.676884] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('690c96d5-eb4d-48e2-8d5e-d794cdf78fd1',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1095.686630] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.686847] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.686847] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.687039] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.687132] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.687256] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 400b642e-7f7e-4993-9916-a3e96af018da already deleted. [ 1095.687324] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-400b642e-7f7e-4993-9916-a3e96af018da" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.871718] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4eb0fe0d-cd04-4189-9b26-953ab87885bd',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1095.887348] env[69980]: INFO networking_nsxv3.common.synchronization [req-abe92e1b-725c-4fcf-a6b0-41ebb0c554f2 req-3afa1af5-1958-4fc0-915d-10fd2dfe1880 tempest-ServersTestMultiNic-322776819 tempest-ServersTestMultiNic-322776819-project-member] Enqueued Resource ID: 690c96d5-eb4d-48e2-8d5e-d794cdf78fd1 with Priority: HIGHEST for action security_group_members [ 1095.888734] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 690c96d5-eb4d-48e2-8d5e-d794cdf78fd1 with Priority: HIGHEST for action security_group_members [ 1095.888734] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-690c96d5-eb4d-48e2-8d5e-d794cdf78fd1 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.888734] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-690c96d5-eb4d-48e2-8d5e-d794cdf78fd1" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.179652] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('690c96d5-eb4d-48e2-8d5e-d794cdf78fd1',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1096.373969] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4eb0fe0d-cd04-4189-9b26-953ab87885bd',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1096.686414] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.686586] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.686666] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.686904] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.687087] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.687135] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 690c96d5-eb4d-48e2-8d5e-d794cdf78fd1 is going to be updated. [ 1096.713890] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.714043] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.714043] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.714363] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.714516] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.722777] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 690c96d5-eb4d-48e2-8d5e-d794cdf78fd1 in Status: IN_PROGRESS for 2s [ 1096.875928] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.876134] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.876211] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.876429] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.876521] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.876621] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4eb0fe0d-cd04-4189-9b26-953ab87885bd is going to be updated. [ 1096.902810] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.902810] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.903034] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.904144] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.904144] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.911606] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4eb0fe0d-cd04-4189-9b26-953ab87885bd in Status: IN_PROGRESS for 2s [ 1097.238530] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 690c96d5-eb4d-48e2-8d5e-d794cdf78fd1 in Status: SUCCESS [ 1097.238858] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-690c96d5-eb4d-48e2-8d5e-d794cdf78fd1" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.300229] env[69980]: INFO networking_nsxv3.common.synchronization [req-f7759958-e00c-4219-b570-c5894fdf6f0c req-d9cb9fa8-0419-4b88-b56b-87d9cc3dea6b tempest-ServerAddressesTestJSON-10287074 tempest-ServerAddressesTestJSON-10287074-project-member] Enqueued Resource ID: ac9b951b-012b-4de0-907c-958e8bf45b46 with Priority: HIGHEST for action security_group_members [ 1098.300790] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ac9b951b-012b-4de0-907c-958e8bf45b46 with Priority: HIGHEST for action security_group_members [ 1098.301139] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-ac9b951b-012b-4de0-907c-958e8bf45b46 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.301262] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ac9b951b-012b-4de0-907c-958e8bf45b46" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.304502] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ac9b951b-012b-4de0-907c-958e8bf45b46" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.305188] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ac9b951b-012b-4de0-907c-958e8bf45b46" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.305188] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.305188] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.305188] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.305385] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.305458] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.305648] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ac9b951b-012b-4de0-907c-958e8bf45b46',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1098.554533] env[69980]: INFO networking_nsxv3.common.synchronization [req-a28cd5a0-9129-4678-83f7-9c9c6a1bdbf7 req-e78679a1-8253-4d60-8a52-e6644b1e0585 tempest-ServersAdminTestJSON-1581544378 tempest-ServersAdminTestJSON-1581544378-project-member] Enqueued Resource ID: 700dc02a-f3c2-4363-9a0e-d7cdcb13a5b8 with Priority: HIGHEST for action security_group_members [ 1098.556166] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 700dc02a-f3c2-4363-9a0e-d7cdcb13a5b8 with Priority: HIGHEST for action security_group_members [ 1098.556166] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-700dc02a-f3c2-4363-9a0e-d7cdcb13a5b8 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.556166] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-700dc02a-f3c2-4363-9a0e-d7cdcb13a5b8" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.556166] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-700dc02a-f3c2-4363-9a0e-d7cdcb13a5b8" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.556166] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-700dc02a-f3c2-4363-9a0e-d7cdcb13a5b8" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.556166] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.556166] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.556166] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.556751] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.556751] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.556751] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('700dc02a-f3c2-4363-9a0e-d7cdcb13a5b8',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1098.867948] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock network-370 taken with stack trace [, , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.868042] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "network-370" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.868160] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "network-370" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.868438] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "network-370" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.868735] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.868898] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.869025] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.869253] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.869401] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.869629] env[69980]: DEBUG dogpile.cache.region [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] No value present for key: 'zone-id' {{(pid=69980) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1098.872575] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] NeedRegenerationException {{(pid=69980) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1098.872575] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] no value, waiting for create lock {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1098.872575] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] value creation lock acquired {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1098.872575] env[69980]: DEBUG dogpile.cache.region [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] No value present for key: 'zone-id' {{(pid=69980) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1098.872575] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Calling creation function for not-yet-present value {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1098.872575] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1098.872575] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 690c96d5-eb4d-48e2-8d5e-d794cdf78fd1 in Status: SUCCESS [ 1098.872575] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-690c96d5-eb4d-48e2-8d5e-d794cdf78fd1" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.873036] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.873036] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.873036] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.873036] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.873245] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.873294] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.873393] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.873445] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.873586] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.873660] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.873746] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ac9b951b-012b-4de0-907c-958e8bf45b46 already deleted. [ 1098.873822] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ac9b951b-012b-4de0-907c-958e8bf45b46" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.874562] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-690c96d5-eb4d-48e2-8d5e-d794cdf78fd1" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.874722] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-690c96d5-eb4d-48e2-8d5e-d794cdf78fd1" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.874865] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.874960] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.875026] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.875166] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.875240] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.875328] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('690c96d5-eb4d-48e2-8d5e-d794cdf78fd1',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1098.893044] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1098.893044] env[69980]: DEBUG dogpile.cache.region [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=69980) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1098.893044] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Released creation lock {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1098.893317] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "network-370" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.893674] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock port-53dffda4-7fd5-4f81-a204-a58d3f95a662 taken with stack trace [, , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.893798] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "port-53dffda4-7fd5-4f81-a204-a58d3f95a662" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.893841] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "port-53dffda4-7fd5-4f81-a204-a58d3f95a662" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.894181] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "port-53dffda4-7fd5-4f81-a204-a58d3f95a662" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.894324] env[69980]: DEBUG networking_nsxv3.api.rpc [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('53dffda4-7fd5-4f81-a204-a58d3f95a662',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1098.921304] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4eb0fe0d-cd04-4189-9b26-953ab87885bd in Status: SUCCESS [ 1098.921449] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4eb0fe0d-cd04-4189-9b26-953ab87885bd" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.921491] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4eb0fe0d-cd04-4189-9b26-953ab87885bd" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.921681] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4eb0fe0d-cd04-4189-9b26-953ab87885bd" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.921863] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.921974] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.922047] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.922198] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.922278] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.922360] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4eb0fe0d-cd04-4189-9b26-953ab87885bd" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.922448] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('4eb0fe0d-cd04-4189-9b26-953ab87885bd',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1099.059974] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('700dc02a-f3c2-4363-9a0e-d7cdcb13a5b8',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1099.379274] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.379574] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.379574] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.379812] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.379812] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.379986] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.380103] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.380149] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.380298] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.380370] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.380456] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 690c96d5-eb4d-48e2-8d5e-d794cdf78fd1 is going to be updated. [ 1099.397059] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.397289] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.397418] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.397710] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.397866] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.398033] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Segment Port 53dffda4-7fd5-4f81-a204-a58d3f95a662 not found, creating... [ 1099.398305] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.398462] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.399880] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.399880] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.399880] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.399880] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.399880] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.399880] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.400410] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.400410] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.400410] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Resource: SegmentPort with ID: 53dffda4-7fd5-4f81-a204-a58d3f95a662 is going to be created. [ 1099.424648] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-4eb0fe0d-cd04-4189-9b26-953ab87885bd taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.424866] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4eb0fe0d-cd04-4189-9b26-953ab87885bd" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.424939] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4eb0fe0d-cd04-4189-9b26-953ab87885bd" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.425292] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4eb0fe0d-cd04-4189-9b26-953ab87885bd" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.425488] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.425658] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.425658] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.425813] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.425912] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.425994] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4eb0fe0d-cd04-4189-9b26-953ab87885bd" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.426176] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-4eb0fe0d-cd04-4189-9b26-953ab87885bd taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.426276] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4eb0fe0d-cd04-4189-9b26-953ab87885bd" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.426334] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4eb0fe0d-cd04-4189-9b26-953ab87885bd" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.426494] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4eb0fe0d-cd04-4189-9b26-953ab87885bd" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.426639] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.426730] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.426785] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.426932] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.427616] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.427616] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4eb0fe0d-cd04-4189-9b26-953ab87885bd" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.427616] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('4eb0fe0d-cd04-4189-9b26-953ab87885bd',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1099.431426] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.431641] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.431761] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.432052] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.432282] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.432508] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "port-53dffda4-7fd5-4f81-a204-a58d3f95a662" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.434028] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.434156] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.434222] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.435156] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.435156] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.444094] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 690c96d5-eb4d-48e2-8d5e-d794cdf78fd1 in Status: IN_PROGRESS for 2s [ 1099.561837] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('700dc02a-f3c2-4363-9a0e-d7cdcb13a5b8',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1099.930442] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 4eb0fe0d-cd04-4189-9b26-953ab87885bd: rpc.has_security_group_logging(os_id): False [ 1099.950295] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.951637] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.952033] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.952811] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.952953] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.953251] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.953565] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.953639] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.954133] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.954940] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.955266] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.955441] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.955441] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.955904] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.955904] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.956114] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.956221] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.956307] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.956481] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.956606] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.956721] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4eb0fe0d-cd04-4189-9b26-953ab87885bd is going to be updated. [ 1100.015061] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.015272] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.015272] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.015435] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.015607] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.027930] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4eb0fe0d-cd04-4189-9b26-953ab87885bd in Status: IN_PROGRESS for 2s [ 1100.039570] env[69980]: INFO networking_nsxv3.common.synchronization [req-f7759958-e00c-4219-b570-c5894fdf6f0c req-282b0f4d-3bc0-4571-849d-d5e4922b95c1 service nova] Enqueued Resource ID: ac9b951b-012b-4de0-907c-958e8bf45b46 with Priority: HIGHEST for action security_group_rules [ 1100.039838] env[69980]: INFO networking_nsxv3.common.synchronization [req-f7759958-e00c-4219-b570-c5894fdf6f0c req-282b0f4d-3bc0-4571-849d-d5e4922b95c1 service nova] Enqueued Resource ID: ac9b951b-012b-4de0-907c-958e8bf45b46 with Priority: HIGHEST for action security_group_members [ 1100.039910] env[69980]: INFO networking_nsxv3.common.synchronization [req-f7759958-e00c-4219-b570-c5894fdf6f0c req-282b0f4d-3bc0-4571-849d-d5e4922b95c1 service nova] Enqueued Resource ID: 53dffda4-7fd5-4f81-a204-a58d3f95a662 with Priority: HIGHEST for action port [ 1100.040167] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ac9b951b-012b-4de0-907c-958e8bf45b46 with Priority: HIGHEST for action security_group_rules [ 1100.040298] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ac9b951b-012b-4de0-907c-958e8bf45b46 with Priority: HIGHEST for action security_group_members [ 1100.040416] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 53dffda4-7fd5-4f81-a204-a58d3f95a662 with Priority: HIGHEST for action port [ 1100.040921] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ac9b951b-012b-4de0-907c-958e8bf45b46 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.042628] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ac9b951b-012b-4de0-907c-958e8bf45b46" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.042628] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ac9b951b-012b-4de0-907c-958e8bf45b46" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.042628] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ac9b951b-012b-4de0-907c-958e8bf45b46" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.042628] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ac9b951b-012b-4de0-907c-958e8bf45b46',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1100.044025] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-ac9b951b-012b-4de0-907c-958e8bf45b46 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.045228] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ac9b951b-012b-4de0-907c-958e8bf45b46" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.045340] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ac9b951b-012b-4de0-907c-958e8bf45b46" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.045594] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ac9b951b-012b-4de0-907c-958e8bf45b46" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.046112] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.046227] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.046294] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.046466] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.046625] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.046679] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ac9b951b-012b-4de0-907c-958e8bf45b46',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1100.047483] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock port-53dffda4-7fd5-4f81-a204-a58d3f95a662 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.047586] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-53dffda4-7fd5-4f81-a204-a58d3f95a662" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.047659] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-53dffda4-7fd5-4f81-a204-a58d3f95a662" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.047806] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-53dffda4-7fd5-4f81-a204-a58d3f95a662" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.047883] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('53dffda4-7fd5-4f81-a204-a58d3f95a662',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1100.064553] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.064718] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.064762] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.064961] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.065053] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.065169] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 700dc02a-f3c2-4363-9a0e-d7cdcb13a5b8 is going to be updated. [ 1100.094747] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.094911] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.095019] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.095194] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.095334] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.107136] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 700dc02a-f3c2-4363-9a0e-d7cdcb13a5b8 in Status: IN_PROGRESS for 2s [ 1100.550084] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ac9b951b-012b-4de0-907c-958e8bf45b46',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1100.550934] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-ac9b951b-012b-4de0-907c-958e8bf45b46 taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.551054] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ac9b951b-012b-4de0-907c-958e8bf45b46" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.551465] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 53dffda4-7fd5-4f81-a204-a58d3f95a662 with status ACTIVE [ 1100.551573] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.551679] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.551748] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.551943] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.552394] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.552394] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.552394] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.552394] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.552590] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.552590] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.552746] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.552816] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.552871] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.553011] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.553082] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.553163] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 53dffda4-7fd5-4f81-a204-a58d3f95a662 is going to be updated. [ 1100.584413] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.584638] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.584724] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.584930] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.585078] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.585236] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-53dffda4-7fd5-4f81-a204-a58d3f95a662" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.703067] env[69980]: INFO networking_nsxv3.common.synchronization [req-a1b9f3a6-7208-481b-a9cd-7968d2933198 req-5f2dd8a1-5033-4a2b-be50-89739131786e tempest-ServersNegativeTestJSON-1861659283 tempest-ServersNegativeTestJSON-1861659283-project-member] Enqueued Resource ID: f44b2d06-c9ca-4621-a354-74c006769956 with Priority: HIGHEST for action security_group_members [ 1100.703576] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f44b2d06-c9ca-4621-a354-74c006769956 with Priority: HIGHEST for action security_group_members [ 1100.704663] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-f44b2d06-c9ca-4621-a354-74c006769956 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.704663] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f44b2d06-c9ca-4621-a354-74c006769956" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.704663] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f44b2d06-c9ca-4621-a354-74c006769956" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.704663] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f44b2d06-c9ca-4621-a354-74c006769956" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.704663] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.704663] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.704663] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.704974] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.704974] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.704974] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f44b2d06-c9ca-4621-a354-74c006769956',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1101.052098] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ac9b951b-012b-4de0-907c-958e8bf45b46',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1101.208576] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.208748] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.208803] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.209036] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.209128] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.210651] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.210980] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.211066] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.211241] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.211321] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.211416] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f44b2d06-c9ca-4621-a354-74c006769956 is going to be updated. [ 1101.240171] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.240171] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.240306] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.240609] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.240609] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.249876] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f44b2d06-c9ca-4621-a354-74c006769956 in Status: IN_PROGRESS for 2s [ 1101.352638] env[69980]: INFO networking_nsxv3.common.synchronization [req-e51611d6-dd85-4483-a9ac-c77b3182a8d8 req-ff080e6d-9528-41d7-aaa9-f86b22564c22 tempest-ServerActionsV293TestJSON-116352925 tempest-ServerActionsV293TestJSON-116352925-project-member] Enqueued Resource ID: 194841ae-0965-407f-a2bf-6d1f7693c801 with Priority: HIGHEST for action security_group_members [ 1101.353319] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 194841ae-0965-407f-a2bf-6d1f7693c801 with Priority: HIGHEST for action security_group_members [ 1101.356041] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-194841ae-0965-407f-a2bf-6d1f7693c801 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.356167] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-194841ae-0965-407f-a2bf-6d1f7693c801" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.356167] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-194841ae-0965-407f-a2bf-6d1f7693c801" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.356386] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-194841ae-0965-407f-a2bf-6d1f7693c801" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.356576] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.356720] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.356769] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.356934] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.357061] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.357129] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('194841ae-0965-407f-a2bf-6d1f7693c801',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1101.452217] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 690c96d5-eb4d-48e2-8d5e-d794cdf78fd1 in Status: SUCCESS [ 1101.452401] env[69980]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 690c96d5-eb4d-48e2-8d5e-d794cdf78fd1 deletion is rescheduled due to dependency. [ 1101.452529] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-690c96d5-eb4d-48e2-8d5e-d794cdf78fd1" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.555161] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.555433] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.555433] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.555595] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.555709] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.555817] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ac9b951b-012b-4de0-907c-958e8bf45b46 is going to be created. [ 1101.578047] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.578195] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.578265] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.578470] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.579585] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.591858] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ac9b951b-012b-4de0-907c-958e8bf45b46 in Status: UNINITIALIZED for 2s [ 1101.859443] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.859941] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.859941] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.860095] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.860228] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.860595] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.860595] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.861612] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.861612] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.861612] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.861612] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 194841ae-0965-407f-a2bf-6d1f7693c801 is going to be updated. [ 1101.893336] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.893336] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.893336] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.893336] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.893336] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.901230] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 194841ae-0965-407f-a2bf-6d1f7693c801 in Status: IN_PROGRESS for 2s [ 1102.040301] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4eb0fe0d-cd04-4189-9b26-953ab87885bd in Status: SUCCESS [ 1102.040758] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4eb0fe0d-cd04-4189-9b26-953ab87885bd" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.118361] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 700dc02a-f3c2-4363-9a0e-d7cdcb13a5b8 in Status: SUCCESS [ 1102.118838] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-700dc02a-f3c2-4363-9a0e-d7cdcb13a5b8" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.928600] env[69980]: INFO networking_nsxv3.common.synchronization [req-a1810d90-1787-47cf-9650-064c4e202fd0 req-3c32a6ca-2d6a-4259-aa80-8425d1ddfbaa tempest-ImagesTestJSON-600722714 tempest-ImagesTestJSON-600722714-project-member] Enqueued Resource ID: 80e3ea48-91a5-4863-b1c2-f3e887204e39 with Priority: HIGHEST for action security_group_members [ 1102.929863] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 80e3ea48-91a5-4863-b1c2-f3e887204e39 with Priority: HIGHEST for action security_group_members [ 1102.931172] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-80e3ea48-91a5-4863-b1c2-f3e887204e39 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.931252] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-80e3ea48-91a5-4863-b1c2-f3e887204e39" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.931298] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-80e3ea48-91a5-4863-b1c2-f3e887204e39" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.931570] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-80e3ea48-91a5-4863-b1c2-f3e887204e39" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.931743] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.931868] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.931907] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.932089] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.932180] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.932246] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('80e3ea48-91a5-4863-b1c2-f3e887204e39',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1103.259146] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f44b2d06-c9ca-4621-a354-74c006769956 in Status: SUCCESS [ 1103.259619] env[69980]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f44b2d06-c9ca-4621-a354-74c006769956 deletion is rescheduled due to dependency. [ 1103.259619] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f44b2d06-c9ca-4621-a354-74c006769956" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.427615] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock network-136 taken with stack trace [, , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.427896] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "network-136" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.427991] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "network-136" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.428770] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "network-136" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.428770] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.429071] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.429071] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.429438] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.429438] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.429651] env[69980]: DEBUG dogpile.cache.region [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] No value present for key: 'zone-id' {{(pid=69980) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1103.429772] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] NeedRegenerationException {{(pid=69980) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1103.429887] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] no value, waiting for create lock {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1103.430025] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] value creation lock acquired {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1103.430146] env[69980]: DEBUG dogpile.cache.region [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] No value present for key: 'zone-id' {{(pid=69980) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1103.430256] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Calling creation function for not-yet-present value {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1103.430395] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1103.435725] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.435860] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.435930] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.436138] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.436231] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.436424] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.436526] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.436582] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.436755] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.436891] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.436942] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 80e3ea48-91a5-4863-b1c2-f3e887204e39 is going to be updated. [ 1103.449375] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1103.449550] env[69980]: DEBUG dogpile.cache.region [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=69980) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1103.449731] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Released creation lock {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1103.449928] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "network-136" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.450276] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock port-a74e3699-62f7-4a04-b25a-0fa55bdf178e taken with stack trace [, , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.450472] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "port-a74e3699-62f7-4a04-b25a-0fa55bdf178e" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.450616] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "port-a74e3699-62f7-4a04-b25a-0fa55bdf178e" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.450991] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "port-a74e3699-62f7-4a04-b25a-0fa55bdf178e" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.451169] env[69980]: DEBUG networking_nsxv3.api.rpc [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a74e3699-62f7-4a04-b25a-0fa55bdf178e',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1103.461200] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.461358] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.461427] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.461644] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.461781] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.470012] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 80e3ea48-91a5-4863-b1c2-f3e887204e39 in Status: IN_PROGRESS for 2s [ 1103.611200] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ac9b951b-012b-4de0-907c-958e8bf45b46 in Status: SUCCESS [ 1103.611259] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ac9b951b-012b-4de0-907c-958e8bf45b46" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.611431] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ac9b951b-012b-4de0-907c-958e8bf45b46" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.611653] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ac9b951b-012b-4de0-907c-958e8bf45b46" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.611856] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.611968] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.612041] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.612241] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.612326] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.612479] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ac9b951b-012b-4de0-907c-958e8bf45b46" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.612565] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ac9b951b-012b-4de0-907c-958e8bf45b46',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1103.912027] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 194841ae-0965-407f-a2bf-6d1f7693c801 in Status: SUCCESS [ 1103.912027] env[69980]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 194841ae-0965-407f-a2bf-6d1f7693c801 deletion is rescheduled due to dependency. [ 1103.912027] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-194841ae-0965-407f-a2bf-6d1f7693c801" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.954074] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.954415] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.954415] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.954730] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.954806] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.955016] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Segment Port a74e3699-62f7-4a04-b25a-0fa55bdf178e not found, creating... [ 1103.956062] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.956062] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.956062] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.956062] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.956062] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.956513] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.956513] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.956513] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.956769] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.956916] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.958010] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Resource: SegmentPort with ID: a74e3699-62f7-4a04-b25a-0fa55bdf178e is going to be created. [ 1103.975440] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.975440] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.975440] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.975701] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.975814] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.976053] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "port-a74e3699-62f7-4a04-b25a-0fa55bdf178e" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.116767] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-ac9b951b-012b-4de0-907c-958e8bf45b46 taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.116767] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ac9b951b-012b-4de0-907c-958e8bf45b46" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.116978] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ac9b951b-012b-4de0-907c-958e8bf45b46" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.117078] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ac9b951b-012b-4de0-907c-958e8bf45b46" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.117254] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.117350] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.117413] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.117564] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.117651] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.117739] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ac9b951b-012b-4de0-907c-958e8bf45b46" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.117889] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-ac9b951b-012b-4de0-907c-958e8bf45b46 taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.117971] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ac9b951b-012b-4de0-907c-958e8bf45b46" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.118041] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ac9b951b-012b-4de0-907c-958e8bf45b46" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.118186] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ac9b951b-012b-4de0-907c-958e8bf45b46" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.118321] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.118408] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.118465] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.118589] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.118711] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.118815] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ac9b951b-012b-4de0-907c-958e8bf45b46" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.118903] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ac9b951b-012b-4de0-907c-958e8bf45b46',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1104.621644] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ac9b951b-012b-4de0-907c-958e8bf45b46: rpc.has_security_group_logging(os_id): False [ 1104.640280] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.640888] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.640888] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.640888] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.640888] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.641343] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.641475] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.641821] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.644132] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.644132] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.644132] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.644132] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.644132] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.644132] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.644132] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.644132] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.644132] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.644132] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.644132] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.644132] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.644132] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ac9b951b-012b-4de0-907c-958e8bf45b46 is going to be created. [ 1104.700424] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.700586] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.700636] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.700923] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.701030] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.714482] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ac9b951b-012b-4de0-907c-958e8bf45b46 in Status: IN_PROGRESS for 2s [ 1104.802017] env[69980]: INFO networking_nsxv3.common.synchronization [req-8182226e-88b6-4ee7-abc2-c4831be25525 req-13268128-cbbd-4ed5-8fce-ab7ecfccd9b6 tempest-ServerActionsTestOtherA-1240783872 tempest-ServerActionsTestOtherA-1240783872-project-member] Enqueued Resource ID: 724b248c-fcba-4659-94d6-7aefe563ad89 with Priority: HIGHEST for action security_group_members [ 1104.802553] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 724b248c-fcba-4659-94d6-7aefe563ad89 with Priority: HIGHEST for action security_group_members [ 1104.802862] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-724b248c-fcba-4659-94d6-7aefe563ad89 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.802987] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-724b248c-fcba-4659-94d6-7aefe563ad89" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.803061] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-724b248c-fcba-4659-94d6-7aefe563ad89" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.803264] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-724b248c-fcba-4659-94d6-7aefe563ad89" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.803423] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.803516] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.803615] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.803714] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.803800] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.803884] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('724b248c-fcba-4659-94d6-7aefe563ad89',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1105.122437] env[69980]: INFO networking_nsxv3.common.synchronization [req-a1810d90-1787-47cf-9650-064c4e202fd0 req-74bad7eb-3669-4359-a1f0-d6b3d37b6eff service nova] Enqueued Resource ID: 80e3ea48-91a5-4863-b1c2-f3e887204e39 with Priority: HIGHEST for action security_group_rules [ 1105.122437] env[69980]: INFO networking_nsxv3.common.synchronization [req-a1810d90-1787-47cf-9650-064c4e202fd0 req-74bad7eb-3669-4359-a1f0-d6b3d37b6eff service nova] Enqueued Resource ID: 80e3ea48-91a5-4863-b1c2-f3e887204e39 with Priority: HIGHEST for action security_group_members [ 1105.122437] env[69980]: INFO networking_nsxv3.common.synchronization [req-a1810d90-1787-47cf-9650-064c4e202fd0 req-74bad7eb-3669-4359-a1f0-d6b3d37b6eff service nova] Enqueued Resource ID: a74e3699-62f7-4a04-b25a-0fa55bdf178e with Priority: HIGHEST for action port [ 1105.123148] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 80e3ea48-91a5-4863-b1c2-f3e887204e39 with Priority: HIGHEST for action security_group_rules [ 1105.123148] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 80e3ea48-91a5-4863-b1c2-f3e887204e39 with Priority: HIGHEST for action security_group_members [ 1105.123148] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a74e3699-62f7-4a04-b25a-0fa55bdf178e with Priority: HIGHEST for action port [ 1105.123421] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock rules-80e3ea48-91a5-4863-b1c2-f3e887204e39 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.123421] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-80e3ea48-91a5-4863-b1c2-f3e887204e39" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.123575] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-80e3ea48-91a5-4863-b1c2-f3e887204e39" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.123720] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-80e3ea48-91a5-4863-b1c2-f3e887204e39" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.123720] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('80e3ea48-91a5-4863-b1c2-f3e887204e39',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1105.124641] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-80e3ea48-91a5-4863-b1c2-f3e887204e39 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.124641] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-80e3ea48-91a5-4863-b1c2-f3e887204e39" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.124833] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock port-a74e3699-62f7-4a04-b25a-0fa55bdf178e taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.128088] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a74e3699-62f7-4a04-b25a-0fa55bdf178e" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.128088] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a74e3699-62f7-4a04-b25a-0fa55bdf178e" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.128088] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a74e3699-62f7-4a04-b25a-0fa55bdf178e" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.128088] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a74e3699-62f7-4a04-b25a-0fa55bdf178e',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1105.311227] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.311227] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.311227] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.311227] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.311227] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.311227] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.311227] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.311227] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.311227] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.311227] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.311227] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 724b248c-fcba-4659-94d6-7aefe563ad89 is going to be updated. [ 1105.337113] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.337113] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.337113] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.337113] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.337113] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.344196] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 724b248c-fcba-4659-94d6-7aefe563ad89 in Status: IN_PROGRESS for 2s [ 1105.483855] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 80e3ea48-91a5-4863-b1c2-f3e887204e39 in Status: SUCCESS [ 1105.484032] env[69980]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 80e3ea48-91a5-4863-b1c2-f3e887204e39 deletion is rescheduled due to dependency. [ 1105.484143] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-80e3ea48-91a5-4863-b1c2-f3e887204e39" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.484300] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-80e3ea48-91a5-4863-b1c2-f3e887204e39" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.484515] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-80e3ea48-91a5-4863-b1c2-f3e887204e39" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.484697] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.484812] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.484874] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.485038] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.485117] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.486381] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('80e3ea48-91a5-4863-b1c2-f3e887204e39',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1105.626959] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-80e3ea48-91a5-4863-b1c2-f3e887204e39 taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.627159] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-80e3ea48-91a5-4863-b1c2-f3e887204e39" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.627248] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a74e3699-62f7-4a04-b25a-0fa55bdf178e with status ACTIVE [ 1105.627414] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.627524] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.627591] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.627805] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.627896] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.628193] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.628193] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.628347] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.628409] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.628492] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.628674] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.628792] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.628883] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.629050] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.629125] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.629206] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a74e3699-62f7-4a04-b25a-0fa55bdf178e is going to be updated. [ 1105.649758] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.649965] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.650078] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.650285] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.650418] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.650573] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a74e3699-62f7-4a04-b25a-0fa55bdf178e" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.987500] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('80e3ea48-91a5-4863-b1c2-f3e887204e39',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1106.490414] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('80e3ea48-91a5-4863-b1c2-f3e887204e39',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1106.725315] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ac9b951b-012b-4de0-907c-958e8bf45b46 in Status: SUCCESS [ 1106.725637] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ac9b951b-012b-4de0-907c-958e8bf45b46" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.993222] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.993465] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.993599] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.993845] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.993955] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.994106] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 80e3ea48-91a5-4863-b1c2-f3e887204e39 is going to be updated. [ 1107.021950] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.021950] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.021950] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.021950] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.021950] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.030432] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 80e3ea48-91a5-4863-b1c2-f3e887204e39 in Status: IN_PROGRESS for 2s [ 1107.353568] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 724b248c-fcba-4659-94d6-7aefe563ad89 in Status: SUCCESS [ 1107.353804] env[69980]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 724b248c-fcba-4659-94d6-7aefe563ad89 deletion is rescheduled due to dependency. [ 1107.353979] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-724b248c-fcba-4659-94d6-7aefe563ad89" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.041022] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 80e3ea48-91a5-4863-b1c2-f3e887204e39 in Status: SUCCESS [ 1109.041319] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-80e3ea48-91a5-4863-b1c2-f3e887204e39" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.041396] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-80e3ea48-91a5-4863-b1c2-f3e887204e39" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.041612] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-80e3ea48-91a5-4863-b1c2-f3e887204e39" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.041829] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.041972] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.042047] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.042215] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.042292] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.042377] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-80e3ea48-91a5-4863-b1c2-f3e887204e39" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.042465] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('80e3ea48-91a5-4863-b1c2-f3e887204e39',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1109.545504] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-80e3ea48-91a5-4863-b1c2-f3e887204e39 taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.545718] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-80e3ea48-91a5-4863-b1c2-f3e887204e39" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.545800] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-80e3ea48-91a5-4863-b1c2-f3e887204e39" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.545993] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-80e3ea48-91a5-4863-b1c2-f3e887204e39" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.546303] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.546412] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.546412] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.546596] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.546781] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.546876] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-80e3ea48-91a5-4863-b1c2-f3e887204e39" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.546972] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-80e3ea48-91a5-4863-b1c2-f3e887204e39 taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.547090] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-80e3ea48-91a5-4863-b1c2-f3e887204e39" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.547153] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-80e3ea48-91a5-4863-b1c2-f3e887204e39" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.547300] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-80e3ea48-91a5-4863-b1c2-f3e887204e39" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.547442] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.547534] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.547589] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.547723] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.547811] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.547894] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-80e3ea48-91a5-4863-b1c2-f3e887204e39" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.547983] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('80e3ea48-91a5-4863-b1c2-f3e887204e39',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1110.051017] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 80e3ea48-91a5-4863-b1c2-f3e887204e39: rpc.has_security_group_logging(os_id): False [ 1110.070030] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.070030] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.070235] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.070419] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.070419] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.070644] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.070783] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.070783] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.070947] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.071044] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.071248] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.071375] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.071453] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.071527] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.071603] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.071783] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.071915] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.071915] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.072075] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.072151] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.072221] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 80e3ea48-91a5-4863-b1c2-f3e887204e39 is going to be updated. [ 1110.124551] env[69980]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1110.124758] env[69980]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1110.137152] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.137452] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.137452] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.137737] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.137989] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.155873] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 80e3ea48-91a5-4863-b1c2-f3e887204e39 in Status: IN_PROGRESS for 2s [ 1111.468098] env[69980]: INFO networking_nsxv3.common.synchronization [req-b9c822c3-c8c8-45dc-b063-4d59448e4081 req-4ead72a4-a6bf-4414-8ef3-5f208f7ed0c2 tempest-DeleteServersTestJSON-1084822395 tempest-DeleteServersTestJSON-1084822395-project-member] Enqueued Resource ID: d0e04be7-8718-489c-8ceb-fe661da4855a with Priority: HIGHEST for action security_group_members [ 1111.469389] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d0e04be7-8718-489c-8ceb-fe661da4855a with Priority: HIGHEST for action security_group_members [ 1111.470198] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-d0e04be7-8718-489c-8ceb-fe661da4855a taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.470198] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d0e04be7-8718-489c-8ceb-fe661da4855a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.470309] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d0e04be7-8718-489c-8ceb-fe661da4855a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.470477] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d0e04be7-8718-489c-8ceb-fe661da4855a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.470637] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.470813] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.470872] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.471072] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.471146] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.471212] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d0e04be7-8718-489c-8ceb-fe661da4855a',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1111.487237] env[69980]: INFO networking_nsxv3.common.synchronization [req-779ddc7a-bb2a-4394-bbd0-e68dd2b40990 req-f18a7995-e694-4986-ad6c-05ce14c2ed21 tempest-ServerAddressesTestJSON-10287074 tempest-ServerAddressesTestJSON-10287074-project-member] Enqueued Resource ID: ac9b951b-012b-4de0-907c-958e8bf45b46 with Priority: HIGHEST for action security_group_members [ 1111.487237] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ac9b951b-012b-4de0-907c-958e8bf45b46 with Priority: HIGHEST for action security_group_members [ 1111.487237] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-ac9b951b-012b-4de0-907c-958e8bf45b46 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.488668] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ac9b951b-012b-4de0-907c-958e8bf45b46" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.488858] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ac9b951b-012b-4de0-907c-958e8bf45b46" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.489174] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ac9b951b-012b-4de0-907c-958e8bf45b46" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.489469] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.491145] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.491145] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.491145] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.491145] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.491145] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ac9b951b-012b-4de0-907c-958e8bf45b46',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1111.900661] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock network-478 taken with stack trace [, , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.900977] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "network-478" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.901199] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "network-478" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.901570] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "network-478" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.901890] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.902115] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.902276] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.902530] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.902720] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.903202] env[69980]: DEBUG dogpile.cache.region [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] No value present for key: 'zone-id' {{(pid=69980) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1111.903353] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] NeedRegenerationException {{(pid=69980) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1111.903469] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] no value, waiting for create lock {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1111.903583] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] value creation lock acquired {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1111.903697] env[69980]: DEBUG dogpile.cache.region [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] No value present for key: 'zone-id' {{(pid=69980) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1111.903811] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Calling creation function for not-yet-present value {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1111.903943] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1111.922438] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1111.922634] env[69980]: DEBUG dogpile.cache.region [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=69980) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1111.922815] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Released creation lock {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1111.923054] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "network-478" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.923442] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock port-fc57780a-f811-4304-84bb-9958f72958d1 taken with stack trace [, , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.923781] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "port-fc57780a-f811-4304-84bb-9958f72958d1" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.923910] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "port-fc57780a-f811-4304-84bb-9958f72958d1" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.924357] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "port-fc57780a-f811-4304-84bb-9958f72958d1" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.924562] env[69980]: DEBUG networking_nsxv3.api.rpc [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fc57780a-f811-4304-84bb-9958f72958d1',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1111.973626] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.973626] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.973626] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.974752] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.974752] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.974752] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.974752] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.974915] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.974998] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.975101] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.975190] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d0e04be7-8718-489c-8ceb-fe661da4855a is going to be updated. [ 1111.993847] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.993847] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.993847] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.993847] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.994150] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.994186] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.994309] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.994374] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.994543] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.994625] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.994718] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ac9b951b-012b-4de0-907c-958e8bf45b46 is going to be updated. [ 1111.999611] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.999836] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.999951] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.000160] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.000357] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.007488] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d0e04be7-8718-489c-8ceb-fe661da4855a in Status: IN_PROGRESS for 2s [ 1112.020380] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.020804] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.020950] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.021115] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.021254] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.028655] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ac9b951b-012b-4de0-907c-958e8bf45b46 in Status: IN_PROGRESS for 2s [ 1112.213848] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 80e3ea48-91a5-4863-b1c2-f3e887204e39 in Status: SUCCESS [ 1112.214090] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-80e3ea48-91a5-4863-b1c2-f3e887204e39" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.426840] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.427120] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.427236] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.427533] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.427727] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.427897] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Segment Port fc57780a-f811-4304-84bb-9958f72958d1 not found, creating... [ 1112.428227] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.428418] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.428544] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.428772] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.428968] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.429313] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.429476] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.429982] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.430350] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.430617] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.430651] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Resource: SegmentPort with ID: fc57780a-f811-4304-84bb-9958f72958d1 is going to be created. [ 1112.456267] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.457038] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.457038] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.457257] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.457447] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.457770] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "port-fc57780a-f811-4304-84bb-9958f72958d1" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.171129] env[69980]: INFO networking_nsxv3.common.synchronization [req-b9c822c3-c8c8-45dc-b063-4d59448e4081 req-6f20c210-ed7d-4c77-8de7-584192bbc929 service nova] Enqueued Resource ID: d0e04be7-8718-489c-8ceb-fe661da4855a with Priority: HIGHEST for action security_group_rules [ 1113.171129] env[69980]: INFO networking_nsxv3.common.synchronization [req-b9c822c3-c8c8-45dc-b063-4d59448e4081 req-6f20c210-ed7d-4c77-8de7-584192bbc929 service nova] Enqueued Resource ID: d0e04be7-8718-489c-8ceb-fe661da4855a with Priority: HIGHEST for action security_group_members [ 1113.171129] env[69980]: INFO networking_nsxv3.common.synchronization [req-b9c822c3-c8c8-45dc-b063-4d59448e4081 req-6f20c210-ed7d-4c77-8de7-584192bbc929 service nova] Enqueued Resource ID: fc57780a-f811-4304-84bb-9958f72958d1 with Priority: HIGHEST for action port [ 1113.171595] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d0e04be7-8718-489c-8ceb-fe661da4855a with Priority: HIGHEST for action security_group_rules [ 1113.171682] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d0e04be7-8718-489c-8ceb-fe661da4855a with Priority: HIGHEST for action security_group_members [ 1113.171781] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fc57780a-f811-4304-84bb-9958f72958d1 with Priority: HIGHEST for action port [ 1113.172323] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d0e04be7-8718-489c-8ceb-fe661da4855a taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.172476] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d0e04be7-8718-489c-8ceb-fe661da4855a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.172543] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d0e04be7-8718-489c-8ceb-fe661da4855a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.172750] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d0e04be7-8718-489c-8ceb-fe661da4855a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.172873] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d0e04be7-8718-489c-8ceb-fe661da4855a',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1113.175078] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-d0e04be7-8718-489c-8ceb-fe661da4855a taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.175078] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d0e04be7-8718-489c-8ceb-fe661da4855a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.175078] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock port-fc57780a-f811-4304-84bb-9958f72958d1 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.179352] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fc57780a-f811-4304-84bb-9958f72958d1" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.179352] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fc57780a-f811-4304-84bb-9958f72958d1" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.179352] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fc57780a-f811-4304-84bb-9958f72958d1" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.179352] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fc57780a-f811-4304-84bb-9958f72958d1',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1113.681112] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-d0e04be7-8718-489c-8ceb-fe661da4855a taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.681112] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d0e04be7-8718-489c-8ceb-fe661da4855a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.681112] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port fc57780a-f811-4304-84bb-9958f72958d1 with status ACTIVE [ 1113.681112] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.681112] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.681112] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.681112] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.681112] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.681112] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.681527] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.681527] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.681527] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.681527] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.681641] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.682724] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.682724] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.682724] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.682724] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.682724] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: fc57780a-f811-4304-84bb-9958f72958d1 is going to be updated. [ 1113.715400] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.715544] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.715673] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.715924] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.716101] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.716274] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fc57780a-f811-4304-84bb-9958f72958d1" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.002938] env[69980]: INFO networking_nsxv3.common.synchronization [None req-972523ba-4819-43e7-adbf-8edb770f42f1 None None] Enqueued Resource ID: bb974b48-8d3d-47cb-b26d-ef92abf29faf with Priority: HIGHEST for action port [ 1114.003561] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bb974b48-8d3d-47cb-b26d-ef92abf29faf with Priority: HIGHEST for action port [ 1114.003939] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock port-bb974b48-8d3d-47cb-b26d-ef92abf29faf taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.004626] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-bb974b48-8d3d-47cb-b26d-ef92abf29faf" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.004705] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-bb974b48-8d3d-47cb-b26d-ef92abf29faf" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.005131] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-bb974b48-8d3d-47cb-b26d-ef92abf29faf" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.005231] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bb974b48-8d3d-47cb-b26d-ef92abf29faf',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1114.016809] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d0e04be7-8718-489c-8ceb-fe661da4855a in Status: SUCCESS [ 1114.017015] env[69980]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d0e04be7-8718-489c-8ceb-fe661da4855a deletion is rescheduled due to dependency. [ 1114.017131] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d0e04be7-8718-489c-8ceb-fe661da4855a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.017308] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d0e04be7-8718-489c-8ceb-fe661da4855a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.017861] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d0e04be7-8718-489c-8ceb-fe661da4855a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.017861] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.017861] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.018082] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.018082] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.018159] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.018944] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d0e04be7-8718-489c-8ceb-fe661da4855a',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1114.037139] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ac9b951b-012b-4de0-907c-958e8bf45b46 in Status: SUCCESS [ 1114.037477] env[69980]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ac9b951b-012b-4de0-907c-958e8bf45b46 deletion is rescheduled due to dependency. [ 1114.037644] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ac9b951b-012b-4de0-907c-958e8bf45b46" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.509198] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port bb974b48-8d3d-47cb-b26d-ef92abf29faf [ 1114.509452] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.510755] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.510755] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.510755] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.510755] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.510755] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:bb974b48-8d3d-47cb-b26d-ef92abf29faf already deleted. [ 1114.510755] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-bb974b48-8d3d-47cb-b26d-ef92abf29faf" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.521089] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d0e04be7-8718-489c-8ceb-fe661da4855a',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1115.025200] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d0e04be7-8718-489c-8ceb-fe661da4855a',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1115.094604] env[69980]: INFO networking_nsxv3.common.synchronization [None req-701febbd-0a1f-4ced-a54a-27d811c7462d tempest-ServersTestJSON-2066262947 tempest-ServersTestJSON-2066262947-project-member] Enqueued Resource ID: 69e79787-6675-42a5-b381-7ffa87e43ee6 with Priority: HIGHEST for action security_group_rules [ 1115.095299] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 69e79787-6675-42a5-b381-7ffa87e43ee6 with Priority: HIGHEST for action security_group_rules [ 1115.099057] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock rules-69e79787-6675-42a5-b381-7ffa87e43ee6 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.099057] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-69e79787-6675-42a5-b381-7ffa87e43ee6" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.099057] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-69e79787-6675-42a5-b381-7ffa87e43ee6" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.099057] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-69e79787-6675-42a5-b381-7ffa87e43ee6" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.099057] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('69e79787-6675-42a5-b381-7ffa87e43ee6',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1115.190348] env[69980]: INFO networking_nsxv3.common.synchronization [None req-60fed6bf-73a9-418f-b19d-905e56238c0b tempest-ServersTestJSON-2066262947 tempest-ServersTestJSON-2066262947-project-member] Enqueued Resource ID: 69e79787-6675-42a5-b381-7ffa87e43ee6 with Priority: HIGHEST for action security_group_rules [ 1115.190401] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 69e79787-6675-42a5-b381-7ffa87e43ee6 with Priority: HIGHEST for action security_group_rules [ 1115.190698] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock rules-69e79787-6675-42a5-b381-7ffa87e43ee6 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.190919] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-69e79787-6675-42a5-b381-7ffa87e43ee6" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.528555] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.528877] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.528877] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.529365] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.529365] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.529365] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d0e04be7-8718-489c-8ceb-fe661da4855a is going to be updated. [ 1115.573312] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.573478] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.573544] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.573834] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.574022] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.585348] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d0e04be7-8718-489c-8ceb-fe661da4855a in Status: IN_PROGRESS for 2s [ 1115.623438] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.623596] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.623731] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.623948] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.624101] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.624200] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 69e79787-6675-42a5-b381-7ffa87e43ee6 already deleted. [ 1115.624298] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-69e79787-6675-42a5-b381-7ffa87e43ee6" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.624486] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-69e79787-6675-42a5-b381-7ffa87e43ee6" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.624636] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-69e79787-6675-42a5-b381-7ffa87e43ee6" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.624912] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('69e79787-6675-42a5-b381-7ffa87e43ee6',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1115.859790] env[69980]: INFO networking_nsxv3.common.synchronization [req-1a340bb9-fc78-4836-bb0a-50b63ee33f6f req-9a407626-40fa-4ac0-bc6b-a8b97ea42035 tempest-AttachInterfacesV270Test-263525417 tempest-AttachInterfacesV270Test-263525417-project-member] Enqueued Resource ID: bc269af3-f7ab-4692-a55c-7c766575036f with Priority: HIGHEST for action security_group_members [ 1115.860362] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bc269af3-f7ab-4692-a55c-7c766575036f with Priority: HIGHEST for action security_group_members [ 1115.860691] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-bc269af3-f7ab-4692-a55c-7c766575036f taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.860819] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bc269af3-f7ab-4692-a55c-7c766575036f" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.860887] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bc269af3-f7ab-4692-a55c-7c766575036f" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.861252] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bc269af3-f7ab-4692-a55c-7c766575036f" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.861405] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.861498] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.861562] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.861721] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.861813] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.861931] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bc269af3-f7ab-4692-a55c-7c766575036f',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1116.149800] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.149961] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.150053] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.152809] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.152809] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.152809] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 69e79787-6675-42a5-b381-7ffa87e43ee6 already deleted. [ 1116.152809] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-69e79787-6675-42a5-b381-7ffa87e43ee6" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.325521] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock network-293 taken with stack trace [, , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.325776] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "network-293" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.325914] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "network-293" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.326301] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "network-293" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.326554] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.327543] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.327543] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.327845] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.328311] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.328654] env[69980]: DEBUG dogpile.cache.region [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] No value present for key: 'zone-id' {{(pid=69980) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1116.328840] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] NeedRegenerationException {{(pid=69980) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1116.329018] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] no value, waiting for create lock {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1116.329190] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] value creation lock acquired {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1116.329356] env[69980]: DEBUG dogpile.cache.region [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] No value present for key: 'zone-id' {{(pid=69980) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1116.329517] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Calling creation function for not-yet-present value {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1116.329823] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1116.351023] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1116.351023] env[69980]: DEBUG dogpile.cache.region [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=69980) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1116.351023] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Released creation lock {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1116.351023] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "network-293" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.351023] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock port-6d25c299-4516-4bb9-be48-70343a6ae40c taken with stack trace [, , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.351023] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "port-6d25c299-4516-4bb9-be48-70343a6ae40c" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.351023] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "port-6d25c299-4516-4bb9-be48-70343a6ae40c" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.353072] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "port-6d25c299-4516-4bb9-be48-70343a6ae40c" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.353072] env[69980]: DEBUG networking_nsxv3.api.rpc [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6d25c299-4516-4bb9-be48-70343a6ae40c',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1116.364705] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.365250] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.365408] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.366410] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.366410] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.366410] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.366584] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.366584] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.366829] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.366921] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.367613] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bc269af3-f7ab-4692-a55c-7c766575036f already deleted. [ 1116.367613] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bc269af3-f7ab-4692-a55c-7c766575036f" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.440222] env[69980]: INFO networking_nsxv3.common.synchronization [None req-9b69f186-2963-45f5-9492-45a5aa08c8a7 None None] Enqueued Resource ID: 4d08601b-8738-49ac-b063-b56d39750f63 with Priority: HIGHEST for action port [ 1116.440890] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4d08601b-8738-49ac-b063-b56d39750f63 with Priority: HIGHEST for action port [ 1116.442073] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock port-4d08601b-8738-49ac-b063-b56d39750f63 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.442527] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4d08601b-8738-49ac-b063-b56d39750f63" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.442632] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4d08601b-8738-49ac-b063-b56d39750f63" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.443617] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4d08601b-8738-49ac-b063-b56d39750f63" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.443884] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4d08601b-8738-49ac-b063-b56d39750f63',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1116.860653] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.861214] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.861214] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.861336] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.861469] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.861656] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Segment Port 6d25c299-4516-4bb9-be48-70343a6ae40c not found, creating... [ 1116.861932] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.862110] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.862249] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.862482] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.862628] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.862953] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.863124] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.863242] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.863471] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.863631] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.863767] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Resource: SegmentPort with ID: 6d25c299-4516-4bb9-be48-70343a6ae40c is going to be created. [ 1116.883058] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.883283] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.883408] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.883701] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.883938] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.884204] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "port-6d25c299-4516-4bb9-be48-70343a6ae40c" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.946434] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 4d08601b-8738-49ac-b063-b56d39750f63 [ 1116.946673] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.946923] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.947015] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.947247] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.947339] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.947440] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:4d08601b-8738-49ac-b063-b56d39750f63 already deleted. [ 1116.947519] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4d08601b-8738-49ac-b063-b56d39750f63" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.598889] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d0e04be7-8718-489c-8ceb-fe661da4855a in Status: SUCCESS [ 1117.599091] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d0e04be7-8718-489c-8ceb-fe661da4855a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.599322] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d0e04be7-8718-489c-8ceb-fe661da4855a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.599565] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d0e04be7-8718-489c-8ceb-fe661da4855a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.599892] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.599993] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.600075] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.600347] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.600421] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.600546] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d0e04be7-8718-489c-8ceb-fe661da4855a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.600601] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d0e04be7-8718-489c-8ceb-fe661da4855a',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1117.741245] env[69980]: INFO networking_nsxv3.common.synchronization [req-1a340bb9-fc78-4836-bb0a-50b63ee33f6f req-95548233-f4ad-44cc-8b27-c3c61acbfa95 service nova] Enqueued Resource ID: bc269af3-f7ab-4692-a55c-7c766575036f with Priority: HIGHEST for action security_group_rules [ 1117.742725] env[69980]: INFO networking_nsxv3.common.synchronization [req-1a340bb9-fc78-4836-bb0a-50b63ee33f6f req-95548233-f4ad-44cc-8b27-c3c61acbfa95 service nova] Enqueued Resource ID: bc269af3-f7ab-4692-a55c-7c766575036f with Priority: HIGHEST for action security_group_members [ 1117.742925] env[69980]: INFO networking_nsxv3.common.synchronization [req-1a340bb9-fc78-4836-bb0a-50b63ee33f6f req-95548233-f4ad-44cc-8b27-c3c61acbfa95 service nova] Enqueued Resource ID: 6d25c299-4516-4bb9-be48-70343a6ae40c with Priority: HIGHEST for action port [ 1117.743488] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bc269af3-f7ab-4692-a55c-7c766575036f with Priority: HIGHEST for action security_group_rules [ 1117.743662] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bc269af3-f7ab-4692-a55c-7c766575036f with Priority: HIGHEST for action security_group_members [ 1117.743772] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6d25c299-4516-4bb9-be48-70343a6ae40c with Priority: HIGHEST for action port [ 1117.744064] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock rules-bc269af3-f7ab-4692-a55c-7c766575036f taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.744181] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-bc269af3-f7ab-4692-a55c-7c766575036f" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.744327] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-bc269af3-f7ab-4692-a55c-7c766575036f" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.744501] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-bc269af3-f7ab-4692-a55c-7c766575036f" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.744581] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('bc269af3-f7ab-4692-a55c-7c766575036f',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1117.746500] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-bc269af3-f7ab-4692-a55c-7c766575036f taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.746659] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bc269af3-f7ab-4692-a55c-7c766575036f" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.750606] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bc269af3-f7ab-4692-a55c-7c766575036f" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.750606] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bc269af3-f7ab-4692-a55c-7c766575036f" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.750606] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.750606] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.750606] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.750606] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.750606] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.750606] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bc269af3-f7ab-4692-a55c-7c766575036f',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1117.750606] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock port-6d25c299-4516-4bb9-be48-70343a6ae40c taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.751436] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6d25c299-4516-4bb9-be48-70343a6ae40c" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.751501] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6d25c299-4516-4bb9-be48-70343a6ae40c" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.751708] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6d25c299-4516-4bb9-be48-70343a6ae40c" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.751850] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6d25c299-4516-4bb9-be48-70343a6ae40c',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1118.111072] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-d0e04be7-8718-489c-8ceb-fe661da4855a taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.111072] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d0e04be7-8718-489c-8ceb-fe661da4855a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.111072] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d0e04be7-8718-489c-8ceb-fe661da4855a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.111072] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d0e04be7-8718-489c-8ceb-fe661da4855a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.111072] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.111072] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.111072] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.111072] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.111072] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.111072] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d0e04be7-8718-489c-8ceb-fe661da4855a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.111072] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-d0e04be7-8718-489c-8ceb-fe661da4855a taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.111072] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d0e04be7-8718-489c-8ceb-fe661da4855a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.111072] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d0e04be7-8718-489c-8ceb-fe661da4855a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.111072] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d0e04be7-8718-489c-8ceb-fe661da4855a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.111072] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.111072] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.111951] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.111951] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.111951] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.111951] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d0e04be7-8718-489c-8ceb-fe661da4855a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.111951] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d0e04be7-8718-489c-8ceb-fe661da4855a',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1118.253996] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-bc269af3-f7ab-4692-a55c-7c766575036f taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.253996] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bc269af3-f7ab-4692-a55c-7c766575036f" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.254248] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('bc269af3-f7ab-4692-a55c-7c766575036f',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1118.255091] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 6d25c299-4516-4bb9-be48-70343a6ae40c with status ACTIVE [ 1118.255305] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.255444] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.255532] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.255780] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.255895] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.256080] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.256193] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.256263] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.256452] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.256542] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.256734] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.256844] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.256915] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.257113] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.257197] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.257277] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 6d25c299-4516-4bb9-be48-70343a6ae40c is going to be updated. [ 1118.275605] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.275842] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.275885] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.276097] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.276554] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.276554] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6d25c299-4516-4bb9-be48-70343a6ae40c" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.613695] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d0e04be7-8718-489c-8ceb-fe661da4855a: rpc.has_security_group_logging(os_id): False [ 1118.632149] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.632290] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.632360] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.632597] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.632693] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.632941] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.633059] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.633125] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.633285] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.633363] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.633578] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.633686] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.633749] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.633893] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.633981] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.634259] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.634368] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.634450] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.634646] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.634765] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.634882] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d0e04be7-8718-489c-8ceb-fe661da4855a is going to be updated. [ 1118.690917] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.691109] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.691198] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.691423] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.691583] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.706524] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d0e04be7-8718-489c-8ceb-fe661da4855a in Status: IN_PROGRESS for 2s [ 1118.759070] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('bc269af3-f7ab-4692-a55c-7c766575036f',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1119.261901] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.262256] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.262256] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.262380] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.262469] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.262571] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bc269af3-f7ab-4692-a55c-7c766575036f is going to be created. [ 1119.283887] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.284128] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.284128] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.284322] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.284496] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.293379] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bc269af3-f7ab-4692-a55c-7c766575036f in Status: UNINITIALIZED for 2s [ 1120.723534] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d0e04be7-8718-489c-8ceb-fe661da4855a in Status: SUCCESS [ 1120.724015] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d0e04be7-8718-489c-8ceb-fe661da4855a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.304549] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bc269af3-f7ab-4692-a55c-7c766575036f in Status: SUCCESS [ 1121.304549] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bc269af3-f7ab-4692-a55c-7c766575036f" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.304813] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bc269af3-f7ab-4692-a55c-7c766575036f" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.304976] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bc269af3-f7ab-4692-a55c-7c766575036f" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.305782] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.305782] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.305782] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.305782] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.305782] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.306284] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bc269af3-f7ab-4692-a55c-7c766575036f" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.306284] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('bc269af3-f7ab-4692-a55c-7c766575036f',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1121.808607] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-bc269af3-f7ab-4692-a55c-7c766575036f taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.808954] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bc269af3-f7ab-4692-a55c-7c766575036f" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.808954] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bc269af3-f7ab-4692-a55c-7c766575036f" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.809141] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bc269af3-f7ab-4692-a55c-7c766575036f" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.809336] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.809531] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.809531] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.810934] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.810934] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.811086] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bc269af3-f7ab-4692-a55c-7c766575036f" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.811209] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-bc269af3-f7ab-4692-a55c-7c766575036f taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.811310] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bc269af3-f7ab-4692-a55c-7c766575036f" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.811374] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bc269af3-f7ab-4692-a55c-7c766575036f" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.811670] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bc269af3-f7ab-4692-a55c-7c766575036f" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.811709] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.814721] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.814721] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.814721] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.814721] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.814721] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bc269af3-f7ab-4692-a55c-7c766575036f" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.814721] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('bc269af3-f7ab-4692-a55c-7c766575036f',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1122.315668] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for bc269af3-f7ab-4692-a55c-7c766575036f: rpc.has_security_group_logging(os_id): False [ 1122.332662] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.332901] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.332901] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.333369] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.333514] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.333810] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.333924] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.333975] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.334221] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.334344] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.334539] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.334641] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.334697] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.334867] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.335296] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.335532] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.335663] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.335813] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.336013] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.336166] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.336325] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bc269af3-f7ab-4692-a55c-7c766575036f is going to be created. [ 1122.387728] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.387930] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.388034] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.388306] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.388502] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.399244] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bc269af3-f7ab-4692-a55c-7c766575036f in Status: IN_PROGRESS for 2s [ 1122.526030] env[69980]: INFO networking_nsxv3.common.synchronization [req-d536d373-1dcd-4f43-add9-057f7c7e2d10 req-875f3c39-58ff-4e5c-bc70-b1c2aad7c8ae tempest-AttachInterfacesTestJSON-1782090316 tempest-AttachInterfacesTestJSON-1782090316-project-member] Enqueued Resource ID: 400b642e-7f7e-4993-9916-a3e96af018da with Priority: HIGHEST for action security_group_members [ 1122.528084] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 400b642e-7f7e-4993-9916-a3e96af018da with Priority: HIGHEST for action security_group_members [ 1122.530025] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-400b642e-7f7e-4993-9916-a3e96af018da taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.530025] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-400b642e-7f7e-4993-9916-a3e96af018da" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.530025] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-400b642e-7f7e-4993-9916-a3e96af018da" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.530025] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-400b642e-7f7e-4993-9916-a3e96af018da" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.535025] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.535025] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.535025] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.535025] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.535025] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.535025] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('400b642e-7f7e-4993-9916-a3e96af018da',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1122.817112] env[69980]: INFO networking_nsxv3.common.synchronization [req-4f44c78d-6bd8-4d6c-9382-aa8fc140b069 req-5cd1aa14-b9d9-421d-8991-d77ae1d9fcf8 tempest-ServerRescueTestJSON-1726562689 tempest-ServerRescueTestJSON-1726562689-project-member] Enqueued Resource ID: 4eb0fe0d-cd04-4189-9b26-953ab87885bd with Priority: HIGHEST for action security_group_members [ 1122.817695] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4eb0fe0d-cd04-4189-9b26-953ab87885bd with Priority: HIGHEST for action security_group_members [ 1122.818150] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-4eb0fe0d-cd04-4189-9b26-953ab87885bd taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.818292] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4eb0fe0d-cd04-4189-9b26-953ab87885bd" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.818362] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4eb0fe0d-cd04-4189-9b26-953ab87885bd" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.818559] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4eb0fe0d-cd04-4189-9b26-953ab87885bd" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.818715] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.818841] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.818890] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.819038] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.819112] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.819208] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4eb0fe0d-cd04-4189-9b26-953ab87885bd',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1122.928060] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock network-762 taken with stack trace [, , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.928060] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "network-762" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.928060] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "network-762" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.928060] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "network-762" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.928060] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.928936] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.929246] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.929601] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.929969] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.930288] env[69980]: DEBUG dogpile.cache.region [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] No value present for key: 'zone-id' {{(pid=69980) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1122.930502] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] NeedRegenerationException {{(pid=69980) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1122.930694] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] no value, waiting for create lock {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1122.932372] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] value creation lock acquired {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1122.932372] env[69980]: DEBUG dogpile.cache.region [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] No value present for key: 'zone-id' {{(pid=69980) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1122.932372] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Calling creation function for not-yet-present value {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1122.932372] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1122.949697] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1122.950043] env[69980]: DEBUG dogpile.cache.region [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=69980) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1122.950043] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Released creation lock {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1122.950216] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "network-762" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.950513] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock port-5f38ae9b-1fb5-45d0-8861-3fde285ea2c7 taken with stack trace [, , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.950682] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "port-5f38ae9b-1fb5-45d0-8861-3fde285ea2c7" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.950793] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "port-5f38ae9b-1fb5-45d0-8861-3fde285ea2c7" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.951149] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "port-5f38ae9b-1fb5-45d0-8861-3fde285ea2c7" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.951292] env[69980]: DEBUG networking_nsxv3.api.rpc [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5f38ae9b-1fb5-45d0-8861-3fde285ea2c7',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1123.038371] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.038661] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.038661] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.039617] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.039617] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.039617] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.039617] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.039617] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.039617] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.039617] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.039858] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 400b642e-7f7e-4993-9916-a3e96af018da already deleted. [ 1123.039858] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-400b642e-7f7e-4993-9916-a3e96af018da" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.322720] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4eb0fe0d-cd04-4189-9b26-953ab87885bd',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1123.454527] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.454527] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.454527] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.454527] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.454527] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.454527] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Segment Port 5f38ae9b-1fb5-45d0-8861-3fde285ea2c7 not found, creating... [ 1123.454885] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.455918] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.455918] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.455918] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.455918] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.456424] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.456716] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.457179] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.457595] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.457668] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.457959] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Resource: SegmentPort with ID: 5f38ae9b-1fb5-45d0-8861-3fde285ea2c7 is going to be created. [ 1123.498766] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.499160] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.499446] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.499835] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.500140] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.501898] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "port-5f38ae9b-1fb5-45d0-8861-3fde285ea2c7" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.826102] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4eb0fe0d-cd04-4189-9b26-953ab87885bd',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1124.209022] env[69980]: INFO networking_nsxv3.common.synchronization [req-d536d373-1dcd-4f43-add9-057f7c7e2d10 req-5be4c57b-693f-44e3-9d4b-c4bdc134c81d service nova] Enqueued Resource ID: 400b642e-7f7e-4993-9916-a3e96af018da with Priority: HIGHEST for action security_group_rules [ 1124.209022] env[69980]: INFO networking_nsxv3.common.synchronization [req-d536d373-1dcd-4f43-add9-057f7c7e2d10 req-5be4c57b-693f-44e3-9d4b-c4bdc134c81d service nova] Enqueued Resource ID: 400b642e-7f7e-4993-9916-a3e96af018da with Priority: HIGHEST for action security_group_members [ 1124.209022] env[69980]: INFO networking_nsxv3.common.synchronization [req-d536d373-1dcd-4f43-add9-057f7c7e2d10 req-5be4c57b-693f-44e3-9d4b-c4bdc134c81d service nova] Enqueued Resource ID: 5f38ae9b-1fb5-45d0-8861-3fde285ea2c7 with Priority: HIGHEST for action port [ 1124.209022] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 400b642e-7f7e-4993-9916-a3e96af018da with Priority: HIGHEST for action security_group_rules [ 1124.209022] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 400b642e-7f7e-4993-9916-a3e96af018da with Priority: HIGHEST for action security_group_members [ 1124.209022] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5f38ae9b-1fb5-45d0-8861-3fde285ea2c7 with Priority: HIGHEST for action port [ 1124.209022] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock rules-400b642e-7f7e-4993-9916-a3e96af018da taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.209022] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-400b642e-7f7e-4993-9916-a3e96af018da" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.209022] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-400b642e-7f7e-4993-9916-a3e96af018da" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.210468] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-400b642e-7f7e-4993-9916-a3e96af018da" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.210685] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('400b642e-7f7e-4993-9916-a3e96af018da',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1124.212996] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-400b642e-7f7e-4993-9916-a3e96af018da taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.212996] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-400b642e-7f7e-4993-9916-a3e96af018da" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.212996] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-400b642e-7f7e-4993-9916-a3e96af018da" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.212996] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-400b642e-7f7e-4993-9916-a3e96af018da" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.212996] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.212996] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.212996] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.212996] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.212996] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.212996] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('400b642e-7f7e-4993-9916-a3e96af018da',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1124.216607] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock port-5f38ae9b-1fb5-45d0-8861-3fde285ea2c7 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.216717] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5f38ae9b-1fb5-45d0-8861-3fde285ea2c7" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.216772] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5f38ae9b-1fb5-45d0-8861-3fde285ea2c7" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.216952] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5f38ae9b-1fb5-45d0-8861-3fde285ea2c7" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.217261] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5f38ae9b-1fb5-45d0-8861-3fde285ea2c7',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1124.328079] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.328306] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.328306] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.328542] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.328634] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.328742] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4eb0fe0d-cd04-4189-9b26-953ab87885bd is going to be updated. [ 1124.354592] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.354761] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.354837] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.355083] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.355244] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.363747] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4eb0fe0d-cd04-4189-9b26-953ab87885bd in Status: IN_PROGRESS for 2s [ 1124.411825] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bc269af3-f7ab-4692-a55c-7c766575036f in Status: SUCCESS [ 1124.412147] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-bc269af3-f7ab-4692-a55c-7c766575036f" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.717375] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('400b642e-7f7e-4993-9916-a3e96af018da',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1124.721358] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-400b642e-7f7e-4993-9916-a3e96af018da taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.721358] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-400b642e-7f7e-4993-9916-a3e96af018da" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.721358] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 5f38ae9b-1fb5-45d0-8861-3fde285ea2c7 with status ACTIVE [ 1124.721358] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.721358] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.721358] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.721358] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.721358] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.721358] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.721358] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.721358] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.721358] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.721358] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.721358] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.721948] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.721948] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.721948] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.721948] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.721948] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 5f38ae9b-1fb5-45d0-8861-3fde285ea2c7 is going to be updated. [ 1124.745126] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.745294] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.745359] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.745582] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.745720] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.745908] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5f38ae9b-1fb5-45d0-8861-3fde285ea2c7" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.224817] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('400b642e-7f7e-4993-9916-a3e96af018da',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1125.302729] env[69980]: INFO networking_nsxv3.common.synchronization [None req-1e8c16f3-c6bb-42bb-9267-977b731f20c2 None None] Enqueued Resource ID: d353367d-61c7-4897-bd50-c3b9ed8f6770 with Priority: HIGHEST for action port [ 1125.303381] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d353367d-61c7-4897-bd50-c3b9ed8f6770 with Priority: HIGHEST for action port [ 1125.303644] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock port-d353367d-61c7-4897-bd50-c3b9ed8f6770 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.303757] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d353367d-61c7-4897-bd50-c3b9ed8f6770" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.304253] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d353367d-61c7-4897-bd50-c3b9ed8f6770" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.304941] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d353367d-61c7-4897-bd50-c3b9ed8f6770" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.305256] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d353367d-61c7-4897-bd50-c3b9ed8f6770',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1125.727336] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.727523] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.727567] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.728304] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.728304] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.728304] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 400b642e-7f7e-4993-9916-a3e96af018da is going to be created. [ 1125.750039] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.750430] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.750543] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.750766] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.751017] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.759660] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 400b642e-7f7e-4993-9916-a3e96af018da in Status: UNINITIALIZED for 2s [ 1125.813373] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port d353367d-61c7-4897-bd50-c3b9ed8f6770 [ 1125.813526] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.813597] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.813635] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.813891] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.814069] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.814168] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:d353367d-61c7-4897-bd50-c3b9ed8f6770 already deleted. [ 1125.814257] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d353367d-61c7-4897-bd50-c3b9ed8f6770" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.061121] env[69980]: INFO networking_nsxv3.common.synchronization [req-5e2e08e3-4283-4455-ab98-505d024c43cf req-3621c133-eb17-4e05-be13-5ff041fed812 tempest-ImagesTestJSON-600722714 tempest-ImagesTestJSON-600722714-project-member] Enqueued Resource ID: 80e3ea48-91a5-4863-b1c2-f3e887204e39 with Priority: HIGHEST for action security_group_members [ 1126.061663] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 80e3ea48-91a5-4863-b1c2-f3e887204e39 with Priority: HIGHEST for action security_group_members [ 1126.061979] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-80e3ea48-91a5-4863-b1c2-f3e887204e39 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.063662] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-80e3ea48-91a5-4863-b1c2-f3e887204e39" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.063662] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-80e3ea48-91a5-4863-b1c2-f3e887204e39" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.063662] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-80e3ea48-91a5-4863-b1c2-f3e887204e39" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.063662] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.064035] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.064035] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.064035] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.064154] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.064243] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('80e3ea48-91a5-4863-b1c2-f3e887204e39',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1126.374021] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4eb0fe0d-cd04-4189-9b26-953ab87885bd in Status: SUCCESS [ 1126.374357] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4eb0fe0d-cd04-4189-9b26-953ab87885bd" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.567630] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.567789] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.567895] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.568110] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.568213] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.568479] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.568596] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.568660] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.568812] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.568893] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.568983] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 80e3ea48-91a5-4863-b1c2-f3e887204e39 is going to be updated. [ 1126.596160] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.596350] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.596418] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.596617] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.596762] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.604925] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 80e3ea48-91a5-4863-b1c2-f3e887204e39 in Status: IN_PROGRESS for 2s [ 1127.547540] env[69980]: INFO networking_nsxv3.common.synchronization [req-b81fc724-4135-454e-a5d3-2401335a8387 req-b9274e00-972c-4db6-9ff6-dfba085f29dc tempest-ServersAdminTestJSON-1581544378 tempest-ServersAdminTestJSON-1581544378-project-member] Enqueued Resource ID: 700dc02a-f3c2-4363-9a0e-d7cdcb13a5b8 with Priority: HIGHEST for action security_group_members [ 1127.548245] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 700dc02a-f3c2-4363-9a0e-d7cdcb13a5b8 with Priority: HIGHEST for action security_group_members [ 1127.548551] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-700dc02a-f3c2-4363-9a0e-d7cdcb13a5b8 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.548679] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-700dc02a-f3c2-4363-9a0e-d7cdcb13a5b8" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.548749] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-700dc02a-f3c2-4363-9a0e-d7cdcb13a5b8" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.549260] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-700dc02a-f3c2-4363-9a0e-d7cdcb13a5b8" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.549467] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.549616] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.549703] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.549908] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.550042] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.550178] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('700dc02a-f3c2-4363-9a0e-d7cdcb13a5b8',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1127.579248] env[69980]: INFO networking_nsxv3.common.synchronization [None req-f6a6e06b-b1ba-41f8-8bfe-5c0f35de8874 None None] Enqueued Resource ID: 1a1b44b2-c8be-4d6e-8572-40df2e469406 with Priority: HIGHEST for action port [ 1127.580018] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1a1b44b2-c8be-4d6e-8572-40df2e469406 with Priority: HIGHEST for action port [ 1127.583183] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock port-1a1b44b2-c8be-4d6e-8572-40df2e469406 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.583488] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1a1b44b2-c8be-4d6e-8572-40df2e469406" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.583617] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1a1b44b2-c8be-4d6e-8572-40df2e469406" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.583904] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1a1b44b2-c8be-4d6e-8572-40df2e469406" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.583996] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1a1b44b2-c8be-4d6e-8572-40df2e469406',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1127.769158] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 400b642e-7f7e-4993-9916-a3e96af018da in Status: SUCCESS [ 1127.769297] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-400b642e-7f7e-4993-9916-a3e96af018da" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.769429] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-400b642e-7f7e-4993-9916-a3e96af018da" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.769725] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-400b642e-7f7e-4993-9916-a3e96af018da" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.769987] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.770127] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.770127] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.770330] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.770439] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.770550] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-400b642e-7f7e-4993-9916-a3e96af018da" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.771334] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('400b642e-7f7e-4993-9916-a3e96af018da',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1128.052946] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.053132] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.053207] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.053427] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.053521] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.053744] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.053845] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.053911] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.054087] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.054188] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.054325] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 700dc02a-f3c2-4363-9a0e-d7cdcb13a5b8 is going to be updated. [ 1128.079984] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.080165] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.080211] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.080382] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.080520] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.086095] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 1a1b44b2-c8be-4d6e-8572-40df2e469406 [ 1128.086280] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.086392] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.086468] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.087301] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.087301] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.087301] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:1a1b44b2-c8be-4d6e-8572-40df2e469406 already deleted. [ 1128.087301] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1a1b44b2-c8be-4d6e-8572-40df2e469406" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.088212] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 700dc02a-f3c2-4363-9a0e-d7cdcb13a5b8 in Status: IN_PROGRESS for 2s [ 1128.272522] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('400b642e-7f7e-4993-9916-a3e96af018da',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1128.617707] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 80e3ea48-91a5-4863-b1c2-f3e887204e39 in Status: SUCCESS [ 1128.617707] env[69980]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 80e3ea48-91a5-4863-b1c2-f3e887204e39 deletion is rescheduled due to dependency. [ 1128.617707] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-80e3ea48-91a5-4863-b1c2-f3e887204e39" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.774899] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 400b642e-7f7e-4993-9916-a3e96af018da: rpc.has_security_group_logging(os_id): False [ 1128.796835] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.796835] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.796835] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.796835] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.796835] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.797219] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.797219] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.797219] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.797358] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.797358] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.797459] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 400b642e-7f7e-4993-9916-a3e96af018da is going to be created. [ 1128.880244] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.880450] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.881666] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.881913] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.882289] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.897052] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 400b642e-7f7e-4993-9916-a3e96af018da in Status: IN_PROGRESS for 2s [ 1130.099496] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 700dc02a-f3c2-4363-9a0e-d7cdcb13a5b8 in Status: SUCCESS [ 1130.099496] env[69980]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 700dc02a-f3c2-4363-9a0e-d7cdcb13a5b8 deletion is rescheduled due to dependency. [ 1130.099496] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-700dc02a-f3c2-4363-9a0e-d7cdcb13a5b8" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.913316] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 400b642e-7f7e-4993-9916-a3e96af018da in Status: SUCCESS [ 1130.913581] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-400b642e-7f7e-4993-9916-a3e96af018da" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.248821] env[69980]: INFO networking_nsxv3.common.synchronization [req-541a36eb-e1e5-498e-b1df-010cd9a4bd7d req-d0294217-0071-41a3-ae74-76e160674709 tempest-AttachInterfacesV270Test-263525417 tempest-AttachInterfacesV270Test-263525417-project-member] Enqueued Resource ID: bc269af3-f7ab-4692-a55c-7c766575036f with Priority: HIGHEST for action security_group_members [ 1131.249392] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bc269af3-f7ab-4692-a55c-7c766575036f with Priority: HIGHEST for action security_group_members [ 1131.249704] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-bc269af3-f7ab-4692-a55c-7c766575036f taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.249829] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bc269af3-f7ab-4692-a55c-7c766575036f" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.249897] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bc269af3-f7ab-4692-a55c-7c766575036f" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.250106] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bc269af3-f7ab-4692-a55c-7c766575036f" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.250266] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.250363] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.250428] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.250571] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.251320] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.251320] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bc269af3-f7ab-4692-a55c-7c766575036f',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1131.755168] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.755336] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.755404] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.755622] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.755788] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.756018] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.756130] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.756213] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.756341] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.756420] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.756506] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bc269af3-f7ab-4692-a55c-7c766575036f is going to be updated. [ 1131.782068] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.782239] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.782314] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.782517] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.782712] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.790383] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bc269af3-f7ab-4692-a55c-7c766575036f in Status: IN_PROGRESS for 2s [ 1132.485259] env[69980]: INFO networking_nsxv3.common.synchronization [None req-8641f86f-1c22-429f-9da7-57cd845c38ea None None] Enqueued Resource ID: 8c299340-37a2-465f-8475-ec7cc51ff18c with Priority: HIGHEST for action port [ 1132.485520] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8c299340-37a2-465f-8475-ec7cc51ff18c with Priority: HIGHEST for action port [ 1132.486297] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock port-8c299340-37a2-465f-8475-ec7cc51ff18c taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.486442] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8c299340-37a2-465f-8475-ec7cc51ff18c" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.486506] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8c299340-37a2-465f-8475-ec7cc51ff18c" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.486786] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8c299340-37a2-465f-8475-ec7cc51ff18c" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.486859] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8c299340-37a2-465f-8475-ec7cc51ff18c',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1132.989075] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 8c299340-37a2-465f-8475-ec7cc51ff18c [ 1132.989326] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.989565] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.989649] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.989862] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.989953] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.990086] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:8c299340-37a2-465f-8475-ec7cc51ff18c already deleted. [ 1132.990202] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8c299340-37a2-465f-8475-ec7cc51ff18c" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.552312] env[69980]: INFO networking_nsxv3.common.synchronization [None req-51c627d4-e914-430a-96c7-3c1ece208f96 tempest-AttachVolumeShelveTestJSON-1941643989 tempest-AttachVolumeShelveTestJSON-1941643989-project-member] Enqueued Resource ID: 3909a119-b9ca-4e95-b2b4-3541d0886a49 with Priority: HIGHEST for action security_group_rules [ 1133.552312] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3909a119-b9ca-4e95-b2b4-3541d0886a49 with Priority: HIGHEST for action security_group_rules [ 1133.552312] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3909a119-b9ca-4e95-b2b4-3541d0886a49 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.552312] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3909a119-b9ca-4e95-b2b4-3541d0886a49" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.552312] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3909a119-b9ca-4e95-b2b4-3541d0886a49" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.552312] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3909a119-b9ca-4e95-b2b4-3541d0886a49" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.552312] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3909a119-b9ca-4e95-b2b4-3541d0886a49',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1133.647016] env[69980]: INFO networking_nsxv3.common.synchronization [None req-ea83b709-f7e6-4cac-89c3-d6c464508b2d tempest-AttachVolumeShelveTestJSON-1941643989 tempest-AttachVolumeShelveTestJSON-1941643989-project-member] Enqueued Resource ID: 3909a119-b9ca-4e95-b2b4-3541d0886a49 with Priority: HIGHEST for action security_group_rules [ 1133.647077] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3909a119-b9ca-4e95-b2b4-3541d0886a49 with Priority: HIGHEST for action security_group_rules [ 1133.647767] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3909a119-b9ca-4e95-b2b4-3541d0886a49 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.647767] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3909a119-b9ca-4e95-b2b4-3541d0886a49" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.803145] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bc269af3-f7ab-4692-a55c-7c766575036f in Status: SUCCESS [ 1133.803438] env[69980]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bc269af3-f7ab-4692-a55c-7c766575036f deletion is rescheduled due to dependency. [ 1133.803513] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bc269af3-f7ab-4692-a55c-7c766575036f" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.071798] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.072757] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.072757] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.072757] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.072757] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.072955] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3909a119-b9ca-4e95-b2b4-3541d0886a49 already deleted. [ 1134.072955] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3909a119-b9ca-4e95-b2b4-3541d0886a49" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.073160] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3909a119-b9ca-4e95-b2b4-3541d0886a49" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.074025] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3909a119-b9ca-4e95-b2b4-3541d0886a49" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.074025] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3909a119-b9ca-4e95-b2b4-3541d0886a49',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1134.593922] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.594276] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.594276] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.594486] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.594486] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.594558] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3909a119-b9ca-4e95-b2b4-3541d0886a49 already deleted. [ 1134.594631] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3909a119-b9ca-4e95-b2b4-3541d0886a49" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.858691] env[69980]: INFO networking_nsxv3.common.synchronization [None req-989e2c6b-9579-4829-a2cf-7354f0dad787 None None] Enqueued Resource ID: 49890036-005b-4ae9-8d31-4cde7579972a with Priority: HIGHEST for action port [ 1134.858691] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 49890036-005b-4ae9-8d31-4cde7579972a with Priority: HIGHEST for action port [ 1134.859125] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock port-49890036-005b-4ae9-8d31-4cde7579972a taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.859265] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-49890036-005b-4ae9-8d31-4cde7579972a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.859265] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-49890036-005b-4ae9-8d31-4cde7579972a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.859515] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-49890036-005b-4ae9-8d31-4cde7579972a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.859633] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('49890036-005b-4ae9-8d31-4cde7579972a',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1135.125227] env[69980]: INFO networking_nsxv3.common.synchronization [None req-006321a1-7a5c-4a09-8f70-b097b128a796 tempest-ServerActionsTestOtherA-1240783872 tempest-ServerActionsTestOtherA-1240783872-project-member] Enqueued Resource ID: c64c611c-a81f-411b-a88c-f87f4d86a64a with Priority: HIGHEST for action security_group_rules [ 1135.125699] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c64c611c-a81f-411b-a88c-f87f4d86a64a with Priority: HIGHEST for action security_group_rules [ 1135.126166] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c64c611c-a81f-411b-a88c-f87f4d86a64a taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.126377] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c64c611c-a81f-411b-a88c-f87f4d86a64a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.126444] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c64c611c-a81f-411b-a88c-f87f4d86a64a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.126725] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c64c611c-a81f-411b-a88c-f87f4d86a64a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.126763] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c64c611c-a81f-411b-a88c-f87f4d86a64a',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1135.205872] env[69980]: INFO networking_nsxv3.common.synchronization [None req-3bc5a2c5-180f-40a8-bc95-71b88107a309 tempest-ServerActionsTestOtherA-1240783872 tempest-ServerActionsTestOtherA-1240783872-project-member] Enqueued Resource ID: c64c611c-a81f-411b-a88c-f87f4d86a64a with Priority: HIGHEST for action security_group_rules [ 1135.206457] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c64c611c-a81f-411b-a88c-f87f4d86a64a with Priority: HIGHEST for action security_group_rules [ 1135.207034] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c64c611c-a81f-411b-a88c-f87f4d86a64a taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.207231] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c64c611c-a81f-411b-a88c-f87f4d86a64a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.365381] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 49890036-005b-4ae9-8d31-4cde7579972a [ 1135.365624] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.365766] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.365840] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.366106] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.366189] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.366291] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:49890036-005b-4ae9-8d31-4cde7579972a already deleted. [ 1135.366373] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-49890036-005b-4ae9-8d31-4cde7579972a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.646907] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.647654] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.647654] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.647654] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.647809] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.647809] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c64c611c-a81f-411b-a88c-f87f4d86a64a already deleted. [ 1135.647932] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c64c611c-a81f-411b-a88c-f87f4d86a64a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.648123] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c64c611c-a81f-411b-a88c-f87f4d86a64a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.648337] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c64c611c-a81f-411b-a88c-f87f4d86a64a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.648441] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c64c611c-a81f-411b-a88c-f87f4d86a64a',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1136.186616] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.186616] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.186616] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.186616] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.186616] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.186616] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c64c611c-a81f-411b-a88c-f87f4d86a64a already deleted. [ 1136.186616] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c64c611c-a81f-411b-a88c-f87f4d86a64a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.105474] env[69980]: INFO networking_nsxv3.common.synchronization [req-53217f68-0abc-4f49-8d4c-f8d0dec945a6 req-d72f46e9-33bc-45cd-b018-10bfc12a2868 tempest-ServersTestJSON-2066262947 tempest-ServersTestJSON-2066262947-project-member] Enqueued Resource ID: 69e79787-6675-42a5-b381-7ffa87e43ee6 with Priority: HIGHEST for action security_group_members [ 1139.106020] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 69e79787-6675-42a5-b381-7ffa87e43ee6 with Priority: HIGHEST for action security_group_members [ 1139.106343] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-69e79787-6675-42a5-b381-7ffa87e43ee6 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.106465] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-69e79787-6675-42a5-b381-7ffa87e43ee6" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.106534] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-69e79787-6675-42a5-b381-7ffa87e43ee6" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.106777] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-69e79787-6675-42a5-b381-7ffa87e43ee6" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.106936] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.110727] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.110766] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.110928] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.111036] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.111140] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('69e79787-6675-42a5-b381-7ffa87e43ee6',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1139.452132] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock network-47 taken with stack trace [, , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.452442] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "network-47" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.452782] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "network-47" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.453150] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "network-47" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.453607] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.453840] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.454062] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.454425] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.454686] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.455037] env[69980]: DEBUG dogpile.cache.region [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] No value present for key: 'zone-id' {{(pid=69980) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1139.455248] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] NeedRegenerationException {{(pid=69980) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1139.455445] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] no value, waiting for create lock {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1139.455620] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] value creation lock acquired {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1139.455819] env[69980]: DEBUG dogpile.cache.region [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] No value present for key: 'zone-id' {{(pid=69980) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1139.456168] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Calling creation function for not-yet-present value {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1139.456444] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1139.478040] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1139.478487] env[69980]: DEBUG dogpile.cache.region [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=69980) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1139.478539] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Released creation lock {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1139.478798] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "network-47" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.479300] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock port-930df5d8-fb51-4265-bba4-ab76b4c80915 taken with stack trace [, , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.479578] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "port-930df5d8-fb51-4265-bba4-ab76b4c80915" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.479768] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "port-930df5d8-fb51-4265-bba4-ab76b4c80915" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.480246] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "port-930df5d8-fb51-4265-bba4-ab76b4c80915" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.480466] env[69980]: DEBUG networking_nsxv3.api.rpc [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('930df5d8-fb51-4265-bba4-ab76b4c80915',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1139.614301] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.614527] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.614614] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.614871] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.614990] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.615224] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.615342] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.615410] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.615577] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.615660] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.615748] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 69e79787-6675-42a5-b381-7ffa87e43ee6 already deleted. [ 1139.615831] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-69e79787-6675-42a5-b381-7ffa87e43ee6" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.983963] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.983963] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.983963] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.983963] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.984197] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.984222] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Segment Port 930df5d8-fb51-4265-bba4-ab76b4c80915 not found, creating... [ 1139.984482] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.984641] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.984760] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.984983] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.985147] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.985432] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.985593] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.985713] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.985921] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.986121] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.986270] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Resource: SegmentPort with ID: 930df5d8-fb51-4265-bba4-ab76b4c80915 is going to be created. [ 1140.004657] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.004862] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.004990] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.005269] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.005505] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.005735] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "port-930df5d8-fb51-4265-bba4-ab76b4c80915" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.727810] env[69980]: INFO networking_nsxv3.common.synchronization [req-53217f68-0abc-4f49-8d4c-f8d0dec945a6 req-d6218d12-e38a-47be-9d43-a9fe696c29c7 service nova] Enqueued Resource ID: 69e79787-6675-42a5-b381-7ffa87e43ee6 with Priority: HIGHEST for action security_group_rules [ 1140.728066] env[69980]: INFO networking_nsxv3.common.synchronization [req-53217f68-0abc-4f49-8d4c-f8d0dec945a6 req-d6218d12-e38a-47be-9d43-a9fe696c29c7 service nova] Enqueued Resource ID: 69e79787-6675-42a5-b381-7ffa87e43ee6 with Priority: HIGHEST for action security_group_members [ 1140.728213] env[69980]: INFO networking_nsxv3.common.synchronization [req-53217f68-0abc-4f49-8d4c-f8d0dec945a6 req-d6218d12-e38a-47be-9d43-a9fe696c29c7 service nova] Enqueued Resource ID: 930df5d8-fb51-4265-bba4-ab76b4c80915 with Priority: HIGHEST for action port [ 1140.728839] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 69e79787-6675-42a5-b381-7ffa87e43ee6 with Priority: HIGHEST for action security_group_rules [ 1140.728953] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 69e79787-6675-42a5-b381-7ffa87e43ee6 with Priority: HIGHEST for action security_group_members [ 1140.729599] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 930df5d8-fb51-4265-bba4-ab76b4c80915 with Priority: HIGHEST for action port [ 1140.729936] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock rules-69e79787-6675-42a5-b381-7ffa87e43ee6 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.730081] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-69e79787-6675-42a5-b381-7ffa87e43ee6" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.730153] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-69e79787-6675-42a5-b381-7ffa87e43ee6" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.730370] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-69e79787-6675-42a5-b381-7ffa87e43ee6" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.730454] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('69e79787-6675-42a5-b381-7ffa87e43ee6',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1140.732188] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-69e79787-6675-42a5-b381-7ffa87e43ee6 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.732321] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-69e79787-6675-42a5-b381-7ffa87e43ee6" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.732392] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-69e79787-6675-42a5-b381-7ffa87e43ee6" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.732794] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-69e79787-6675-42a5-b381-7ffa87e43ee6" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.732996] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.733121] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.733198] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.733428] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.733560] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.733668] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('69e79787-6675-42a5-b381-7ffa87e43ee6',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1140.734764] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock port-930df5d8-fb51-4265-bba4-ab76b4c80915 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.734875] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-930df5d8-fb51-4265-bba4-ab76b4c80915" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.734944] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-930df5d8-fb51-4265-bba4-ab76b4c80915" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.735143] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-930df5d8-fb51-4265-bba4-ab76b4c80915" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.735224] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('930df5d8-fb51-4265-bba4-ab76b4c80915',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1141.243026] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-69e79787-6675-42a5-b381-7ffa87e43ee6 taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.243026] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-69e79787-6675-42a5-b381-7ffa87e43ee6" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.243026] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 930df5d8-fb51-4265-bba4-ab76b4c80915 with status ACTIVE [ 1141.243026] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.243026] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.243026] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.243026] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.243026] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.243026] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.243026] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.243026] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.243026] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.243026] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.243599] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.243599] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.243599] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.243599] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.243599] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.243805] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 930df5d8-fb51-4265-bba4-ab76b4c80915 is going to be updated. [ 1141.244830] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('69e79787-6675-42a5-b381-7ffa87e43ee6',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1141.264431] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.264578] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.264650] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.264865] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.265010] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.265180] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-930df5d8-fb51-4265-bba4-ab76b4c80915" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.747987] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('69e79787-6675-42a5-b381-7ffa87e43ee6',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1142.249609] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.249844] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.249844] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.250093] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.250195] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.250304] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 69e79787-6675-42a5-b381-7ffa87e43ee6 is going to be created. [ 1142.292482] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.292482] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.292482] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.292482] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.292482] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.310043] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 69e79787-6675-42a5-b381-7ffa87e43ee6 in Status: UNINITIALIZED for 2s [ 1142.751451] env[69980]: INFO networking_nsxv3.common.synchronization [req-d5af8da2-7202-450c-ae99-efb23e963bc5 req-d788b264-3734-4c7e-b106-cd29c1d4f4aa tempest-ServerRescueTestJSON-1726562689 tempest-ServerRescueTestJSON-1726562689-project-member] Enqueued Resource ID: 4eb0fe0d-cd04-4189-9b26-953ab87885bd with Priority: HIGHEST for action security_group_members [ 1142.752373] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4eb0fe0d-cd04-4189-9b26-953ab87885bd with Priority: HIGHEST for action security_group_members [ 1142.753150] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-4eb0fe0d-cd04-4189-9b26-953ab87885bd taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.753544] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4eb0fe0d-cd04-4189-9b26-953ab87885bd" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.753785] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4eb0fe0d-cd04-4189-9b26-953ab87885bd" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.754083] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4eb0fe0d-cd04-4189-9b26-953ab87885bd" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.754330] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.754536] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.754675] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.754908] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.755099] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.755269] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4eb0fe0d-cd04-4189-9b26-953ab87885bd',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1143.259943] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.259943] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.259943] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.259943] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.259943] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.259943] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.259943] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.259943] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.259943] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.259943] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.259943] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4eb0fe0d-cd04-4189-9b26-953ab87885bd is going to be updated. [ 1143.293462] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.293462] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.293462] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.293462] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.293462] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.302208] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4eb0fe0d-cd04-4189-9b26-953ab87885bd in Status: IN_PROGRESS for 2s [ 1144.320951] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 69e79787-6675-42a5-b381-7ffa87e43ee6 in Status: SUCCESS [ 1144.321264] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-69e79787-6675-42a5-b381-7ffa87e43ee6" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.321475] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-69e79787-6675-42a5-b381-7ffa87e43ee6" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.321768] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-69e79787-6675-42a5-b381-7ffa87e43ee6" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.322060] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.322213] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.322332] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.322607] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.322767] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.322818] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-69e79787-6675-42a5-b381-7ffa87e43ee6" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.322932] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('69e79787-6675-42a5-b381-7ffa87e43ee6',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1144.827771] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('69e79787-6675-42a5-b381-7ffa87e43ee6',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1145.310595] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4eb0fe0d-cd04-4189-9b26-953ab87885bd in Status: SUCCESS [ 1145.310774] env[69980]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4eb0fe0d-cd04-4189-9b26-953ab87885bd deletion is rescheduled due to dependency. [ 1145.311698] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4eb0fe0d-cd04-4189-9b26-953ab87885bd" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.330326] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 69e79787-6675-42a5-b381-7ffa87e43ee6: rpc.has_security_group_logging(os_id): False [ 1145.346419] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.346553] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.346619] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.346832] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.346918] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.347181] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.347277] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.347340] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.347491] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.347559] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.347643] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 69e79787-6675-42a5-b381-7ffa87e43ee6 is going to be created. [ 1145.405188] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.405188] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.405188] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.405188] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.405188] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.414907] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 69e79787-6675-42a5-b381-7ffa87e43ee6 in Status: IN_PROGRESS for 2s [ 1146.891448] env[69980]: INFO networking_nsxv3.common.synchronization [None req-25201b19-efab-45f3-80e9-da7576c163cf None None] Enqueued Resource ID: aeb93b58-9833-4b06-8c6f-44d723a313a2 with Priority: HIGHEST for action port [ 1146.891707] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aeb93b58-9833-4b06-8c6f-44d723a313a2 with Priority: HIGHEST for action port [ 1146.892254] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock port-aeb93b58-9833-4b06-8c6f-44d723a313a2 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.892379] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-aeb93b58-9833-4b06-8c6f-44d723a313a2" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.892446] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-aeb93b58-9833-4b06-8c6f-44d723a313a2" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.892700] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-aeb93b58-9833-4b06-8c6f-44d723a313a2" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.892782] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('aeb93b58-9833-4b06-8c6f-44d723a313a2',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1147.396682] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port aeb93b58-9833-4b06-8c6f-44d723a313a2 [ 1147.396967] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.398540] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.398540] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.398540] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.398540] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.398540] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:aeb93b58-9833-4b06-8c6f-44d723a313a2 already deleted. [ 1147.398540] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-aeb93b58-9833-4b06-8c6f-44d723a313a2" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.427754] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 69e79787-6675-42a5-b381-7ffa87e43ee6 in Status: SUCCESS [ 1147.427998] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-69e79787-6675-42a5-b381-7ffa87e43ee6" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.531619] env[69980]: INFO networking_nsxv3.common.synchronization [req-7afc0395-1065-4bcf-9415-4fd0b4a0b767 req-ade6924f-3e48-467a-be88-5275e2f61a7a tempest-ServerRescueNegativeTestJSON-1270382253 tempest-ServerRescueNegativeTestJSON-1270382253-project-member] Enqueued Resource ID: f0f521c8-595e-4f1b-a139-3ce8948484da with Priority: HIGHEST for action security_group_members [ 1147.532189] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f0f521c8-595e-4f1b-a139-3ce8948484da with Priority: HIGHEST for action security_group_members [ 1147.532490] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-f0f521c8-595e-4f1b-a139-3ce8948484da taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.532618] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f0f521c8-595e-4f1b-a139-3ce8948484da" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.532752] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f0f521c8-595e-4f1b-a139-3ce8948484da" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.533012] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f0f521c8-595e-4f1b-a139-3ce8948484da" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.535100] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.535219] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.535286] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.535464] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.537058] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.537058] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f0f521c8-595e-4f1b-a139-3ce8948484da',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1147.585352] env[69980]: INFO networking_nsxv3.common.synchronization [None req-f312a6ee-119b-4929-9a29-71c6c1eb3812 tempest-AttachInterfacesUnderV243Test-838011731 tempest-AttachInterfacesUnderV243Test-838011731-project-member] Enqueued Resource ID: 142d9057-bcb0-4a21-b68c-c89aa62897bf with Priority: HIGHEST for action security_group_rules [ 1147.585710] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 142d9057-bcb0-4a21-b68c-c89aa62897bf with Priority: HIGHEST for action security_group_rules [ 1147.586028] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock rules-142d9057-bcb0-4a21-b68c-c89aa62897bf taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.586181] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-142d9057-bcb0-4a21-b68c-c89aa62897bf" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.586254] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-142d9057-bcb0-4a21-b68c-c89aa62897bf" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.586509] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-142d9057-bcb0-4a21-b68c-c89aa62897bf" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.586594] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('142d9057-bcb0-4a21-b68c-c89aa62897bf',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1147.758412] env[69980]: INFO networking_nsxv3.common.synchronization [None req-f0e12830-5265-4da5-b0ee-1ee3d4fd68d5 tempest-AttachInterfacesUnderV243Test-838011731 tempest-AttachInterfacesUnderV243Test-838011731-project-member] Enqueued Resource ID: 142d9057-bcb0-4a21-b68c-c89aa62897bf with Priority: HIGHEST for action security_group_rules [ 1147.758935] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 142d9057-bcb0-4a21-b68c-c89aa62897bf with Priority: HIGHEST for action security_group_rules [ 1147.759268] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock rules-142d9057-bcb0-4a21-b68c-c89aa62897bf taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.759374] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-142d9057-bcb0-4a21-b68c-c89aa62897bf" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.987467] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock network-988 taken with stack trace [, , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.987467] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "network-988" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.987467] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "network-988" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.987467] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "network-988" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.987467] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.988030] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.988030] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.988030] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.988030] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.989053] env[69980]: DEBUG dogpile.cache.region [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] No value present for key: 'zone-id' {{(pid=69980) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1147.989053] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] NeedRegenerationException {{(pid=69980) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1147.989223] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] no value, waiting for create lock {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1147.989604] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] value creation lock acquired {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1147.989604] env[69980]: DEBUG dogpile.cache.region [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] No value present for key: 'zone-id' {{(pid=69980) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1147.989604] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Calling creation function for not-yet-present value {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1147.989766] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1148.007793] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1148.007970] env[69980]: DEBUG dogpile.cache.region [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=69980) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1148.013863] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Released creation lock {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1148.013863] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "network-988" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.013863] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock port-13a83941-4b13-4378-82a1-eec3f0efcaf0 taken with stack trace [, , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.013863] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "port-13a83941-4b13-4378-82a1-eec3f0efcaf0" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.013863] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "port-13a83941-4b13-4378-82a1-eec3f0efcaf0" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.013863] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "port-13a83941-4b13-4378-82a1-eec3f0efcaf0" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.013863] env[69980]: DEBUG networking_nsxv3.api.rpc [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('13a83941-4b13-4378-82a1-eec3f0efcaf0',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1148.039740] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.039740] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.039740] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.039740] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.039740] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.039740] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.039740] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.039740] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.039740] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.039740] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.039740] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f0f521c8-595e-4f1b-a139-3ce8948484da already deleted. [ 1148.039740] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f0f521c8-595e-4f1b-a139-3ce8948484da" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.106200] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.108257] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.108257] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.108257] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.108257] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.108257] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 142d9057-bcb0-4a21-b68c-c89aa62897bf already deleted. [ 1148.108257] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-142d9057-bcb0-4a21-b68c-c89aa62897bf" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.108257] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-142d9057-bcb0-4a21-b68c-c89aa62897bf" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.108257] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-142d9057-bcb0-4a21-b68c-c89aa62897bf" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.108257] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('142d9057-bcb0-4a21-b68c-c89aa62897bf',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1148.516778] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.517070] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.517228] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.517571] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.517746] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.517931] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Segment Port 13a83941-4b13-4378-82a1-eec3f0efcaf0 not found, creating... [ 1148.518279] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.518484] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.518611] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.518881] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.519068] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.519431] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.520125] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.520125] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.520125] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.520258] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.520407] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Resource: SegmentPort with ID: 13a83941-4b13-4378-82a1-eec3f0efcaf0 is going to be created. [ 1148.542474] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.542690] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.542822] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.543108] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.543361] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.543648] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "port-13a83941-4b13-4378-82a1-eec3f0efcaf0" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.636805] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.636955] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.637038] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.637256] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.637345] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.637443] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 142d9057-bcb0-4a21-b68c-c89aa62897bf already deleted. [ 1148.637526] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-142d9057-bcb0-4a21-b68c-c89aa62897bf" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.272052] env[69980]: INFO networking_nsxv3.common.synchronization [req-7afc0395-1065-4bcf-9415-4fd0b4a0b767 req-14c83c78-1683-4869-9428-be8653123780 service nova] Enqueued Resource ID: f0f521c8-595e-4f1b-a139-3ce8948484da with Priority: HIGHEST for action security_group_rules [ 1149.272318] env[69980]: INFO networking_nsxv3.common.synchronization [req-7afc0395-1065-4bcf-9415-4fd0b4a0b767 req-14c83c78-1683-4869-9428-be8653123780 service nova] Enqueued Resource ID: f0f521c8-595e-4f1b-a139-3ce8948484da with Priority: HIGHEST for action security_group_members [ 1149.272458] env[69980]: INFO networking_nsxv3.common.synchronization [req-7afc0395-1065-4bcf-9415-4fd0b4a0b767 req-14c83c78-1683-4869-9428-be8653123780 service nova] Enqueued Resource ID: 13a83941-4b13-4378-82a1-eec3f0efcaf0 with Priority: HIGHEST for action port [ 1149.272875] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f0f521c8-595e-4f1b-a139-3ce8948484da with Priority: HIGHEST for action security_group_rules [ 1149.273013] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f0f521c8-595e-4f1b-a139-3ce8948484da with Priority: HIGHEST for action security_group_members [ 1149.273276] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 13a83941-4b13-4378-82a1-eec3f0efcaf0 with Priority: HIGHEST for action port [ 1149.273569] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f0f521c8-595e-4f1b-a139-3ce8948484da taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.273692] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f0f521c8-595e-4f1b-a139-3ce8948484da" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.273756] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f0f521c8-595e-4f1b-a139-3ce8948484da" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.274107] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f0f521c8-595e-4f1b-a139-3ce8948484da" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.274137] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f0f521c8-595e-4f1b-a139-3ce8948484da',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1149.277980] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-f0f521c8-595e-4f1b-a139-3ce8948484da taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.277980] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f0f521c8-595e-4f1b-a139-3ce8948484da" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.277980] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f0f521c8-595e-4f1b-a139-3ce8948484da" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.277980] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f0f521c8-595e-4f1b-a139-3ce8948484da" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.277980] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.277980] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.277980] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.277980] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.277980] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.277980] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f0f521c8-595e-4f1b-a139-3ce8948484da',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1149.277980] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock port-13a83941-4b13-4378-82a1-eec3f0efcaf0 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.277980] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-13a83941-4b13-4378-82a1-eec3f0efcaf0" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.277980] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-13a83941-4b13-4378-82a1-eec3f0efcaf0" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.277980] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-13a83941-4b13-4378-82a1-eec3f0efcaf0" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.277980] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('13a83941-4b13-4378-82a1-eec3f0efcaf0',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1149.404658] env[69980]: INFO networking_nsxv3.common.synchronization [None req-3bae8cff-d068-4bd7-9e00-97de4e16317e None None] Enqueued Resource ID: 85a0d6b6-0e8b-43f5-8e26-33c25a8d50a6 with Priority: HIGHEST for action port [ 1149.408762] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 85a0d6b6-0e8b-43f5-8e26-33c25a8d50a6 with Priority: HIGHEST for action port [ 1149.409248] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock port-85a0d6b6-0e8b-43f5-8e26-33c25a8d50a6 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.409881] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-85a0d6b6-0e8b-43f5-8e26-33c25a8d50a6" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.409881] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-85a0d6b6-0e8b-43f5-8e26-33c25a8d50a6" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.410107] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-85a0d6b6-0e8b-43f5-8e26-33c25a8d50a6" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.410703] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('85a0d6b6-0e8b-43f5-8e26-33c25a8d50a6',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1149.465407] env[69980]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-977287c2-69f8-47e1-8dff-764e9cba9a38 None None] NSXv3 Agent Agent loop - iteration:1 completed [ 1149.465540] env[69980]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-977287c2-69f8-47e1-8dff-764e9cba9a38 None None] NSXv3 Agent Agent loop - iteration:2 started [ 1149.779114] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f0f521c8-595e-4f1b-a139-3ce8948484da',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1149.780120] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-f0f521c8-595e-4f1b-a139-3ce8948484da taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.781042] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f0f521c8-595e-4f1b-a139-3ce8948484da" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.781042] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 13a83941-4b13-4378-82a1-eec3f0efcaf0 with status ACTIVE [ 1149.781042] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.781042] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.781042] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.781207] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.781207] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.781339] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.781426] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.781489] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.781642] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.781718] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.781926] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.782066] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.782134] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.782281] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.782355] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.782541] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 13a83941-4b13-4378-82a1-eec3f0efcaf0 is going to be updated. [ 1149.805934] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.805934] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.805934] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.806169] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.806294] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.806455] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-13a83941-4b13-4378-82a1-eec3f0efcaf0" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.912409] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 85a0d6b6-0e8b-43f5-8e26-33c25a8d50a6 [ 1149.912685] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.913491] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.913491] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.913491] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.913491] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.913491] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:85a0d6b6-0e8b-43f5-8e26-33c25a8d50a6 already deleted. [ 1149.913491] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-85a0d6b6-0e8b-43f5-8e26-33c25a8d50a6" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.282221] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f0f521c8-595e-4f1b-a139-3ce8948484da',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1150.788197] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.788362] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.788435] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.788671] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.788766] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.788868] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f0f521c8-595e-4f1b-a139-3ce8948484da is going to be created. [ 1150.815402] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.815653] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.816334] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.816594] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.820245] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.835304] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f0f521c8-595e-4f1b-a139-3ce8948484da in Status: UNINITIALIZED for 2s [ 1151.688334] env[69980]: INFO networking_nsxv3.common.synchronization [req-a32bac5f-3888-4c87-884e-2efc230989d8 req-08e930fd-7e47-42ed-935b-66467d9ea344 tempest-ServerRescueNegativeTestJSON-1270382253 tempest-ServerRescueNegativeTestJSON-1270382253-project-member] Enqueued Resource ID: f0f521c8-595e-4f1b-a139-3ce8948484da with Priority: HIGHEST for action security_group_members [ 1151.688859] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f0f521c8-595e-4f1b-a139-3ce8948484da with Priority: HIGHEST for action security_group_members [ 1151.689169] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-f0f521c8-595e-4f1b-a139-3ce8948484da taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.689269] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f0f521c8-595e-4f1b-a139-3ce8948484da" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.080585] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock network-988 taken with stack trace [, , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.080779] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "network-988" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.080901] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "network-988" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.081411] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "network-988" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.082048] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.082048] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.082178] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.082418] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.082608] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.082876] env[69980]: DEBUG dogpile.cache.region [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] No value present for key: 'zone-id' {{(pid=69980) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1152.083037] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] NeedRegenerationException {{(pid=69980) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1152.083177] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] no value, waiting for create lock {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1152.083307] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] value creation lock acquired {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1152.083550] env[69980]: DEBUG dogpile.cache.region [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] No value present for key: 'zone-id' {{(pid=69980) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1152.083709] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Calling creation function for not-yet-present value {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1152.083878] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1152.100818] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1152.100986] env[69980]: DEBUG dogpile.cache.region [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Cache value generated in 0.017 seconds for key(s): 'zone-id' {{(pid=69980) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1152.101160] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Released creation lock {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1152.101352] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "network-988" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.101654] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock port-a1dcc3f6-d7e4-49b4-90e2-ca84d38e05e1 taken with stack trace [, , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.101828] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "port-a1dcc3f6-d7e4-49b4-90e2-ca84d38e05e1" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.101951] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "port-a1dcc3f6-d7e4-49b4-90e2-ca84d38e05e1" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.102333] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "port-a1dcc3f6-d7e4-49b4-90e2-ca84d38e05e1" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.102406] env[69980]: DEBUG networking_nsxv3.api.rpc [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a1dcc3f6-d7e4-49b4-90e2-ca84d38e05e1',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1152.606046] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.606370] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.606508] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.607728] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.607728] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.607728] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Segment Port a1dcc3f6-d7e4-49b4-90e2-ca84d38e05e1 not found, creating... [ 1152.607728] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.607728] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.607728] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.608070] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.608070] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.608336] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.608509] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.608628] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.608836] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.608973] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.609222] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Resource: SegmentPort with ID: a1dcc3f6-d7e4-49b4-90e2-ca84d38e05e1 is going to be created. [ 1152.631073] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.631293] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.631428] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.631835] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.632110] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.632234] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "port-a1dcc3f6-d7e4-49b4-90e2-ca84d38e05e1" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.844871] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f0f521c8-595e-4f1b-a139-3ce8948484da in Status: SUCCESS [ 1152.845160] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f0f521c8-595e-4f1b-a139-3ce8948484da" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.845262] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f0f521c8-595e-4f1b-a139-3ce8948484da" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.845468] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f0f521c8-595e-4f1b-a139-3ce8948484da" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.845660] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.845787] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.845853] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.846059] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.846103] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.846219] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f0f521c8-595e-4f1b-a139-3ce8948484da" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.846275] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f0f521c8-595e-4f1b-a139-3ce8948484da',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1152.848103] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f0f521c8-595e-4f1b-a139-3ce8948484da" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.848671] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f0f521c8-595e-4f1b-a139-3ce8948484da" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.848671] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.848671] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.848828] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.848855] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.849544] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.849544] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f0f521c8-595e-4f1b-a139-3ce8948484da',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1153.348711] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-f0f521c8-595e-4f1b-a139-3ce8948484da taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.348897] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f0f521c8-595e-4f1b-a139-3ce8948484da" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.351384] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f0f521c8-595e-4f1b-a139-3ce8948484da',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1153.390994] env[69980]: INFO networking_nsxv3.common.synchronization [req-a32bac5f-3888-4c87-884e-2efc230989d8 req-00b836b4-de36-4747-9d9d-74883510fff3 service nova] Enqueued Resource ID: f0f521c8-595e-4f1b-a139-3ce8948484da with Priority: HIGHEST for action security_group_rules [ 1153.391186] env[69980]: INFO networking_nsxv3.common.synchronization [req-a32bac5f-3888-4c87-884e-2efc230989d8 req-00b836b4-de36-4747-9d9d-74883510fff3 service nova] Enqueued Resource ID: f0f521c8-595e-4f1b-a139-3ce8948484da with Priority: HIGHEST for action security_group_members [ 1153.391321] env[69980]: INFO networking_nsxv3.common.synchronization [req-a32bac5f-3888-4c87-884e-2efc230989d8 req-00b836b4-de36-4747-9d9d-74883510fff3 service nova] Enqueued Resource ID: a1dcc3f6-d7e4-49b4-90e2-ca84d38e05e1 with Priority: HIGHEST for action port [ 1153.391540] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f0f521c8-595e-4f1b-a139-3ce8948484da with Priority: HIGHEST for action security_group_rules [ 1153.391703] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f0f521c8-595e-4f1b-a139-3ce8948484da with Priority: HIGHEST for action security_group_members [ 1153.391785] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a1dcc3f6-d7e4-49b4-90e2-ca84d38e05e1 with Priority: HIGHEST for action port [ 1153.392325] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f0f521c8-595e-4f1b-a139-3ce8948484da taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.392428] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f0f521c8-595e-4f1b-a139-3ce8948484da" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.395613] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-f0f521c8-595e-4f1b-a139-3ce8948484da taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.395613] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f0f521c8-595e-4f1b-a139-3ce8948484da" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.395613] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock port-a1dcc3f6-d7e4-49b4-90e2-ca84d38e05e1 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.395613] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a1dcc3f6-d7e4-49b4-90e2-ca84d38e05e1" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.395613] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a1dcc3f6-d7e4-49b4-90e2-ca84d38e05e1" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.395613] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a1dcc3f6-d7e4-49b4-90e2-ca84d38e05e1" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.395613] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a1dcc3f6-d7e4-49b4-90e2-ca84d38e05e1',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1153.854458] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f0f521c8-595e-4f1b-a139-3ce8948484da',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1153.897408] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a1dcc3f6-d7e4-49b4-90e2-ca84d38e05e1 with status ACTIVE [ 1153.897637] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.897774] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.897845] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.898073] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.898167] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.898354] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.899446] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.899482] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.899689] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.899751] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.899950] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.900130] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.900130] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.900353] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.900353] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.900613] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a1dcc3f6-d7e4-49b4-90e2-ca84d38e05e1 is going to be updated. [ 1153.923631] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.923631] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.923748] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.924334] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.924334] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.924334] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a1dcc3f6-d7e4-49b4-90e2-ca84d38e05e1" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.357392] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.357568] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.357647] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.357857] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.357949] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.358060] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f0f521c8-595e-4f1b-a139-3ce8948484da is going to be updated. [ 1154.393605] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.393752] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.393814] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.397019] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.397019] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.403512] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f0f521c8-595e-4f1b-a139-3ce8948484da in Status: IN_PROGRESS for 2s [ 1155.951506] env[69980]: INFO networking_nsxv3.common.synchronization [req-88000879-8af8-4f5f-9159-3ccf7897ca51 req-106ee698-67fa-448f-b4b0-9662b8b21a3c tempest-AttachVolumeShelveTestJSON-1941643989 tempest-AttachVolumeShelveTestJSON-1941643989-project-member] Enqueued Resource ID: 3909a119-b9ca-4e95-b2b4-3541d0886a49 with Priority: HIGHEST for action security_group_members [ 1155.951506] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3909a119-b9ca-4e95-b2b4-3541d0886a49 with Priority: HIGHEST for action security_group_members [ 1155.952025] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-3909a119-b9ca-4e95-b2b4-3541d0886a49 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1155.952025] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3909a119-b9ca-4e95-b2b4-3541d0886a49" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1155.952025] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3909a119-b9ca-4e95-b2b4-3541d0886a49" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1155.952378] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3909a119-b9ca-4e95-b2b4-3541d0886a49" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1155.952378] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1155.952511] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1155.952616] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1155.952836] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1155.953224] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1155.953224] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3909a119-b9ca-4e95-b2b4-3541d0886a49',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1156.286021] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock network-472 taken with stack trace [, , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.286021] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "network-472" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.286021] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "network-472" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.286626] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "network-472" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.287104] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.288077] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.288077] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.288077] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.288934] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.288934] env[69980]: DEBUG dogpile.cache.region [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] No value present for key: 'zone-id' {{(pid=69980) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1156.288934] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] NeedRegenerationException {{(pid=69980) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1156.288934] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] no value, waiting for create lock {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1156.288934] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] value creation lock acquired {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1156.288934] env[69980]: DEBUG dogpile.cache.region [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] No value present for key: 'zone-id' {{(pid=69980) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1156.289301] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Calling creation function for not-yet-present value {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1156.289301] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1156.307581] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1156.307790] env[69980]: DEBUG dogpile.cache.region [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=69980) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1156.307967] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Released creation lock {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1156.308242] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "network-472" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.308687] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock port-917b0999-9a9f-41ad-b7ca-4827aab2a90f taken with stack trace [, , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.308835] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "port-917b0999-9a9f-41ad-b7ca-4827aab2a90f" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.308947] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "port-917b0999-9a9f-41ad-b7ca-4827aab2a90f" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.309450] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "port-917b0999-9a9f-41ad-b7ca-4827aab2a90f" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.309624] env[69980]: DEBUG networking_nsxv3.api.rpc [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('917b0999-9a9f-41ad-b7ca-4827aab2a90f',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1156.413800] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f0f521c8-595e-4f1b-a139-3ce8948484da in Status: SUCCESS [ 1156.414109] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f0f521c8-595e-4f1b-a139-3ce8948484da" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.414302] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f0f521c8-595e-4f1b-a139-3ce8948484da" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.414531] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f0f521c8-595e-4f1b-a139-3ce8948484da" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.414732] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.414852] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.415185] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.415185] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.415294] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.415294] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f0f521c8-595e-4f1b-a139-3ce8948484da" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.415448] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-f0f521c8-595e-4f1b-a139-3ce8948484da taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.415523] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f0f521c8-595e-4f1b-a139-3ce8948484da" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.415584] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f0f521c8-595e-4f1b-a139-3ce8948484da" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.415722] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f0f521c8-595e-4f1b-a139-3ce8948484da" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.415871] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.415974] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.416061] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.416168] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.416274] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.416381] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f0f521c8-595e-4f1b-a139-3ce8948484da" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.416473] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f0f521c8-595e-4f1b-a139-3ce8948484da',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1156.417570] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f0f521c8-595e-4f1b-a139-3ce8948484da" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.417802] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f0f521c8-595e-4f1b-a139-3ce8948484da" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.417931] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.418051] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.418115] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.418260] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.418841] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.418841] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f0f521c8-595e-4f1b-a139-3ce8948484da',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1156.456304] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.456304] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.456304] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.456504] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.456625] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.456877] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.458191] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.458191] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.458191] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.458191] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.458191] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3909a119-b9ca-4e95-b2b4-3541d0886a49 already deleted. [ 1156.458191] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3909a119-b9ca-4e95-b2b4-3541d0886a49" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.813040] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.813040] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.813040] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.813326] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.813430] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.813591] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Segment Port 917b0999-9a9f-41ad-b7ca-4827aab2a90f not found, creating... [ 1156.813862] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.814044] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.814172] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.814402] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.814548] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.814833] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.814997] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.815131] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.815339] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.815479] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.815620] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Resource: SegmentPort with ID: 917b0999-9a9f-41ad-b7ca-4827aab2a90f is going to be created. [ 1156.836024] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.836196] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.836388] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.836656] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.836939] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.837210] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "port-917b0999-9a9f-41ad-b7ca-4827aab2a90f" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.921020] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f0f521c8-595e-4f1b-a139-3ce8948484da: rpc.has_security_group_logging(os_id): False [ 1156.922239] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f0f521c8-595e-4f1b-a139-3ce8948484da',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1156.947134] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.947283] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.947357] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.947565] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.947654] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.947840] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.947936] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.947999] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.948157] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.948236] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.948440] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.948537] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.948607] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.948741] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.948814] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.949012] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.949175] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.949203] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.949334] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.949408] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.949493] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f0f521c8-595e-4f1b-a139-3ce8948484da is going to be created. [ 1157.022305] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.022567] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.022567] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.022853] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.023084] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.032798] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f0f521c8-595e-4f1b-a139-3ce8948484da in Status: IN_PROGRESS for 2s [ 1157.424212] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f0f521c8-595e-4f1b-a139-3ce8948484da',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1157.564148] env[69980]: INFO networking_nsxv3.common.synchronization [req-88000879-8af8-4f5f-9159-3ccf7897ca51 req-d0814016-c4fb-4b6a-b703-2cafb27bddb1 service nova] Enqueued Resource ID: 3909a119-b9ca-4e95-b2b4-3541d0886a49 with Priority: HIGHEST for action security_group_rules [ 1157.564148] env[69980]: INFO networking_nsxv3.common.synchronization [req-88000879-8af8-4f5f-9159-3ccf7897ca51 req-d0814016-c4fb-4b6a-b703-2cafb27bddb1 service nova] Enqueued Resource ID: 3909a119-b9ca-4e95-b2b4-3541d0886a49 with Priority: HIGHEST for action security_group_members [ 1157.564148] env[69980]: INFO networking_nsxv3.common.synchronization [req-88000879-8af8-4f5f-9159-3ccf7897ca51 req-d0814016-c4fb-4b6a-b703-2cafb27bddb1 service nova] Enqueued Resource ID: 917b0999-9a9f-41ad-b7ca-4827aab2a90f with Priority: HIGHEST for action port [ 1157.564148] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3909a119-b9ca-4e95-b2b4-3541d0886a49 with Priority: HIGHEST for action security_group_rules [ 1157.564148] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3909a119-b9ca-4e95-b2b4-3541d0886a49 with Priority: HIGHEST for action security_group_members [ 1157.564148] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 917b0999-9a9f-41ad-b7ca-4827aab2a90f with Priority: HIGHEST for action port [ 1157.564697] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3909a119-b9ca-4e95-b2b4-3541d0886a49 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.564825] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3909a119-b9ca-4e95-b2b4-3541d0886a49" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.565671] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3909a119-b9ca-4e95-b2b4-3541d0886a49" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.565671] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3909a119-b9ca-4e95-b2b4-3541d0886a49" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.565671] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3909a119-b9ca-4e95-b2b4-3541d0886a49',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1157.566062] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-3909a119-b9ca-4e95-b2b4-3541d0886a49 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.566232] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3909a119-b9ca-4e95-b2b4-3541d0886a49" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.566335] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3909a119-b9ca-4e95-b2b4-3541d0886a49" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.566559] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3909a119-b9ca-4e95-b2b4-3541d0886a49" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.566726] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.566828] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.566907] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.567079] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.567168] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.567266] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3909a119-b9ca-4e95-b2b4-3541d0886a49',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1157.568348] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock port-917b0999-9a9f-41ad-b7ca-4827aab2a90f taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.568413] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-917b0999-9a9f-41ad-b7ca-4827aab2a90f" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.568444] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-917b0999-9a9f-41ad-b7ca-4827aab2a90f" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.568579] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-917b0999-9a9f-41ad-b7ca-4827aab2a90f" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.568675] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('917b0999-9a9f-41ad-b7ca-4827aab2a90f',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1157.926949] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.926949] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.926949] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.927216] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.927317] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.927437] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f0f521c8-595e-4f1b-a139-3ce8948484da is going to be updated. [ 1157.951864] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.952025] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.952107] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.952295] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.952435] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.960040] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f0f521c8-595e-4f1b-a139-3ce8948484da in Status: IN_PROGRESS for 2s [ 1158.069923] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-3909a119-b9ca-4e95-b2b4-3541d0886a49 taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.070242] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3909a119-b9ca-4e95-b2b4-3541d0886a49" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.071398] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3909a119-b9ca-4e95-b2b4-3541d0886a49',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1158.072457] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 917b0999-9a9f-41ad-b7ca-4827aab2a90f with status ACTIVE [ 1158.072457] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.072589] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.072628] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.075158] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.075158] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.075158] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.075158] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.075158] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.075158] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.075158] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.075158] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.075158] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.075158] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.075158] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.075158] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.075158] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 917b0999-9a9f-41ad-b7ca-4827aab2a90f is going to be updated. [ 1158.098209] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.098398] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.098506] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.098760] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.098946] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.099149] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-917b0999-9a9f-41ad-b7ca-4827aab2a90f" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.576893] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3909a119-b9ca-4e95-b2b4-3541d0886a49',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1159.045081] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f0f521c8-595e-4f1b-a139-3ce8948484da in Status: SUCCESS [ 1159.045429] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f0f521c8-595e-4f1b-a139-3ce8948484da" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1159.045652] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f0f521c8-595e-4f1b-a139-3ce8948484da" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.045912] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f0f521c8-595e-4f1b-a139-3ce8948484da" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.046054] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f0f521c8-595e-4f1b-a139-3ce8948484da',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1159.079674] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.080019] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.080019] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.080145] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.080317] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1159.080448] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3909a119-b9ca-4e95-b2b4-3541d0886a49 is going to be created. [ 1159.099967] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.100125] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.100201] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.100405] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.100557] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1159.108664] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3909a119-b9ca-4e95-b2b4-3541d0886a49 in Status: UNINITIALIZED for 2s [ 1159.548561] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-f0f521c8-595e-4f1b-a139-3ce8948484da taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.548785] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f0f521c8-595e-4f1b-a139-3ce8948484da" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.970038] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f0f521c8-595e-4f1b-a139-3ce8948484da in Status: SUCCESS [ 1159.970724] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f0f521c8-595e-4f1b-a139-3ce8948484da" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1159.970724] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f0f521c8-595e-4f1b-a139-3ce8948484da" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.970724] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f0f521c8-595e-4f1b-a139-3ce8948484da" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.970915] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.971040] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.972165] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.972165] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.972165] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1159.972165] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f0f521c8-595e-4f1b-a139-3ce8948484da" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1159.972165] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f0f521c8-595e-4f1b-a139-3ce8948484da',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1160.473870] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-f0f521c8-595e-4f1b-a139-3ce8948484da taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1160.474751] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f0f521c8-595e-4f1b-a139-3ce8948484da" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1160.474751] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f0f521c8-595e-4f1b-a139-3ce8948484da" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1160.475127] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f0f521c8-595e-4f1b-a139-3ce8948484da" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1160.475127] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1160.475251] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1160.475341] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1160.475456] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1160.475555] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1160.475661] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f0f521c8-595e-4f1b-a139-3ce8948484da" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1160.475885] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-f0f521c8-595e-4f1b-a139-3ce8948484da taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1160.475999] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f0f521c8-595e-4f1b-a139-3ce8948484da" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1160.476115] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f0f521c8-595e-4f1b-a139-3ce8948484da" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1160.476273] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f0f521c8-595e-4f1b-a139-3ce8948484da" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1160.476439] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1160.476545] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1160.476606] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1160.476740] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1160.476940] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1160.476940] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f0f521c8-595e-4f1b-a139-3ce8948484da" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1160.477052] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f0f521c8-595e-4f1b-a139-3ce8948484da',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1160.560458] env[69980]: INFO networking_nsxv3.common.synchronization [req-53b5691f-a899-48d1-8f1e-a4653c1627b4 req-51d59a08-33e7-4e2a-a3cb-cefaf4fcd6a5 tempest-ServerActionsTestOtherA-1240783872 tempest-ServerActionsTestOtherA-1240783872-project-member] Enqueued Resource ID: c64c611c-a81f-411b-a88c-f87f4d86a64a with Priority: HIGHEST for action security_group_members [ 1160.560984] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c64c611c-a81f-411b-a88c-f87f4d86a64a with Priority: HIGHEST for action security_group_members [ 1160.561308] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-c64c611c-a81f-411b-a88c-f87f4d86a64a taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1160.561458] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c64c611c-a81f-411b-a88c-f87f4d86a64a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1160.561560] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c64c611c-a81f-411b-a88c-f87f4d86a64a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1160.561828] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c64c611c-a81f-411b-a88c-f87f4d86a64a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1160.561992] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1160.562103] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1160.562172] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1160.562319] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1160.562402] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1160.562492] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c64c611c-a81f-411b-a88c-f87f4d86a64a',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1160.818871] env[69980]: INFO networking_nsxv3.common.synchronization [req-f6417271-fa61-4e9c-bebd-943101a62cba req-5da6d994-6734-46c8-9270-e01969ddc41a tempest-ServerDiskConfigTestJSON-214268531 tempest-ServerDiskConfigTestJSON-214268531-project-member] Enqueued Resource ID: 0dbf2bcd-0572-43ef-b18d-cc3cca7fcfd5 with Priority: HIGHEST for action security_group_members [ 1160.820210] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0dbf2bcd-0572-43ef-b18d-cc3cca7fcfd5 with Priority: HIGHEST for action security_group_members [ 1160.820210] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-0dbf2bcd-0572-43ef-b18d-cc3cca7fcfd5 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1160.820210] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0dbf2bcd-0572-43ef-b18d-cc3cca7fcfd5" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1160.820210] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0dbf2bcd-0572-43ef-b18d-cc3cca7fcfd5" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1160.820355] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0dbf2bcd-0572-43ef-b18d-cc3cca7fcfd5" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1160.820724] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1160.821264] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1160.821264] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1160.821264] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1160.821264] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1160.821264] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0dbf2bcd-0572-43ef-b18d-cc3cca7fcfd5',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1160.872682] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock network-714 taken with stack trace [, , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1160.873006] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "network-714" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1160.873175] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "network-714" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1160.873438] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "network-714" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1160.873703] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1160.873866] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1160.873986] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1160.874336] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1160.874552] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1160.875203] env[69980]: DEBUG dogpile.cache.region [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] No value present for key: 'zone-id' {{(pid=69980) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1160.875384] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] NeedRegenerationException {{(pid=69980) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1160.875550] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] no value, waiting for create lock {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1160.875698] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] value creation lock acquired {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1160.875848] env[69980]: DEBUG dogpile.cache.region [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] No value present for key: 'zone-id' {{(pid=69980) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1160.875986] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Calling creation function for not-yet-present value {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1160.876164] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1160.895362] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1160.895362] env[69980]: DEBUG dogpile.cache.region [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=69980) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1160.895362] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Released creation lock {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1160.895362] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "network-714" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1160.895362] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock port-1a363ae8-2e72-4c0f-94a3-59ba12de641d taken with stack trace [, , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1160.895362] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "port-1a363ae8-2e72-4c0f-94a3-59ba12de641d" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1160.895573] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "port-1a363ae8-2e72-4c0f-94a3-59ba12de641d" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1160.895769] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "port-1a363ae8-2e72-4c0f-94a3-59ba12de641d" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1160.895904] env[69980]: DEBUG networking_nsxv3.api.rpc [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1a363ae8-2e72-4c0f-94a3-59ba12de641d',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1160.979132] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f0f521c8-595e-4f1b-a139-3ce8948484da: rpc.has_security_group_logging(os_id): False [ 1161.005808] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1161.006075] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1161.006224] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1161.006517] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1161.006682] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1161.006929] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1161.007066] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1161.007152] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1161.007342] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1161.007432] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1161.007682] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1161.007813] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1161.007879] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1161.008067] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1161.008152] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1161.008377] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1161.008489] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1161.008563] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1161.008752] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1161.008838] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1161.008926] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f0f521c8-595e-4f1b-a139-3ce8948484da is going to be updated. [ 1161.064382] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1161.064616] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1161.064680] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1161.064913] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1161.065023] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1161.065265] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1161.065379] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1161.065448] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1161.065643] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1161.065726] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1161.065819] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c64c611c-a81f-411b-a88c-f87f4d86a64a already deleted. [ 1161.065900] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c64c611c-a81f-411b-a88c-f87f4d86a64a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1161.096862] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1161.097042] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1161.097042] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1161.097735] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1161.097735] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1161.111482] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f0f521c8-595e-4f1b-a139-3ce8948484da in Status: IN_PROGRESS for 2s [ 1161.117942] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3909a119-b9ca-4e95-b2b4-3541d0886a49 in Status: SUCCESS [ 1161.118205] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3909a119-b9ca-4e95-b2b4-3541d0886a49" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1161.118369] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3909a119-b9ca-4e95-b2b4-3541d0886a49" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1161.118603] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3909a119-b9ca-4e95-b2b4-3541d0886a49" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1161.118813] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1161.118952] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1161.119033] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1161.119249] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1161.119305] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1161.119393] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3909a119-b9ca-4e95-b2b4-3541d0886a49" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1161.119480] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('3909a119-b9ca-4e95-b2b4-3541d0886a49',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1161.323413] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1161.323581] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1161.323655] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1161.323875] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1161.323968] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1161.324187] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1161.324308] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1161.324373] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1161.324523] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1161.324600] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1161.324685] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0dbf2bcd-0572-43ef-b18d-cc3cca7fcfd5 is going to be updated. [ 1161.356060] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1161.356199] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1161.356239] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1161.356465] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1161.356607] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1161.367087] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0dbf2bcd-0572-43ef-b18d-cc3cca7fcfd5 in Status: IN_PROGRESS for 2s [ 1161.398697] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1161.398895] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1161.399014] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1161.399294] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1161.399449] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1161.399606] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Segment Port 1a363ae8-2e72-4c0f-94a3-59ba12de641d not found, creating... [ 1161.399878] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1161.400055] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1161.400198] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1161.400433] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1161.400578] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1161.400865] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1161.401033] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1161.401157] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1161.401364] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1161.401500] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1161.401667] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Resource: SegmentPort with ID: 1a363ae8-2e72-4c0f-94a3-59ba12de641d is going to be created. [ 1161.421325] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1161.421508] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1161.421635] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1161.421871] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1161.422109] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1161.422334] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "port-1a363ae8-2e72-4c0f-94a3-59ba12de641d" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1161.621583] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('3909a119-b9ca-4e95-b2b4-3541d0886a49',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1162.123665] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 3909a119-b9ca-4e95-b2b4-3541d0886a49: rpc.has_security_group_logging(os_id): False [ 1162.140767] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.140916] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.140988] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.141220] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.141310] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.141555] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.141657] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.141722] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.141880] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.141957] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.142058] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3909a119-b9ca-4e95-b2b4-3541d0886a49 is going to be created. [ 1162.181979] env[69980]: INFO networking_nsxv3.common.synchronization [req-53b5691f-a899-48d1-8f1e-a4653c1627b4 req-6afaaacd-774f-4269-8137-4408dd7648a3 service nova] Enqueued Resource ID: c64c611c-a81f-411b-a88c-f87f4d86a64a with Priority: HIGHEST for action security_group_rules [ 1162.182188] env[69980]: INFO networking_nsxv3.common.synchronization [req-53b5691f-a899-48d1-8f1e-a4653c1627b4 req-6afaaacd-774f-4269-8137-4408dd7648a3 service nova] Enqueued Resource ID: c64c611c-a81f-411b-a88c-f87f4d86a64a with Priority: HIGHEST for action security_group_members [ 1162.182330] env[69980]: INFO networking_nsxv3.common.synchronization [req-53b5691f-a899-48d1-8f1e-a4653c1627b4 req-6afaaacd-774f-4269-8137-4408dd7648a3 service nova] Enqueued Resource ID: 1a363ae8-2e72-4c0f-94a3-59ba12de641d with Priority: HIGHEST for action port [ 1162.182560] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c64c611c-a81f-411b-a88c-f87f4d86a64a with Priority: HIGHEST for action security_group_rules [ 1162.182684] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c64c611c-a81f-411b-a88c-f87f4d86a64a with Priority: HIGHEST for action security_group_members [ 1162.182779] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1a363ae8-2e72-4c0f-94a3-59ba12de641d with Priority: HIGHEST for action port [ 1162.183325] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c64c611c-a81f-411b-a88c-f87f4d86a64a taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.183440] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c64c611c-a81f-411b-a88c-f87f4d86a64a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.183508] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c64c611c-a81f-411b-a88c-f87f4d86a64a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.183706] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c64c611c-a81f-411b-a88c-f87f4d86a64a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.183786] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c64c611c-a81f-411b-a88c-f87f4d86a64a',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1162.185520] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-c64c611c-a81f-411b-a88c-f87f4d86a64a taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.185917] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c64c611c-a81f-411b-a88c-f87f4d86a64a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.185991] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c64c611c-a81f-411b-a88c-f87f4d86a64a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.186172] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c64c611c-a81f-411b-a88c-f87f4d86a64a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.186343] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.186454] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.186520] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.186672] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.186758] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.186848] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c64c611c-a81f-411b-a88c-f87f4d86a64a',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1162.187592] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock port-1a363ae8-2e72-4c0f-94a3-59ba12de641d taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.187700] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1a363ae8-2e72-4c0f-94a3-59ba12de641d" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.187769] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1a363ae8-2e72-4c0f-94a3-59ba12de641d" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.187919] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1a363ae8-2e72-4c0f-94a3-59ba12de641d" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.187995] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1a363ae8-2e72-4c0f-94a3-59ba12de641d',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1162.193155] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.193239] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.193321] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.193493] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.193675] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.203919] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3909a119-b9ca-4e95-b2b4-3541d0886a49 in Status: IN_PROGRESS for 2s [ 1162.689447] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c64c611c-a81f-411b-a88c-f87f4d86a64a',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1162.690868] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-c64c611c-a81f-411b-a88c-f87f4d86a64a taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.690868] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c64c611c-a81f-411b-a88c-f87f4d86a64a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.691255] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 1a363ae8-2e72-4c0f-94a3-59ba12de641d with status ACTIVE [ 1162.691424] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.691530] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.691598] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.691830] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.691922] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.692110] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.692208] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.692257] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.692407] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.692485] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.692707] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.692778] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.692812] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.692936] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.693016] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.693107] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 1a363ae8-2e72-4c0f-94a3-59ba12de641d is going to be updated. [ 1162.720466] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.720653] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.720653] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.720906] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.721064] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.721229] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1a363ae8-2e72-4c0f-94a3-59ba12de641d" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.122707] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f0f521c8-595e-4f1b-a139-3ce8948484da in Status: SUCCESS [ 1163.122941] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f0f521c8-595e-4f1b-a139-3ce8948484da" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.193338] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c64c611c-a81f-411b-a88c-f87f4d86a64a',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1163.378901] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0dbf2bcd-0572-43ef-b18d-cc3cca7fcfd5 in Status: SUCCESS [ 1163.378901] env[69980]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0dbf2bcd-0572-43ef-b18d-cc3cca7fcfd5 deletion is rescheduled due to dependency. [ 1163.378901] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0dbf2bcd-0572-43ef-b18d-cc3cca7fcfd5" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.695608] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.695922] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.695922] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.696088] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.696177] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.696276] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c64c611c-a81f-411b-a88c-f87f4d86a64a is going to be created. [ 1163.728949] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.728949] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.728949] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.729177] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.730051] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.737996] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c64c611c-a81f-411b-a88c-f87f4d86a64a in Status: UNINITIALIZED for 2s [ 1164.215581] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3909a119-b9ca-4e95-b2b4-3541d0886a49 in Status: SUCCESS [ 1164.215889] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3909a119-b9ca-4e95-b2b4-3541d0886a49" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.406036] env[69980]: INFO networking_nsxv3.common.synchronization [req-5a605d38-ec16-4c5f-9caf-287251ecd0d6 req-bd96c60a-7d7b-4e21-969c-71551d2c8964 tempest-DeleteServersTestJSON-1084822395 tempest-DeleteServersTestJSON-1084822395-project-member] Enqueued Resource ID: d0e04be7-8718-489c-8ceb-fe661da4855a with Priority: HIGHEST for action security_group_members [ 1164.408027] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d0e04be7-8718-489c-8ceb-fe661da4855a with Priority: HIGHEST for action security_group_members [ 1164.408027] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-d0e04be7-8718-489c-8ceb-fe661da4855a taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.408027] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d0e04be7-8718-489c-8ceb-fe661da4855a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.408027] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d0e04be7-8718-489c-8ceb-fe661da4855a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.408027] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d0e04be7-8718-489c-8ceb-fe661da4855a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.408027] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.408027] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.408027] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.408545] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.408717] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.408883] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d0e04be7-8718-489c-8ceb-fe661da4855a',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1164.911368] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.911694] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.911732] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.911994] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.912081] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.912346] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.912570] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.912570] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.912715] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.912797] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.912930] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d0e04be7-8718-489c-8ceb-fe661da4855a is going to be updated. [ 1164.942318] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.942898] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.942898] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.942898] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.943043] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.954725] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d0e04be7-8718-489c-8ceb-fe661da4855a in Status: IN_PROGRESS for 2s [ 1165.751369] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c64c611c-a81f-411b-a88c-f87f4d86a64a in Status: SUCCESS [ 1165.751369] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c64c611c-a81f-411b-a88c-f87f4d86a64a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1165.751369] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c64c611c-a81f-411b-a88c-f87f4d86a64a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1165.751516] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c64c611c-a81f-411b-a88c-f87f4d86a64a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1165.751677] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1165.752378] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1165.752378] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1165.752378] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1165.752378] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1165.752378] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c64c611c-a81f-411b-a88c-f87f4d86a64a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1165.752378] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c64c611c-a81f-411b-a88c-f87f4d86a64a',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1166.254649] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c64c611c-a81f-411b-a88c-f87f4d86a64a',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1166.759430] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c64c611c-a81f-411b-a88c-f87f4d86a64a: rpc.has_security_group_logging(os_id): False [ 1166.776251] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1166.776251] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1166.776493] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1166.777040] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1166.777040] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1166.777040] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1166.777255] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1166.777255] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1166.777490] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1166.777490] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1166.777562] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c64c611c-a81f-411b-a88c-f87f4d86a64a is going to be created. [ 1166.836365] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1166.836365] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1166.836365] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1166.836365] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1166.836365] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1166.847283] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c64c611c-a81f-411b-a88c-f87f4d86a64a in Status: IN_PROGRESS for 2s [ 1166.974439] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d0e04be7-8718-489c-8ceb-fe661da4855a in Status: SUCCESS [ 1166.974582] env[69980]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d0e04be7-8718-489c-8ceb-fe661da4855a deletion is rescheduled due to dependency. [ 1166.974674] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d0e04be7-8718-489c-8ceb-fe661da4855a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1167.305104] env[69980]: INFO networking_nsxv3.common.synchronization [req-25fa8629-efba-4fd0-9949-e3c7bc2d8a97 req-94d01c1a-bbe3-4219-a7c3-8cfa17f16b44 tempest-AttachInterfacesUnderV243Test-838011731 tempest-AttachInterfacesUnderV243Test-838011731-project-member] Enqueued Resource ID: 142d9057-bcb0-4a21-b68c-c89aa62897bf with Priority: HIGHEST for action security_group_members [ 1167.305821] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 142d9057-bcb0-4a21-b68c-c89aa62897bf with Priority: HIGHEST for action security_group_members [ 1167.306324] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-142d9057-bcb0-4a21-b68c-c89aa62897bf taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.306570] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-142d9057-bcb0-4a21-b68c-c89aa62897bf" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.306707] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-142d9057-bcb0-4a21-b68c-c89aa62897bf" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1167.307049] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-142d9057-bcb0-4a21-b68c-c89aa62897bf" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1167.307433] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.307433] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.307536] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1167.307914] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1167.307914] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1167.308011] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('142d9057-bcb0-4a21-b68c-c89aa62897bf',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1167.692318] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock network-474 taken with stack trace [, , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.692528] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "network-474" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.692649] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "network-474" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1167.692977] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "network-474" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1167.693261] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.693426] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.693547] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1167.693766] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1167.693949] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1167.694184] env[69980]: DEBUG dogpile.cache.region [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] No value present for key: 'zone-id' {{(pid=69980) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1167.694308] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] NeedRegenerationException {{(pid=69980) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1167.694552] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] no value, waiting for create lock {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1167.694552] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] value creation lock acquired {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1167.695051] env[69980]: DEBUG dogpile.cache.region [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] No value present for key: 'zone-id' {{(pid=69980) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1167.695215] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Calling creation function for not-yet-present value {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1167.695373] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1167.714269] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1167.714499] env[69980]: DEBUG dogpile.cache.region [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=69980) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1167.714739] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Released creation lock {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1167.714991] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "network-474" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1167.715510] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock port-34175dd9-72ca-491c-b458-ce73e251edac taken with stack trace [, , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.715655] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "port-34175dd9-72ca-491c-b458-ce73e251edac" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.715790] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "port-34175dd9-72ca-491c-b458-ce73e251edac" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1167.716142] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "port-34175dd9-72ca-491c-b458-ce73e251edac" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1167.716267] env[69980]: DEBUG networking_nsxv3.api.rpc [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('34175dd9-72ca-491c-b458-ce73e251edac',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1167.810850] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.811062] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.811125] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1167.811323] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1167.811417] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1167.811621] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.811721] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.811784] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1167.811948] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1167.812035] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1167.812120] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 142d9057-bcb0-4a21-b68c-c89aa62897bf already deleted. [ 1167.812203] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-142d9057-bcb0-4a21-b68c-c89aa62897bf" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1168.219631] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1168.219967] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1168.220192] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1168.220433] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1168.220622] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1168.220808] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Segment Port 34175dd9-72ca-491c-b458-ce73e251edac not found, creating... [ 1168.221302] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1168.221302] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1168.221498] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1168.221584] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1168.221742] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1168.222043] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1168.222207] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1168.222325] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1168.222577] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1168.222753] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1168.222894] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Resource: SegmentPort with ID: 34175dd9-72ca-491c-b458-ce73e251edac is going to be created. [ 1168.245044] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1168.245392] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1168.245624] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1168.246036] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1168.246432] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1168.246756] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "port-34175dd9-72ca-491c-b458-ce73e251edac" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1168.425878] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1168.426258] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1168.426258] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1168.426359] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1168.426480] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1168.861140] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c64c611c-a81f-411b-a88c-f87f4d86a64a in Status: SUCCESS [ 1168.861140] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c64c611c-a81f-411b-a88c-f87f4d86a64a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1168.930609] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1169.185455] env[69980]: INFO networking_nsxv3.common.synchronization [req-25fa8629-efba-4fd0-9949-e3c7bc2d8a97 req-edeb0c50-b6b1-4b20-b7a6-7ad5ebafd626 service nova] Enqueued Resource ID: 142d9057-bcb0-4a21-b68c-c89aa62897bf with Priority: HIGHEST for action security_group_rules [ 1169.185819] env[69980]: INFO networking_nsxv3.common.synchronization [req-25fa8629-efba-4fd0-9949-e3c7bc2d8a97 req-edeb0c50-b6b1-4b20-b7a6-7ad5ebafd626 service nova] Enqueued Resource ID: 142d9057-bcb0-4a21-b68c-c89aa62897bf with Priority: HIGHEST for action security_group_members [ 1169.186045] env[69980]: INFO networking_nsxv3.common.synchronization [req-25fa8629-efba-4fd0-9949-e3c7bc2d8a97 req-edeb0c50-b6b1-4b20-b7a6-7ad5ebafd626 service nova] Enqueued Resource ID: 34175dd9-72ca-491c-b458-ce73e251edac with Priority: HIGHEST for action port [ 1169.186625] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 142d9057-bcb0-4a21-b68c-c89aa62897bf with Priority: HIGHEST for action security_group_rules [ 1169.186762] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 142d9057-bcb0-4a21-b68c-c89aa62897bf with Priority: HIGHEST for action security_group_members [ 1169.186859] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 34175dd9-72ca-491c-b458-ce73e251edac with Priority: HIGHEST for action port [ 1169.187171] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock rules-142d9057-bcb0-4a21-b68c-c89aa62897bf taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.187459] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-142d9057-bcb0-4a21-b68c-c89aa62897bf" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.187459] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-142d9057-bcb0-4a21-b68c-c89aa62897bf" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1169.187604] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-142d9057-bcb0-4a21-b68c-c89aa62897bf" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1169.187669] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('142d9057-bcb0-4a21-b68c-c89aa62897bf',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1169.188539] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-142d9057-bcb0-4a21-b68c-c89aa62897bf taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.188710] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-142d9057-bcb0-4a21-b68c-c89aa62897bf" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.188848] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-142d9057-bcb0-4a21-b68c-c89aa62897bf" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1169.188985] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-142d9057-bcb0-4a21-b68c-c89aa62897bf" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1169.189243] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.189243] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.189316] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1169.189485] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1169.189540] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1169.189627] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('142d9057-bcb0-4a21-b68c-c89aa62897bf',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1169.190380] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock port-34175dd9-72ca-491c-b458-ce73e251edac taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.190513] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-34175dd9-72ca-491c-b458-ce73e251edac" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.190553] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-34175dd9-72ca-491c-b458-ce73e251edac" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1169.190686] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-34175dd9-72ca-491c-b458-ce73e251edac" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1169.190760] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('34175dd9-72ca-491c-b458-ce73e251edac',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1169.404039] env[69980]: INFO networking_nsxv3.common.synchronization [None req-6a0d5f12-5b2c-4fbf-b466-447de706164d None None] Enqueued Resource ID: 14e5f9e2-6ff2-4535-bfff-fa25e47c9e46 with Priority: HIGHEST for action port [ 1169.404039] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 14e5f9e2-6ff2-4535-bfff-fa25e47c9e46 with Priority: HIGHEST for action port [ 1169.404039] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock port-14e5f9e2-6ff2-4535-bfff-fa25e47c9e46 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.404039] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-14e5f9e2-6ff2-4535-bfff-fa25e47c9e46" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.404039] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-14e5f9e2-6ff2-4535-bfff-fa25e47c9e46" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1169.404039] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-14e5f9e2-6ff2-4535-bfff-fa25e47c9e46" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1169.404546] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('14e5f9e2-6ff2-4535-bfff-fa25e47c9e46',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1169.435309] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1169.696023] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-142d9057-bcb0-4a21-b68c-c89aa62897bf taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.696023] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-142d9057-bcb0-4a21-b68c-c89aa62897bf" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.696023] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('142d9057-bcb0-4a21-b68c-c89aa62897bf',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1169.696023] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 34175dd9-72ca-491c-b458-ce73e251edac with status ACTIVE [ 1169.696023] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.696023] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.696023] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1169.696023] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1169.696023] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1169.696023] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.696023] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.696023] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1169.696023] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1169.696023] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1169.696907] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.696907] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.696907] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1169.696907] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1169.696907] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1169.696907] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 34175dd9-72ca-491c-b458-ce73e251edac is going to be updated. [ 1169.717516] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.717657] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.717729] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1169.717938] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1169.718227] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1169.718275] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-34175dd9-72ca-491c-b458-ce73e251edac" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1169.831285] env[69980]: INFO networking_nsxv3.common.synchronization [req-9ea5ea31-0a7e-4617-bf1e-0b83ffe671ab req-79c45f2c-1134-4aa9-9d93-827acfa5fbb8 tempest-ServerDiskConfigTestJSON-214268531 tempest-ServerDiskConfigTestJSON-214268531-project-member] Enqueued Resource ID: 0dbf2bcd-0572-43ef-b18d-cc3cca7fcfd5 with Priority: HIGHEST for action security_group_members [ 1169.831802] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0dbf2bcd-0572-43ef-b18d-cc3cca7fcfd5 with Priority: HIGHEST for action security_group_members [ 1169.832520] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-0dbf2bcd-0572-43ef-b18d-cc3cca7fcfd5 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.832644] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0dbf2bcd-0572-43ef-b18d-cc3cca7fcfd5" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.832710] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0dbf2bcd-0572-43ef-b18d-cc3cca7fcfd5" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1169.832909] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0dbf2bcd-0572-43ef-b18d-cc3cca7fcfd5" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1169.833787] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.833900] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.833965] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1169.834138] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1169.834221] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1169.834313] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0dbf2bcd-0572-43ef-b18d-cc3cca7fcfd5',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1169.906453] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 14e5f9e2-6ff2-4535-bfff-fa25e47c9e46 [ 1169.906708] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.906853] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.906924] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1169.907166] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1169.907262] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1169.907399] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:14e5f9e2-6ff2-4535-bfff-fa25e47c9e46 already deleted. [ 1169.907449] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-14e5f9e2-6ff2-4535-bfff-fa25e47c9e46" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1169.937399] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 1169.937399] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 1170.201506] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('142d9057-bcb0-4a21-b68c-c89aa62897bf',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1170.335852] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.336048] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.336094] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.336295] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.336398] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.336612] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.336708] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.336769] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.336918] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.336993] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.337089] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0dbf2bcd-0572-43ef-b18d-cc3cca7fcfd5 is going to be updated. [ 1170.347384] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock network-932 taken with stack trace [, , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.347384] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "network-932" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.348630] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "network-932" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.348630] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "network-932" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.348630] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.348630] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.348630] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.348874] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.348906] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.349315] env[69980]: DEBUG dogpile.cache.region [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] No value present for key: 'zone-id' {{(pid=69980) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1170.349315] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] NeedRegenerationException {{(pid=69980) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1170.349455] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] no value, waiting for create lock {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1170.349455] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] value creation lock acquired {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1170.349551] env[69980]: DEBUG dogpile.cache.region [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] No value present for key: 'zone-id' {{(pid=69980) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1170.349664] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Calling creation function for not-yet-present value {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1170.349802] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1170.361913] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.361913] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.361913] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.361913] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.361913] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.442240] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0dbf2bcd-0572-43ef-b18d-cc3cca7fcfd5 in Status: IN_PROGRESS for 2s [ 1170.452040] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1170.452260] env[69980]: DEBUG dogpile.cache.region [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Cache value generated in 0.102 seconds for key(s): 'zone-id' {{(pid=69980) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1170.452412] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Released creation lock {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1170.452594] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "network-932" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.452922] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock port-d2f43ede-0da8-464c-a576-3e8fbdea68be taken with stack trace [, , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.453121] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "port-d2f43ede-0da8-464c-a576-3e8fbdea68be" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.453246] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "port-d2f43ede-0da8-464c-a576-3e8fbdea68be" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.453575] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "port-d2f43ede-0da8-464c-a576-3e8fbdea68be" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.453720] env[69980]: DEBUG networking_nsxv3.api.rpc [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d2f43ede-0da8-464c-a576-3e8fbdea68be',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1170.577339] env[69980]: INFO networking_nsxv3.common.synchronization [None req-79cb38df-6320-492d-9235-be0062efdf89 tempest-AttachVolumeTestJSON-92929017 tempest-AttachVolumeTestJSON-92929017-project-member] Enqueued Resource ID: bb697495-b311-499b-98c5-fa0133350846 with Priority: HIGHEST for action security_group_rules [ 1170.577339] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bb697495-b311-499b-98c5-fa0133350846 with Priority: HIGHEST for action security_group_rules [ 1170.577974] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock rules-bb697495-b311-499b-98c5-fa0133350846 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.577974] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-bb697495-b311-499b-98c5-fa0133350846" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.577974] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-bb697495-b311-499b-98c5-fa0133350846" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.578283] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-bb697495-b311-499b-98c5-fa0133350846" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.578403] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('bb697495-b311-499b-98c5-fa0133350846',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1170.697308] env[69980]: INFO networking_nsxv3.common.synchronization [None req-03ff6385-5c2e-468d-b982-0bc5f5ebdc4e tempest-AttachVolumeTestJSON-92929017 tempest-AttachVolumeTestJSON-92929017-project-member] Enqueued Resource ID: bb697495-b311-499b-98c5-fa0133350846 with Priority: HIGHEST for action security_group_rules [ 1170.697908] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bb697495-b311-499b-98c5-fa0133350846 with Priority: HIGHEST for action security_group_rules [ 1170.698332] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock rules-bb697495-b311-499b-98c5-fa0133350846 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.698332] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-bb697495-b311-499b-98c5-fa0133350846" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.705244] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.705244] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.705244] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.705244] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.705244] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.705244] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 142d9057-bcb0-4a21-b68c-c89aa62897bf is going to be created. [ 1170.734356] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.734525] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.734601] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.734793] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.735279] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.749928] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 142d9057-bcb0-4a21-b68c-c89aa62897bf in Status: UNINITIALIZED for 2s [ 1170.781951] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.782103] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.782103] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.782365] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.794090] env[69980]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 1170.795023] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.797039] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 1170.829164] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.829164] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.829164] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.829164] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.842177] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.842847] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 1170.842953] env[69980]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=69980) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1170.843595] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 1170.883622] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.883789] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.885153] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.885153] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.885835] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.886179] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 1170.952169] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.952330] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.952398] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.952645] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.952943] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.953248] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 1170.955941] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.956171] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.956305] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.956577] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.956750] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.956974] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Segment Port d2f43ede-0da8-464c-a576-3e8fbdea68be not found, creating... [ 1170.957319] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.957373] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.957473] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.957702] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.957847] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.958599] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.958790] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.958911] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.959158] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.959286] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.959436] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Resource: SegmentPort with ID: d2f43ede-0da8-464c-a576-3e8fbdea68be is going to be created. [ 1170.979563] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.979675] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.979802] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.981914] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.981914] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.981914] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "port-d2f43ede-0da8-464c-a576-3e8fbdea68be" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.025030] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.025030] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.025030] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.025030] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.025030] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.025030] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:48. [ 1171.025030] env[69980]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:{'ac9b951b-012b-4de0-907c-958e8bf45b46', '2a4996fc-ca8e-4694-8fe3-48cd22295c48', 'c894c3c8-4482-4b2e-a8fb-72eb5f6eb886', '724b248c-fcba-4659-94d6-7aefe563ad89', 'b258b5de-7d19-4a1e-b1cf-37eaaefe0a00', '98819590-8807-4667-9ed7-ac1964aca5fa', 'bc269af3-f7ab-4692-a55c-7c766575036f', 'e2390617-a1da-45a2-94eb-d162a19e2fae', 'd0e04be7-8718-489c-8ceb-fe661da4855a', 'f9bdd708-8cea-4b45-818f-2a931611c895', 'd53aff15-d6ed-495c-9f29-fdc03bd13622', 'f44b2d06-c9ca-4621-a354-74c006769956', '690c96d5-eb4d-48e2-8d5e-d794cdf78fd1', 'c6ee756d-3ef5-4a20-82b2-95a3ddd8edd4', '182d01fc-7e61-4437-b380-e0d264b41c12', '3b94a139-70f4-4b1b-82e2-803c78f509bf', '9057c45b-1d82-49a9-8ffb-aaf0cddf5801', '0dbf2bcd-0572-43ef-b18d-cc3cca7fcfd5', '7bc12ce3-2b1a-439c-8e90-f01bd1033c9a', '100806a5-6fdb-4512-83e3-fc77cac134dd', '3909a119-b9ca-4e95-b2b4-3541d0886a49', '72f0fad5-906a-4ed9-a922-fdb13010a34d', '80e3ea48-91a5-4863-b1c2-f3e887204e39', '69e79787-6675-42a5-b381-7ffa87e43ee6', 'cdebe06d-8b9c-47c7-bf4d-f0246381eb14', '30a735ee-d68e-4b01-87b7-59775ace11cc', '4191fccf-dc75-4be2-9ec5-2d6447dbdbd8', '0b52672e-87ad-43b6-b078-903b8601b014', '7f2e833b-9263-48ef-ba09-f0afee0fa4af', 'c64c611c-a81f-411b-a88c-f87f4d86a64a', '07d8236a-b9f2-429a-9942-e7cb46920213', '00f20236-2b69-46dc-a00f-0c4d6b93c17a', 'f0f521c8-595e-4f1b-a139-3ce8948484da', 'f2b778ac-011d-472f-9220-d8d50a881380', '162065c3-9db0-41c8-9437-c51716e30968', 'b472d7ce-a3a7-4859-8fa3-f222ee058e66', '2961e549-f7d2-46b0-a1f4-9365d96bb58a', '48dd2a84-68ac-43c8-a7e2-4cb28bb82546', '825b0052-8bd1-4107-8258-075804cbc484', '6719a83d-3363-4339-a277-6e1ec27ec7bc', '4eb0fe0d-cd04-4189-9b26-953ab87885bd', '400b642e-7f7e-4993-9916-a3e96af018da', '462431af-62e3-426c-a50e-a61604f20358', '700dc02a-f3c2-4363-9a0e-d7cdcb13a5b8', '194841ae-0965-407f-a2bf-6d1f7693c801', '241bcad9-5919-4c26-b0b9-beb6a98733bd', 'd696a1d3-1fa9-4790-b673-19d262f97699', 'e63cb46c-ccab-4856-bf25-2380514e2780'} {{(pid=69980) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1171.025030] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 1171.047937] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.047937] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.047937] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.047937] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.047937] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.047937] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 1171.047937] env[69980]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=69980) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1171.047937] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 1171.100074] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.100909] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.100909] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.103406] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.103406] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.103406] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bb697495-b311-499b-98c5-fa0133350846 already deleted. [ 1171.103406] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-bb697495-b311-499b-98c5-fa0133350846" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.103406] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-bb697495-b311-499b-98c5-fa0133350846" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.103406] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-bb697495-b311-499b-98c5-fa0133350846" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.103406] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('bb697495-b311-499b-98c5-fa0133350846',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1171.176934] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.177401] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.177401] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.177644] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.181626] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.181626] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 1171.181626] env[69980]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=69980) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1171.181626] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 1171.181626] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 1171.181626] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 20/48 resources of Type:Security Group Rules [ 1171.181626] env[69980]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: ac9b951b-012b-4de0-907c-958e8bf45b46 with Priority: HIGH for action security_group_rules [ 1171.181626] env[69980]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 2a4996fc-ca8e-4694-8fe3-48cd22295c48 with Priority: HIGH for action security_group_rules [ 1171.181626] env[69980]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: c894c3c8-4482-4b2e-a8fb-72eb5f6eb886 with Priority: HIGH for action security_group_rules [ 1171.181626] env[69980]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 724b248c-fcba-4659-94d6-7aefe563ad89 with Priority: HIGH for action security_group_rules [ 1171.181626] env[69980]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: b258b5de-7d19-4a1e-b1cf-37eaaefe0a00 with Priority: HIGH for action security_group_rules [ 1171.181626] env[69980]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 98819590-8807-4667-9ed7-ac1964aca5fa with Priority: HIGH for action security_group_rules [ 1171.181626] env[69980]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: bc269af3-f7ab-4692-a55c-7c766575036f with Priority: HIGH for action security_group_rules [ 1171.181626] env[69980]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: e2390617-a1da-45a2-94eb-d162a19e2fae with Priority: HIGH for action security_group_rules [ 1171.181626] env[69980]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: d0e04be7-8718-489c-8ceb-fe661da4855a with Priority: HIGH for action security_group_rules [ 1171.181626] env[69980]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: f9bdd708-8cea-4b45-818f-2a931611c895 with Priority: HIGH for action security_group_rules [ 1171.181626] env[69980]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: d53aff15-d6ed-495c-9f29-fdc03bd13622 with Priority: HIGH for action security_group_rules [ 1171.181626] env[69980]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: f44b2d06-c9ca-4621-a354-74c006769956 with Priority: HIGH for action security_group_rules [ 1171.181626] env[69980]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 690c96d5-eb4d-48e2-8d5e-d794cdf78fd1 with Priority: HIGH for action security_group_rules [ 1171.181626] env[69980]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: c6ee756d-3ef5-4a20-82b2-95a3ddd8edd4 with Priority: HIGH for action security_group_rules [ 1171.181626] env[69980]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 182d01fc-7e61-4437-b380-e0d264b41c12 with Priority: HIGH for action security_group_rules [ 1171.181626] env[69980]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 3b94a139-70f4-4b1b-82e2-803c78f509bf with Priority: HIGH for action security_group_rules [ 1171.181626] env[69980]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 9057c45b-1d82-49a9-8ffb-aaf0cddf5801 with Priority: HIGH for action security_group_rules [ 1171.181626] env[69980]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 0dbf2bcd-0572-43ef-b18d-cc3cca7fcfd5 with Priority: HIGH for action security_group_rules [ 1171.181626] env[69980]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 7bc12ce3-2b1a-439c-8e90-f01bd1033c9a with Priority: HIGH for action security_group_rules [ 1171.181626] env[69980]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 100806a5-6fdb-4512-83e3-fc77cac134dd with Priority: HIGH for action security_group_rules [ 1171.181626] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.424512] env[69980]: INFO networking_nsxv3.common.synchronization [None req-3d93072e-06da-44a1-b2df-6fcea6f7b0f1 None None] Enqueued Resource ID: 8baf7fcd-d9ab-47c2-acac-7b1355de1dca with Priority: HIGHEST for action port [ 1171.425174] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8baf7fcd-d9ab-47c2-acac-7b1355de1dca with Priority: HIGHEST for action port [ 1171.425174] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ac9b951b-012b-4de0-907c-958e8bf45b46 with Priority: HIGH for action security_group_rules [ 1171.425174] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c894c3c8-4482-4b2e-a8fb-72eb5f6eb886 with Priority: HIGH for action security_group_rules [ 1171.425174] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bc269af3-f7ab-4692-a55c-7c766575036f with Priority: HIGH for action security_group_rules [ 1171.425377] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 182d01fc-7e61-4437-b380-e0d264b41c12 with Priority: HIGH for action security_group_rules [ 1171.425377] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 100806a5-6fdb-4512-83e3-fc77cac134dd with Priority: HIGH for action security_group_rules [ 1171.425464] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7bc12ce3-2b1a-439c-8e90-f01bd1033c9a with Priority: HIGH for action security_group_rules [ 1171.425538] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0dbf2bcd-0572-43ef-b18d-cc3cca7fcfd5 with Priority: HIGH for action security_group_rules [ 1171.425579] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9057c45b-1d82-49a9-8ffb-aaf0cddf5801 with Priority: HIGH for action security_group_rules [ 1171.425667] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c6ee756d-3ef5-4a20-82b2-95a3ddd8edd4 with Priority: HIGH for action security_group_rules [ 1171.425849] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3b94a139-70f4-4b1b-82e2-803c78f509bf with Priority: HIGH for action security_group_rules [ 1171.425961] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 690c96d5-eb4d-48e2-8d5e-d794cdf78fd1 with Priority: HIGH for action security_group_rules [ 1171.426064] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f44b2d06-c9ca-4621-a354-74c006769956 with Priority: HIGH for action security_group_rules [ 1171.426155] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d53aff15-d6ed-495c-9f29-fdc03bd13622 with Priority: HIGH for action security_group_rules [ 1171.426245] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f9bdd708-8cea-4b45-818f-2a931611c895 with Priority: HIGH for action security_group_rules [ 1171.426334] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d0e04be7-8718-489c-8ceb-fe661da4855a with Priority: HIGH for action security_group_rules [ 1171.426421] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 98819590-8807-4667-9ed7-ac1964aca5fa with Priority: HIGH for action security_group_rules [ 1171.426533] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e2390617-a1da-45a2-94eb-d162a19e2fae with Priority: HIGH for action security_group_rules [ 1171.426625] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b258b5de-7d19-4a1e-b1cf-37eaaefe0a00 with Priority: HIGH for action security_group_rules [ 1171.426766] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2a4996fc-ca8e-4694-8fe3-48cd22295c48 with Priority: HIGH for action security_group_rules [ 1171.426828] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 724b248c-fcba-4659-94d6-7aefe563ad89 with Priority: HIGH for action security_group_rules [ 1171.427380] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock port-8baf7fcd-d9ab-47c2-acac-7b1355de1dca taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.427541] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8baf7fcd-d9ab-47c2-acac-7b1355de1dca" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.427661] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8baf7fcd-d9ab-47c2-acac-7b1355de1dca" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.427948] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8baf7fcd-d9ab-47c2-acac-7b1355de1dca" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.428048] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8baf7fcd-d9ab-47c2-acac-7b1355de1dca',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1171.428920] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ac9b951b-012b-4de0-907c-958e8bf45b46 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.429051] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ac9b951b-012b-4de0-907c-958e8bf45b46" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.429286] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ac9b951b-012b-4de0-907c-958e8bf45b46" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.429286] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ac9b951b-012b-4de0-907c-958e8bf45b46" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.429392] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ac9b951b-012b-4de0-907c-958e8bf45b46',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1171.430635] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c894c3c8-4482-4b2e-a8fb-72eb5f6eb886 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.430635] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c894c3c8-4482-4b2e-a8fb-72eb5f6eb886" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.430635] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c894c3c8-4482-4b2e-a8fb-72eb5f6eb886" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.430635] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c894c3c8-4482-4b2e-a8fb-72eb5f6eb886" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.430635] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c894c3c8-4482-4b2e-a8fb-72eb5f6eb886',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1171.431327] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock rules-bc269af3-f7ab-4692-a55c-7c766575036f taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.431432] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-bc269af3-f7ab-4692-a55c-7c766575036f" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.431691] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-bc269af3-f7ab-4692-a55c-7c766575036f" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.431691] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-bc269af3-f7ab-4692-a55c-7c766575036f" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.431798] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('bc269af3-f7ab-4692-a55c-7c766575036f',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1171.432532] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock rules-182d01fc-7e61-4437-b380-e0d264b41c12 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.432667] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-182d01fc-7e61-4437-b380-e0d264b41c12" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.432723] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-182d01fc-7e61-4437-b380-e0d264b41c12" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.432938] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-182d01fc-7e61-4437-b380-e0d264b41c12" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.432996] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('182d01fc-7e61-4437-b380-e0d264b41c12',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1171.433749] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock rules-100806a5-6fdb-4512-83e3-fc77cac134dd taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.433880] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-100806a5-6fdb-4512-83e3-fc77cac134dd" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.433939] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-100806a5-6fdb-4512-83e3-fc77cac134dd" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.434110] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-100806a5-6fdb-4512-83e3-fc77cac134dd" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.434174] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('100806a5-6fdb-4512-83e3-fc77cac134dd',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1171.434899] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7bc12ce3-2b1a-439c-8e90-f01bd1033c9a taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.435034] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7bc12ce3-2b1a-439c-8e90-f01bd1033c9a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.435115] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7bc12ce3-2b1a-439c-8e90-f01bd1033c9a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.435256] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7bc12ce3-2b1a-439c-8e90-f01bd1033c9a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.435296] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7bc12ce3-2b1a-439c-8e90-f01bd1033c9a',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1171.436405] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0dbf2bcd-0572-43ef-b18d-cc3cca7fcfd5 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.436548] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0dbf2bcd-0572-43ef-b18d-cc3cca7fcfd5" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.437157] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0dbf2bcd-0572-43ef-b18d-cc3cca7fcfd5" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.437157] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0dbf2bcd-0572-43ef-b18d-cc3cca7fcfd5" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.437157] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0dbf2bcd-0572-43ef-b18d-cc3cca7fcfd5',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1171.438291] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9057c45b-1d82-49a9-8ffb-aaf0cddf5801 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.438291] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9057c45b-1d82-49a9-8ffb-aaf0cddf5801" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.438291] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9057c45b-1d82-49a9-8ffb-aaf0cddf5801" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.438291] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9057c45b-1d82-49a9-8ffb-aaf0cddf5801" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.438291] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9057c45b-1d82-49a9-8ffb-aaf0cddf5801',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1171.440043] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c6ee756d-3ef5-4a20-82b2-95a3ddd8edd4 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.440043] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c6ee756d-3ef5-4a20-82b2-95a3ddd8edd4" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.440043] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c6ee756d-3ef5-4a20-82b2-95a3ddd8edd4" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.440043] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c6ee756d-3ef5-4a20-82b2-95a3ddd8edd4" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.440043] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c6ee756d-3ef5-4a20-82b2-95a3ddd8edd4',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1171.440043] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3b94a139-70f4-4b1b-82e2-803c78f509bf taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.440043] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3b94a139-70f4-4b1b-82e2-803c78f509bf" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.440043] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3b94a139-70f4-4b1b-82e2-803c78f509bf" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.440352] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3b94a139-70f4-4b1b-82e2-803c78f509bf" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.440352] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3b94a139-70f4-4b1b-82e2-803c78f509bf',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1171.440852] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock rules-690c96d5-eb4d-48e2-8d5e-d794cdf78fd1 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.440949] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-690c96d5-eb4d-48e2-8d5e-d794cdf78fd1" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.441020] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-690c96d5-eb4d-48e2-8d5e-d794cdf78fd1" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.441162] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-690c96d5-eb4d-48e2-8d5e-d794cdf78fd1" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.441228] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('690c96d5-eb4d-48e2-8d5e-d794cdf78fd1',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1171.441952] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f44b2d06-c9ca-4621-a354-74c006769956 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.442105] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f44b2d06-c9ca-4621-a354-74c006769956" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.442199] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f44b2d06-c9ca-4621-a354-74c006769956" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.442279] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f44b2d06-c9ca-4621-a354-74c006769956" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.442535] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f44b2d06-c9ca-4621-a354-74c006769956',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1171.443279] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d53aff15-d6ed-495c-9f29-fdc03bd13622 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.443279] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d53aff15-d6ed-495c-9f29-fdc03bd13622" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.443279] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d53aff15-d6ed-495c-9f29-fdc03bd13622" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.443486] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d53aff15-d6ed-495c-9f29-fdc03bd13622" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.443486] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d53aff15-d6ed-495c-9f29-fdc03bd13622',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1171.444121] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f9bdd708-8cea-4b45-818f-2a931611c895 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.444257] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f9bdd708-8cea-4b45-818f-2a931611c895" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.444336] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f9bdd708-8cea-4b45-818f-2a931611c895" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.444586] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f9bdd708-8cea-4b45-818f-2a931611c895" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.444586] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f9bdd708-8cea-4b45-818f-2a931611c895',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1171.445205] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d0e04be7-8718-489c-8ceb-fe661da4855a taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.445331] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d0e04be7-8718-489c-8ceb-fe661da4855a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.445378] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d0e04be7-8718-489c-8ceb-fe661da4855a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.445544] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d0e04be7-8718-489c-8ceb-fe661da4855a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.445610] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d0e04be7-8718-489c-8ceb-fe661da4855a',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1171.446346] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock rules-98819590-8807-4667-9ed7-ac1964aca5fa taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.446468] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-98819590-8807-4667-9ed7-ac1964aca5fa" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.446543] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-98819590-8807-4667-9ed7-ac1964aca5fa" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.446694] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-98819590-8807-4667-9ed7-ac1964aca5fa" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.446770] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('98819590-8807-4667-9ed7-ac1964aca5fa',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1171.447525] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e2390617-a1da-45a2-94eb-d162a19e2fae taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.447655] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e2390617-a1da-45a2-94eb-d162a19e2fae" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.447724] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e2390617-a1da-45a2-94eb-d162a19e2fae" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.447873] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e2390617-a1da-45a2-94eb-d162a19e2fae" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.447946] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e2390617-a1da-45a2-94eb-d162a19e2fae',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1171.448654] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b258b5de-7d19-4a1e-b1cf-37eaaefe0a00 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.448766] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b258b5de-7d19-4a1e-b1cf-37eaaefe0a00" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.449471] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b258b5de-7d19-4a1e-b1cf-37eaaefe0a00" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.449660] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b258b5de-7d19-4a1e-b1cf-37eaaefe0a00" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.450031] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b258b5de-7d19-4a1e-b1cf-37eaaefe0a00',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1171.450570] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2a4996fc-ca8e-4694-8fe3-48cd22295c48 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.450676] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2a4996fc-ca8e-4694-8fe3-48cd22295c48" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.450740] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2a4996fc-ca8e-4694-8fe3-48cd22295c48" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.450888] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2a4996fc-ca8e-4694-8fe3-48cd22295c48" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.450961] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2a4996fc-ca8e-4694-8fe3-48cd22295c48',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1171.451614] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock rules-724b248c-fcba-4659-94d6-7aefe563ad89 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.451836] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-724b248c-fcba-4659-94d6-7aefe563ad89" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.451836] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-724b248c-fcba-4659-94d6-7aefe563ad89" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.451932] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-724b248c-fcba-4659-94d6-7aefe563ad89" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.451986] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('724b248c-fcba-4659-94d6-7aefe563ad89',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1171.611058] env[69980]: INFO networking_nsxv3.common.synchronization [req-9ea5ea31-0a7e-4617-bf1e-0b83ffe671ab req-ea52df97-d8de-43a5-a804-baea8de34d7e service nova] Enqueued Resource ID: 0dbf2bcd-0572-43ef-b18d-cc3cca7fcfd5 with Priority: HIGHEST for action security_group_rules [ 1171.611244] env[69980]: INFO networking_nsxv3.common.synchronization [req-9ea5ea31-0a7e-4617-bf1e-0b83ffe671ab req-ea52df97-d8de-43a5-a804-baea8de34d7e service nova] Enqueued Resource ID: 0dbf2bcd-0572-43ef-b18d-cc3cca7fcfd5 with Priority: HIGHEST for action security_group_members [ 1171.611381] env[69980]: INFO networking_nsxv3.common.synchronization [req-9ea5ea31-0a7e-4617-bf1e-0b83ffe671ab req-ea52df97-d8de-43a5-a804-baea8de34d7e service nova] Enqueued Resource ID: d2f43ede-0da8-464c-a576-3e8fbdea68be with Priority: HIGHEST for action port [ 1171.611607] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0dbf2bcd-0572-43ef-b18d-cc3cca7fcfd5 with Priority: HIGHEST for action security_group_rules [ 1171.611726] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0dbf2bcd-0572-43ef-b18d-cc3cca7fcfd5 with Priority: HIGHEST for action security_group_members [ 1171.612636] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d2f43ede-0da8-464c-a576-3e8fbdea68be with Priority: HIGHEST for action port [ 1171.618825] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0dbf2bcd-0572-43ef-b18d-cc3cca7fcfd5 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.618825] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0dbf2bcd-0572-43ef-b18d-cc3cca7fcfd5" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.618825] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-0dbf2bcd-0572-43ef-b18d-cc3cca7fcfd5 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.618825] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0dbf2bcd-0572-43ef-b18d-cc3cca7fcfd5" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.618825] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock port-d2f43ede-0da8-464c-a576-3e8fbdea68be taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.618825] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d2f43ede-0da8-464c-a576-3e8fbdea68be" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.618825] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d2f43ede-0da8-464c-a576-3e8fbdea68be" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.618825] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d2f43ede-0da8-464c-a576-3e8fbdea68be" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.618825] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d2f43ede-0da8-464c-a576-3e8fbdea68be',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1171.625563] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.625563] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.625563] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.625563] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.625563] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.625563] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bb697495-b311-499b-98c5-fa0133350846 already deleted. [ 1171.625563] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-bb697495-b311-499b-98c5-fa0133350846" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.959371] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 8baf7fcd-d9ab-47c2-acac-7b1355de1dca [ 1171.960034] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.960034] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.960034] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.960034] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.960249] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.960249] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:8baf7fcd-d9ab-47c2-acac-7b1355de1dca already deleted. [ 1171.960455] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8baf7fcd-d9ab-47c2-acac-7b1355de1dca" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.968407] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-0dbf2bcd-0572-43ef-b18d-cc3cca7fcfd5 taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.968665] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0dbf2bcd-0572-43ef-b18d-cc3cca7fcfd5" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.973470] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-9057c45b-1d82-49a9-8ffb-aaf0cddf5801 taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.973602] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9057c45b-1d82-49a9-8ffb-aaf0cddf5801" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.973672] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9057c45b-1d82-49a9-8ffb-aaf0cddf5801" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.974269] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9057c45b-1d82-49a9-8ffb-aaf0cddf5801" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.974269] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.974269] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.974269] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.974563] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.974563] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.974563] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9057c45b-1d82-49a9-8ffb-aaf0cddf5801" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.974649] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9057c45b-1d82-49a9-8ffb-aaf0cddf5801',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1171.994519] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.994683] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.994683] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.994907] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.996388] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.996526] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.018775] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.019064] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.026435] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.026594] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.027442] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.027547] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.028282] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.028377] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.029065] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.029161] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.029875] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.029973] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.039940] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.040064] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.040731] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.040825] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.041518] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.041615] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.043870] env[69980]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1172.044379] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.044509] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.045218] env[69980]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1172.045664] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.045780] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.046495] env[69980]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1172.046889] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.046995] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.047679] env[69980]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1172.048074] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.048182] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.048830] env[69980]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1172.049233] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.049318] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.049928] env[69980]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1172.050337] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.050431] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.051346] env[69980]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1172.051821] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.051923] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e2390617-a1da-45a2-94eb-d162a19e2fae is going to be deleted. [ 1172.053388] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.053519] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.053579] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.053738] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.067385] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.067508] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f44b2d06-c9ca-4621-a354-74c006769956 is going to be deleted. [ 1172.068267] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.068460] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.084142] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.084621] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b258b5de-7d19-4a1e-b1cf-37eaaefe0a00 is going to be deleted. [ 1172.085411] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.085613] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.100068] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.100205] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7bc12ce3-2b1a-439c-8e90-f01bd1033c9a is going to be deleted. [ 1172.101032] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.101239] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.116920] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.117083] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.119467] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d2f43ede-0da8-464c-a576-3e8fbdea68be with status ACTIVE [ 1172.119688] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.119812] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.119911] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.120181] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.120313] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.120569] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.120682] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.120787] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.120918] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.120997] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.121192] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.121284] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.121347] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.121483] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.121559] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.122184] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d2f43ede-0da8-464c-a576-3e8fbdea68be is going to be updated. [ 1172.123342] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.123456] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.128967] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.129125] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bc269af3-f7ab-4692-a55c-7c766575036f is going to be deleted. [ 1172.130050] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.130271] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.131878] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.132037] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.146152] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.146336] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.146403] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.146673] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.146809] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.146975] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d2f43ede-0da8-464c-a576-3e8fbdea68be" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.148032] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.148032] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f9bdd708-8cea-4b45-818f-2a931611c895 is going to be deleted. [ 1172.148862] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.149084] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.163034] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.163192] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.178757] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.179095] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ac9b951b-012b-4de0-907c-958e8bf45b46 is going to be deleted. [ 1172.179955] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.180196] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.243898] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.244057] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c6ee756d-3ef5-4a20-82b2-95a3ddd8edd4 is going to be deleted. [ 1172.246076] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.246076] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.257169] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.257310] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.283084] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.283272] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.339687] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.339893] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3b94a139-70f4-4b1b-82e2-803c78f509bf is going to be deleted. [ 1172.341043] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.341315] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.378495] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.378737] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.382851] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.383010] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d0e04be7-8718-489c-8ceb-fe661da4855a is going to be deleted. [ 1172.383954] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.384194] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.448374] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.448727] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c894c3c8-4482-4b2e-a8fb-72eb5f6eb886 is going to be deleted. [ 1172.449454] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.449674] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.463200] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0dbf2bcd-0572-43ef-b18d-cc3cca7fcfd5 in Status: SUCCESS [ 1172.463378] env[69980]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0dbf2bcd-0572-43ef-b18d-cc3cca7fcfd5 deletion is rescheduled due to dependency. [ 1172.463486] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0dbf2bcd-0572-43ef-b18d-cc3cca7fcfd5" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.463615] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0dbf2bcd-0572-43ef-b18d-cc3cca7fcfd5" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.463820] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0dbf2bcd-0572-43ef-b18d-cc3cca7fcfd5" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.464017] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.464138] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.464213] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.464378] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.464483] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.464561] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0dbf2bcd-0572-43ef-b18d-cc3cca7fcfd5',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1172.465885] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.465994] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.474931] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.475053] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2a4996fc-ca8e-4694-8fe3-48cd22295c48 is going to be deleted. [ 1172.476136] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.476345] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.489654] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9057c45b-1d82-49a9-8ffb-aaf0cddf5801',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1172.511138] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.511297] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d53aff15-d6ed-495c-9f29-fdc03bd13622 is going to be deleted. [ 1172.512397] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.512601] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.514370] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.514529] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.550439] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.550592] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.575929] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.576120] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.581289] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.581439] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.582197] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.582309] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 724b248c-fcba-4659-94d6-7aefe563ad89 is going to be deleted. [ 1172.583174] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.583387] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.631765] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.631908] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 100806a5-6fdb-4512-83e3-fc77cac134dd is going to be deleted. [ 1172.632823] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.633049] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.693912] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.693912] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.705345] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.705345] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 98819590-8807-4667-9ed7-ac1964aca5fa is going to be deleted. [ 1172.705345] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.705345] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.740496] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.741315] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.772344] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.772509] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 182d01fc-7e61-4437-b380-e0d264b41c12 is going to be deleted. [ 1172.773691] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.774606] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.779950] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 142d9057-bcb0-4a21-b68c-c89aa62897bf in Status: SUCCESS [ 1172.780159] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-142d9057-bcb0-4a21-b68c-c89aa62897bf" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.780307] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-142d9057-bcb0-4a21-b68c-c89aa62897bf" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.780780] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-142d9057-bcb0-4a21-b68c-c89aa62897bf" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.780780] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.780893] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.780893] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.781014] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.781102] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.781186] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-142d9057-bcb0-4a21-b68c-c89aa62897bf" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.781539] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('142d9057-bcb0-4a21-b68c-c89aa62897bf',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1172.866859] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.869019] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 690c96d5-eb4d-48e2-8d5e-d794cdf78fd1 is going to be deleted. [ 1172.869019] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.869019] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.869019] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.869019] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e2390617-a1da-45a2-94eb-d162a19e2fae" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.869019] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.869019] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.869019] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.869019] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f44b2d06-c9ca-4621-a354-74c006769956" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.869845] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.870114] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.870368] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.870593] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b258b5de-7d19-4a1e-b1cf-37eaaefe0a00" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.870810] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.871054] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.871220] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.871417] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7bc12ce3-2b1a-439c-8e90-f01bd1033c9a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.871632] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.871874] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.872046] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.872241] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-bc269af3-f7ab-4692-a55c-7c766575036f" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.872462] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.872685] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.873019] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.873019] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f9bdd708-8cea-4b45-818f-2a931611c895" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.873224] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.874029] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.874029] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.874029] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ac9b951b-012b-4de0-907c-958e8bf45b46" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.874029] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.874029] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.874029] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.874323] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c6ee756d-3ef5-4a20-82b2-95a3ddd8edd4" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.874529] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.874758] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.874920] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.875132] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3b94a139-70f4-4b1b-82e2-803c78f509bf" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.877599] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.877599] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.877599] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.877599] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d0e04be7-8718-489c-8ceb-fe661da4855a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.877599] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.877599] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.877599] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.877599] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c894c3c8-4482-4b2e-a8fb-72eb5f6eb886" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.877599] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.877599] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.877599] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.877599] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2a4996fc-ca8e-4694-8fe3-48cd22295c48" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.877599] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.877599] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.877599] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.877599] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d53aff15-d6ed-495c-9f29-fdc03bd13622" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.877599] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.877599] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.877599] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.877599] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-724b248c-fcba-4659-94d6-7aefe563ad89" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.882333] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.882333] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.882333] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.882333] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.882333] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.882333] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-100806a5-6fdb-4512-83e3-fc77cac134dd" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.968206] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.968206] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.968206] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.968206] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.968206] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.968206] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-182d01fc-7e61-4437-b380-e0d264b41c12" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.968206] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0dbf2bcd-0572-43ef-b18d-cc3cca7fcfd5',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1172.979888] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.980225] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.980390] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.980694] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.981073] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.981308] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-98819590-8807-4667-9ed7-ac1964aca5fa" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.991585] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9057c45b-1d82-49a9-8ffb-aaf0cddf5801: rpc.has_security_group_logging(os_id): False [ 1173.016408] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.016801] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.016970] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.017272] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.066423] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.066423] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.123309] env[69980]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1173.123309] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.123309] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.123309] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.123309] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.123309] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.123309] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.123309] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9057c45b-1d82-49a9-8ffb-aaf0cddf5801 is going to be updated. [ 1173.124791] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.125113] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.125294] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.125493] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-690c96d5-eb4d-48e2-8d5e-d794cdf78fd1" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.217817] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.217817] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.217817] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.217817] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.217817] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.234625] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9057c45b-1d82-49a9-8ffb-aaf0cddf5801 in Status: IN_PROGRESS for 2s [ 1173.283905] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('142d9057-bcb0-4a21-b68c-c89aa62897bf',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1173.438153] env[69980]: INFO networking_nsxv3.common.synchronization [None req-a267a59e-8464-409d-aca0-9f4fc00e600e tempest-ServerActionsTestJSON-1479580870 tempest-ServerActionsTestJSON-1479580870-project-member] Enqueued Resource ID: 1c48b9d6-06bd-4429-a87d-c56109170df7 with Priority: HIGHEST for action security_group_rules [ 1173.438762] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1c48b9d6-06bd-4429-a87d-c56109170df7 with Priority: HIGHEST for action security_group_rules [ 1173.439783] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1c48b9d6-06bd-4429-a87d-c56109170df7 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.439979] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1c48b9d6-06bd-4429-a87d-c56109170df7" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.440133] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1c48b9d6-06bd-4429-a87d-c56109170df7" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.440471] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1c48b9d6-06bd-4429-a87d-c56109170df7" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.440629] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1c48b9d6-06bd-4429-a87d-c56109170df7',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1173.473539] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0dbf2bcd-0572-43ef-b18d-cc3cca7fcfd5',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1173.523235] env[69980]: INFO networking_nsxv3.common.synchronization [None req-90adbfc7-5d95-478c-9c6a-2a07a39422ea tempest-ServerActionsTestJSON-1479580870 tempest-ServerActionsTestJSON-1479580870-project-member] Enqueued Resource ID: 1c48b9d6-06bd-4429-a87d-c56109170df7 with Priority: HIGHEST for action security_group_rules [ 1173.524358] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1c48b9d6-06bd-4429-a87d-c56109170df7 with Priority: HIGHEST for action security_group_rules [ 1173.524976] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1c48b9d6-06bd-4429-a87d-c56109170df7 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.525121] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1c48b9d6-06bd-4429-a87d-c56109170df7" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.787065] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 142d9057-bcb0-4a21-b68c-c89aa62897bf: rpc.has_security_group_logging(os_id): False [ 1173.808650] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.808650] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.808650] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.808947] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.809011] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.809661] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.809661] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.809661] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.809925] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.809955] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.810114] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 142d9057-bcb0-4a21-b68c-c89aa62897bf is going to be created. [ 1173.885630] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.885807] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.885901] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.886172] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.886373] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.897900] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 142d9057-bcb0-4a21-b68c-c89aa62897bf in Status: IN_PROGRESS for 2s [ 1173.976606] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.976781] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.976858] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.977091] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.977186] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.977287] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0dbf2bcd-0572-43ef-b18d-cc3cca7fcfd5 is going to be updated. [ 1173.996584] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.996739] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.996806] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.997017] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.997114] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.997206] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1c48b9d6-06bd-4429-a87d-c56109170df7 already deleted. [ 1173.997289] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1c48b9d6-06bd-4429-a87d-c56109170df7" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.997433] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1c48b9d6-06bd-4429-a87d-c56109170df7" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.997634] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1c48b9d6-06bd-4429-a87d-c56109170df7" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.997709] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1c48b9d6-06bd-4429-a87d-c56109170df7',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1174.031814] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1174.031941] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1174.032056] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1174.032252] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1174.032408] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1174.041680] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0dbf2bcd-0572-43ef-b18d-cc3cca7fcfd5 in Status: IN_PROGRESS for 2s [ 1174.522561] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1174.523030] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1174.523030] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1174.523149] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1174.523219] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1174.523324] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1c48b9d6-06bd-4429-a87d-c56109170df7 already deleted. [ 1174.523409] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1c48b9d6-06bd-4429-a87d-c56109170df7" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.250249] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9057c45b-1d82-49a9-8ffb-aaf0cddf5801 in Status: SUCCESS [ 1175.250512] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9057c45b-1d82-49a9-8ffb-aaf0cddf5801" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.909562] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 142d9057-bcb0-4a21-b68c-c89aa62897bf in Status: SUCCESS [ 1175.909923] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-142d9057-bcb0-4a21-b68c-c89aa62897bf" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.990296] env[69980]: INFO networking_nsxv3.common.synchronization [req-74eae7e7-c466-4b8f-a475-0f0aa45cdded req-68905244-4662-487b-9809-a014fa972eda tempest-DeleteServersTestJSON-1084822395 tempest-DeleteServersTestJSON-1084822395-project-member] Enqueued Resource ID: d0e04be7-8718-489c-8ceb-fe661da4855a with Priority: HIGHEST for action security_group_members [ 1175.990885] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d0e04be7-8718-489c-8ceb-fe661da4855a with Priority: HIGHEST for action security_group_members [ 1175.991205] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-d0e04be7-8718-489c-8ceb-fe661da4855a taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.991323] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d0e04be7-8718-489c-8ceb-fe661da4855a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.991388] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d0e04be7-8718-489c-8ceb-fe661da4855a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.991590] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d0e04be7-8718-489c-8ceb-fe661da4855a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.991742] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.991839] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.991899] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.992175] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.992279] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.992370] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d0e04be7-8718-489c-8ceb-fe661da4855a',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1176.064283] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0dbf2bcd-0572-43ef-b18d-cc3cca7fcfd5 in Status: SUCCESS [ 1176.064548] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0dbf2bcd-0572-43ef-b18d-cc3cca7fcfd5" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.064726] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0dbf2bcd-0572-43ef-b18d-cc3cca7fcfd5" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.064955] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0dbf2bcd-0572-43ef-b18d-cc3cca7fcfd5" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.065167] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.065286] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.065351] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.065514] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.065598] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.065685] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0dbf2bcd-0572-43ef-b18d-cc3cca7fcfd5" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.065776] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('0dbf2bcd-0572-43ef-b18d-cc3cca7fcfd5',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1176.308907] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock network-478 taken with stack trace [, , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.309197] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "network-478" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.309775] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "network-478" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.309867] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "network-478" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.310436] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.310731] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.310858] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.311186] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.311404] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.311864] env[69980]: DEBUG dogpile.cache.region [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] No value present for key: 'zone-id' {{(pid=69980) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1176.311954] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] NeedRegenerationException {{(pid=69980) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1176.312081] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] no value, waiting for create lock {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1176.312254] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] value creation lock acquired {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1176.312415] env[69980]: DEBUG dogpile.cache.region [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] No value present for key: 'zone-id' {{(pid=69980) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1176.312816] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Calling creation function for not-yet-present value {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1176.313073] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1176.333129] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1176.333129] env[69980]: DEBUG dogpile.cache.region [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=69980) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1176.333260] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Released creation lock {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1176.333480] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "network-478" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.333865] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock port-44499cf8-f9c6-4b3c-afd5-0907ffdad7ea taken with stack trace [, , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.337028] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "port-44499cf8-f9c6-4b3c-afd5-0907ffdad7ea" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.337028] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "port-44499cf8-f9c6-4b3c-afd5-0907ffdad7ea" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.337028] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "port-44499cf8-f9c6-4b3c-afd5-0907ffdad7ea" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.337028] env[69980]: DEBUG networking_nsxv3.api.rpc [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('44499cf8-f9c6-4b3c-afd5-0907ffdad7ea',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1176.496190] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.496328] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.496405] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.496672] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.496785] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.497022] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.497126] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.497191] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.497344] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.497427] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.497518] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d0e04be7-8718-489c-8ceb-fe661da4855a is going to be deleted. [ 1176.524724] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.524907] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.524907] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.525119] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.525212] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.525310] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d0e04be7-8718-489c-8ceb-fe661da4855a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.568159] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-0dbf2bcd-0572-43ef-b18d-cc3cca7fcfd5 taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.568399] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0dbf2bcd-0572-43ef-b18d-cc3cca7fcfd5" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.568520] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0dbf2bcd-0572-43ef-b18d-cc3cca7fcfd5" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.568760] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0dbf2bcd-0572-43ef-b18d-cc3cca7fcfd5" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.568964] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.569089] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.569153] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.569330] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.569418] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.569521] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0dbf2bcd-0572-43ef-b18d-cc3cca7fcfd5" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.569688] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-0dbf2bcd-0572-43ef-b18d-cc3cca7fcfd5 taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.569773] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0dbf2bcd-0572-43ef-b18d-cc3cca7fcfd5" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.569830] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0dbf2bcd-0572-43ef-b18d-cc3cca7fcfd5" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.569981] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0dbf2bcd-0572-43ef-b18d-cc3cca7fcfd5" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.570158] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.570231] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.570276] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.570428] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.570534] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.570589] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0dbf2bcd-0572-43ef-b18d-cc3cca7fcfd5" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.570689] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('0dbf2bcd-0572-43ef-b18d-cc3cca7fcfd5',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1176.838845] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.839128] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.839267] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.839537] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.839713] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.839873] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Segment Port 44499cf8-f9c6-4b3c-afd5-0907ffdad7ea not found, creating... [ 1176.840163] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.840342] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.840466] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.840793] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.840866] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.841121] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.841283] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.841402] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.841613] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.841846] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.841932] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Resource: SegmentPort with ID: 44499cf8-f9c6-4b3c-afd5-0907ffdad7ea is going to be created. [ 1176.864089] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.864298] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.864454] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.864769] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.865015] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.865860] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "port-44499cf8-f9c6-4b3c-afd5-0907ffdad7ea" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.972459] env[69980]: INFO networking_nsxv3.common.synchronization [req-c59ab362-ba78-4c29-a2fe-1dc2b6fbacad req-0fc57696-5d3d-470e-89f2-6cf49f16d53a tempest-AttachInterfacesTestJSON-1782090316 tempest-AttachInterfacesTestJSON-1782090316-project-member] Enqueued Resource ID: e63cb46c-ccab-4856-bf25-2380514e2780 with Priority: HIGHEST for action security_group_members [ 1176.973059] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e63cb46c-ccab-4856-bf25-2380514e2780 with Priority: HIGHEST for action security_group_members [ 1176.973382] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-e63cb46c-ccab-4856-bf25-2380514e2780 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.973558] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e63cb46c-ccab-4856-bf25-2380514e2780" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.973650] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e63cb46c-ccab-4856-bf25-2380514e2780" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.973905] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e63cb46c-ccab-4856-bf25-2380514e2780" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.974265] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.974411] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.974529] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.974682] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.974838] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.974919] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e63cb46c-ccab-4856-bf25-2380514e2780',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1177.073166] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 0dbf2bcd-0572-43ef-b18d-cc3cca7fcfd5: rpc.has_security_group_logging(os_id): False [ 1177.093342] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.093500] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.093561] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.093735] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.131347] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.131613] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.131739] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.131806] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.132063] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.132163] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.132365] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.132465] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.132528] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.132691] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.132765] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.132964] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.133071] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.133133] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.133273] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.133358] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.133484] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0dbf2bcd-0572-43ef-b18d-cc3cca7fcfd5 is going to be updated. [ 1177.197642] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.197760] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.197852] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.198077] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.198226] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.209340] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0dbf2bcd-0572-43ef-b18d-cc3cca7fcfd5 in Status: IN_PROGRESS for 2s [ 1177.274875] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock network-762 taken with stack trace [, , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.275088] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "network-762" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.275218] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "network-762" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.275486] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "network-762" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.275741] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.275899] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.276056] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.276305] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.276485] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.276783] env[69980]: DEBUG dogpile.cache.region [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] No value present for key: 'zone-id' {{(pid=69980) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1177.276912] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] NeedRegenerationException {{(pid=69980) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1177.277037] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] no value, waiting for create lock {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1177.277151] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] value creation lock acquired {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1177.277262] env[69980]: DEBUG dogpile.cache.region [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] No value present for key: 'zone-id' {{(pid=69980) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1177.277370] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Calling creation function for not-yet-present value {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1177.277503] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1177.315562] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1177.315711] env[69980]: DEBUG dogpile.cache.region [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Cache value generated in 0.038 seconds for key(s): 'zone-id' {{(pid=69980) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1177.316258] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Released creation lock {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1177.316258] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "network-762" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.316684] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock port-98eaa3d2-4c21-4891-80c5-746cc5fde2fc taken with stack trace [, , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.316978] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "port-98eaa3d2-4c21-4891-80c5-746cc5fde2fc" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.317202] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "port-98eaa3d2-4c21-4891-80c5-746cc5fde2fc" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.317596] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "port-98eaa3d2-4c21-4891-80c5-746cc5fde2fc" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.317917] env[69980]: DEBUG networking_nsxv3.api.rpc [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('98eaa3d2-4c21-4891-80c5-746cc5fde2fc',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1177.477226] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.477494] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.477623] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.477959] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.502940] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.503392] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.503547] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.503660] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.503910] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.504075] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.504352] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e63cb46c-ccab-4856-bf25-2380514e2780 is going to be updated. [ 1177.529478] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.529633] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.529687] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.529898] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.530045] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.539022] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e63cb46c-ccab-4856-bf25-2380514e2780 in Status: IN_PROGRESS for 2s [ 1177.542780] env[69980]: INFO networking_nsxv3.common.synchronization [req-74eae7e7-c466-4b8f-a475-0f0aa45cdded req-f80d6cb4-053c-4707-86e8-5fd7645f9943 service nova] Enqueued Resource ID: d0e04be7-8718-489c-8ceb-fe661da4855a with Priority: HIGHEST for action security_group_rules [ 1177.542960] env[69980]: INFO networking_nsxv3.common.synchronization [req-74eae7e7-c466-4b8f-a475-0f0aa45cdded req-f80d6cb4-053c-4707-86e8-5fd7645f9943 service nova] Enqueued Resource ID: d0e04be7-8718-489c-8ceb-fe661da4855a with Priority: HIGHEST for action security_group_members [ 1177.543192] env[69980]: INFO networking_nsxv3.common.synchronization [req-74eae7e7-c466-4b8f-a475-0f0aa45cdded req-f80d6cb4-053c-4707-86e8-5fd7645f9943 service nova] Enqueued Resource ID: 44499cf8-f9c6-4b3c-afd5-0907ffdad7ea with Priority: HIGHEST for action port [ 1177.543389] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d0e04be7-8718-489c-8ceb-fe661da4855a with Priority: HIGHEST for action security_group_rules [ 1177.543447] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d0e04be7-8718-489c-8ceb-fe661da4855a with Priority: HIGHEST for action security_group_members [ 1177.543540] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 44499cf8-f9c6-4b3c-afd5-0907ffdad7ea with Priority: HIGHEST for action port [ 1177.544124] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d0e04be7-8718-489c-8ceb-fe661da4855a taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.544263] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d0e04be7-8718-489c-8ceb-fe661da4855a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.544433] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d0e04be7-8718-489c-8ceb-fe661da4855a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.544507] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d0e04be7-8718-489c-8ceb-fe661da4855a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.544638] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d0e04be7-8718-489c-8ceb-fe661da4855a',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1177.550022] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-d0e04be7-8718-489c-8ceb-fe661da4855a taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.550022] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d0e04be7-8718-489c-8ceb-fe661da4855a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.550022] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d0e04be7-8718-489c-8ceb-fe661da4855a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.550022] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d0e04be7-8718-489c-8ceb-fe661da4855a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.550022] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.550022] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.550022] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.550022] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.550022] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.550022] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d0e04be7-8718-489c-8ceb-fe661da4855a',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1177.550022] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock port-44499cf8-f9c6-4b3c-afd5-0907ffdad7ea taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.550022] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-44499cf8-f9c6-4b3c-afd5-0907ffdad7ea" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.550022] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-44499cf8-f9c6-4b3c-afd5-0907ffdad7ea" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.550022] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-44499cf8-f9c6-4b3c-afd5-0907ffdad7ea" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.550022] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('44499cf8-f9c6-4b3c-afd5-0907ffdad7ea',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1177.821149] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.821396] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.821552] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.821802] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.821956] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.822127] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Segment Port 98eaa3d2-4c21-4891-80c5-746cc5fde2fc not found, creating... [ 1177.822389] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.822552] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.822677] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.822894] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.823048] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.823369] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.823536] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.823658] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.823869] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.824016] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.824166] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Resource: SegmentPort with ID: 98eaa3d2-4c21-4891-80c5-746cc5fde2fc is going to be created. [ 1177.843480] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.843480] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.843694] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.843841] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.844075] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.844428] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "port-98eaa3d2-4c21-4891-80c5-746cc5fde2fc" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.054253] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 44499cf8-f9c6-4b3c-afd5-0907ffdad7ea with status ACTIVE [ 1178.054486] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.055368] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.055368] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.055368] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.055368] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.055368] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.055368] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.055368] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.055675] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.055675] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.055731] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.055780] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.055859] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.055994] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.056080] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.056164] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 44499cf8-f9c6-4b3c-afd5-0907ffdad7ea is going to be updated. [ 1178.057437] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-d0e04be7-8718-489c-8ceb-fe661da4855a taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.057555] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d0e04be7-8718-489c-8ceb-fe661da4855a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.057738] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d0e04be7-8718-489c-8ceb-fe661da4855a',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1178.076779] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.076932] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.076983] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.077208] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.077337] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.077486] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-44499cf8-f9c6-4b3c-afd5-0907ffdad7ea" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.364503] env[69980]: INFO networking_nsxv3.common.synchronization [req-67b84146-4521-49a2-b4a5-d52e85f79226 req-9dbe7f1e-603f-43e9-bdda-8b43b3386b29 tempest-AttachVolumeTestJSON-92929017 tempest-AttachVolumeTestJSON-92929017-project-member] Enqueued Resource ID: bb697495-b311-499b-98c5-fa0133350846 with Priority: HIGHEST for action security_group_members [ 1178.365336] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bb697495-b311-499b-98c5-fa0133350846 with Priority: HIGHEST for action security_group_members [ 1178.366159] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-bb697495-b311-499b-98c5-fa0133350846 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.366159] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bb697495-b311-499b-98c5-fa0133350846" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.366159] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bb697495-b311-499b-98c5-fa0133350846" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.366338] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bb697495-b311-499b-98c5-fa0133350846" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.366709] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.366709] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.366709] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.366912] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.367041] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.367461] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bb697495-b311-499b-98c5-fa0133350846',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1178.560321] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d0e04be7-8718-489c-8ceb-fe661da4855a',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1178.606902] env[69980]: INFO networking_nsxv3.common.synchronization [req-c59ab362-ba78-4c29-a2fe-1dc2b6fbacad req-c2065ae7-0fdf-4ace-b874-50fdd157cddf service nova] Enqueued Resource ID: e63cb46c-ccab-4856-bf25-2380514e2780 with Priority: HIGHEST for action security_group_rules [ 1178.606902] env[69980]: INFO networking_nsxv3.common.synchronization [req-c59ab362-ba78-4c29-a2fe-1dc2b6fbacad req-c2065ae7-0fdf-4ace-b874-50fdd157cddf service nova] Enqueued Resource ID: e63cb46c-ccab-4856-bf25-2380514e2780 with Priority: HIGHEST for action security_group_members [ 1178.606902] env[69980]: INFO networking_nsxv3.common.synchronization [req-c59ab362-ba78-4c29-a2fe-1dc2b6fbacad req-c2065ae7-0fdf-4ace-b874-50fdd157cddf service nova] Enqueued Resource ID: 98eaa3d2-4c21-4891-80c5-746cc5fde2fc with Priority: HIGHEST for action port [ 1178.606902] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e63cb46c-ccab-4856-bf25-2380514e2780 with Priority: HIGHEST for action security_group_rules [ 1178.606902] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e63cb46c-ccab-4856-bf25-2380514e2780 with Priority: HIGHEST for action security_group_members [ 1178.606902] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 98eaa3d2-4c21-4891-80c5-746cc5fde2fc with Priority: HIGHEST for action port [ 1178.606902] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e63cb46c-ccab-4856-bf25-2380514e2780 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.606902] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e63cb46c-ccab-4856-bf25-2380514e2780" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.606902] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e63cb46c-ccab-4856-bf25-2380514e2780" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.606902] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e63cb46c-ccab-4856-bf25-2380514e2780" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.606902] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e63cb46c-ccab-4856-bf25-2380514e2780',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1178.606902] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-e63cb46c-ccab-4856-bf25-2380514e2780 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.606902] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e63cb46c-ccab-4856-bf25-2380514e2780" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.607480] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock port-98eaa3d2-4c21-4891-80c5-746cc5fde2fc taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.607480] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-98eaa3d2-4c21-4891-80c5-746cc5fde2fc" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.607480] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-98eaa3d2-4c21-4891-80c5-746cc5fde2fc" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.607480] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-98eaa3d2-4c21-4891-80c5-746cc5fde2fc" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.607480] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('98eaa3d2-4c21-4891-80c5-746cc5fde2fc',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1178.675412] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock network-488 taken with stack trace [, , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.675625] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "network-488" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.675755] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "network-488" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.676123] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "network-488" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.676419] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.676605] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.676732] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.676979] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.677346] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.677597] env[69980]: DEBUG dogpile.cache.region [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] No value present for key: 'zone-id' {{(pid=69980) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1178.677748] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] NeedRegenerationException {{(pid=69980) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1178.678291] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] no value, waiting for create lock {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1178.678291] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] value creation lock acquired {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1178.678291] env[69980]: DEBUG dogpile.cache.region [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] No value present for key: 'zone-id' {{(pid=69980) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1178.678291] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Calling creation function for not-yet-present value {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1178.678428] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1178.698629] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1178.698629] env[69980]: DEBUG dogpile.cache.region [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=69980) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1178.700693] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Released creation lock {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1178.700693] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "network-488" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.700693] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock port-85e7a84f-ed45-465d-83f7-5ba7ed1b0bba taken with stack trace [, , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.700693] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "port-85e7a84f-ed45-465d-83f7-5ba7ed1b0bba" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.700693] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "port-85e7a84f-ed45-465d-83f7-5ba7ed1b0bba" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.700693] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "port-85e7a84f-ed45-465d-83f7-5ba7ed1b0bba" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.700693] env[69980]: DEBUG networking_nsxv3.api.rpc [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('85e7a84f-ed45-465d-83f7-5ba7ed1b0bba',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1178.869094] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.869351] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.869477] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.869715] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.869849] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.870081] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.870185] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.870248] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.870426] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.870507] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.870611] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bb697495-b311-499b-98c5-fa0133350846 already deleted. [ 1178.870697] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bb697495-b311-499b-98c5-fa0133350846" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.063129] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.063129] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.063129] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.063129] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.063129] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.063129] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d0e04be7-8718-489c-8ceb-fe661da4855a is going to be created. [ 1179.084881] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.085084] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.085084] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.085281] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.085434] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.094678] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d0e04be7-8718-489c-8ceb-fe661da4855a in Status: UNINITIALIZED for 2s [ 1179.109125] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 98eaa3d2-4c21-4891-80c5-746cc5fde2fc with status ACTIVE [ 1179.109417] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.109504] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.109555] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.109806] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.109982] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.110121] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.110225] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.110280] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.110444] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.110539] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.110697] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.110788] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.110837] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.110987] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.111074] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.111146] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 98eaa3d2-4c21-4891-80c5-746cc5fde2fc is going to be updated. [ 1179.112627] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-e63cb46c-ccab-4856-bf25-2380514e2780 taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.112627] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e63cb46c-ccab-4856-bf25-2380514e2780" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.130827] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.130827] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.130827] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.131156] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.131156] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.131156] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-98eaa3d2-4c21-4891-80c5-746cc5fde2fc" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.202552] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.202899] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.203133] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.203530] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.203759] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.204051] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Segment Port 85e7a84f-ed45-465d-83f7-5ba7ed1b0bba not found, creating... [ 1179.204669] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.204813] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.205018] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.205298] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.205506] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.205864] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.206108] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.206290] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.206561] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.206774] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.206971] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Resource: SegmentPort with ID: 85e7a84f-ed45-465d-83f7-5ba7ed1b0bba is going to be created. [ 1179.224090] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0dbf2bcd-0572-43ef-b18d-cc3cca7fcfd5 in Status: SUCCESS [ 1179.224335] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0dbf2bcd-0572-43ef-b18d-cc3cca7fcfd5" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.224595] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0dbf2bcd-0572-43ef-b18d-cc3cca7fcfd5" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.224884] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0dbf2bcd-0572-43ef-b18d-cc3cca7fcfd5" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.225039] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0dbf2bcd-0572-43ef-b18d-cc3cca7fcfd5',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1179.240297] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.240517] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.240623] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.240883] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.241121] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.241341] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "port-85e7a84f-ed45-465d-83f7-5ba7ed1b0bba" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.553036] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e63cb46c-ccab-4856-bf25-2380514e2780 in Status: SUCCESS [ 1179.553036] env[69980]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e63cb46c-ccab-4856-bf25-2380514e2780 deletion is rescheduled due to dependency. [ 1179.553036] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e63cb46c-ccab-4856-bf25-2380514e2780" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.553036] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e63cb46c-ccab-4856-bf25-2380514e2780" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.553036] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e63cb46c-ccab-4856-bf25-2380514e2780" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.553036] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.553036] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.553036] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.553036] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.553036] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.553036] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e63cb46c-ccab-4856-bf25-2380514e2780',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1179.728045] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-0dbf2bcd-0572-43ef-b18d-cc3cca7fcfd5 taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.728045] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0dbf2bcd-0572-43ef-b18d-cc3cca7fcfd5" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.728045] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0dbf2bcd-0572-43ef-b18d-cc3cca7fcfd5" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.729960] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0dbf2bcd-0572-43ef-b18d-cc3cca7fcfd5" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.729960] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.729960] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.729960] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.729960] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.729960] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.729960] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0dbf2bcd-0572-43ef-b18d-cc3cca7fcfd5" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.729960] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('0dbf2bcd-0572-43ef-b18d-cc3cca7fcfd5',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1179.923309] env[69980]: INFO networking_nsxv3.common.synchronization [req-67b84146-4521-49a2-b4a5-d52e85f79226 req-1ba03e48-d3c8-4f2b-9ed3-81839cafcc9d service nova] Enqueued Resource ID: bb697495-b311-499b-98c5-fa0133350846 with Priority: HIGHEST for action security_group_rules [ 1179.923504] env[69980]: INFO networking_nsxv3.common.synchronization [req-67b84146-4521-49a2-b4a5-d52e85f79226 req-1ba03e48-d3c8-4f2b-9ed3-81839cafcc9d service nova] Enqueued Resource ID: bb697495-b311-499b-98c5-fa0133350846 with Priority: HIGHEST for action security_group_members [ 1179.923643] env[69980]: INFO networking_nsxv3.common.synchronization [req-67b84146-4521-49a2-b4a5-d52e85f79226 req-1ba03e48-d3c8-4f2b-9ed3-81839cafcc9d service nova] Enqueued Resource ID: 85e7a84f-ed45-465d-83f7-5ba7ed1b0bba with Priority: HIGHEST for action port [ 1179.923871] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bb697495-b311-499b-98c5-fa0133350846 with Priority: HIGHEST for action security_group_rules [ 1179.923999] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bb697495-b311-499b-98c5-fa0133350846 with Priority: HIGHEST for action security_group_members [ 1179.924113] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 85e7a84f-ed45-465d-83f7-5ba7ed1b0bba with Priority: HIGHEST for action port [ 1179.924758] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock rules-bb697495-b311-499b-98c5-fa0133350846 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.924883] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-bb697495-b311-499b-98c5-fa0133350846" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.924953] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-bb697495-b311-499b-98c5-fa0133350846" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.925178] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-bb697495-b311-499b-98c5-fa0133350846" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.925279] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('bb697495-b311-499b-98c5-fa0133350846',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1179.926267] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-bb697495-b311-499b-98c5-fa0133350846 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.926343] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bb697495-b311-499b-98c5-fa0133350846" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.926343] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bb697495-b311-499b-98c5-fa0133350846" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.926521] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bb697495-b311-499b-98c5-fa0133350846" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.926758] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.926823] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.926871] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.927012] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.927101] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.927189] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bb697495-b311-499b-98c5-fa0133350846',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1179.927997] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock port-85e7a84f-ed45-465d-83f7-5ba7ed1b0bba taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.928117] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-85e7a84f-ed45-465d-83f7-5ba7ed1b0bba" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.931590] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-85e7a84f-ed45-465d-83f7-5ba7ed1b0bba" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.931590] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-85e7a84f-ed45-465d-83f7-5ba7ed1b0bba" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.931590] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('85e7a84f-ed45-465d-83f7-5ba7ed1b0bba',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1180.055926] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e63cb46c-ccab-4856-bf25-2380514e2780',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1180.231965] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-0dbf2bcd-0572-43ef-b18d-cc3cca7fcfd5 taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.232208] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0dbf2bcd-0572-43ef-b18d-cc3cca7fcfd5" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.232238] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0dbf2bcd-0572-43ef-b18d-cc3cca7fcfd5" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1180.232442] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0dbf2bcd-0572-43ef-b18d-cc3cca7fcfd5" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1180.232614] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.232710] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.232772] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1180.232958] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1180.233053] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1180.233121] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0dbf2bcd-0572-43ef-b18d-cc3cca7fcfd5" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1180.233265] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-0dbf2bcd-0572-43ef-b18d-cc3cca7fcfd5 taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.233357] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0dbf2bcd-0572-43ef-b18d-cc3cca7fcfd5" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.233418] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0dbf2bcd-0572-43ef-b18d-cc3cca7fcfd5" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1180.233557] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0dbf2bcd-0572-43ef-b18d-cc3cca7fcfd5" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1180.233710] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.233803] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.233863] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1180.234035] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1180.234119] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1180.234203] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0dbf2bcd-0572-43ef-b18d-cc3cca7fcfd5" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1180.234293] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('0dbf2bcd-0572-43ef-b18d-cc3cca7fcfd5',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1180.433030] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('bb697495-b311-499b-98c5-fa0133350846',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1180.433030] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-bb697495-b311-499b-98c5-fa0133350846 taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.433030] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bb697495-b311-499b-98c5-fa0133350846" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.433030] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 85e7a84f-ed45-465d-83f7-5ba7ed1b0bba with status ACTIVE [ 1180.433030] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.433030] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.433030] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1180.433030] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1180.433030] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1180.433030] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.433030] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.434131] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1180.434131] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1180.434131] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1180.434359] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.434359] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.434359] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1180.434545] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1180.434613] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1180.434715] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 85e7a84f-ed45-465d-83f7-5ba7ed1b0bba is going to be updated. [ 1180.455118] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.455310] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.455394] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1180.455617] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1180.455758] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1180.455920] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-85e7a84f-ed45-465d-83f7-5ba7ed1b0bba" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1180.558273] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e63cb46c-ccab-4856-bf25-2380514e2780',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1180.737463] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 0dbf2bcd-0572-43ef-b18d-cc3cca7fcfd5: rpc.has_security_group_logging(os_id): False [ 1180.755164] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.755306] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.755384] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1180.755619] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1180.755722] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1180.755851] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.755949] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.756031] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1180.756184] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1180.756262] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1180.756448] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.756890] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.756890] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1180.756890] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1180.757055] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1180.757191] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.757257] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.757337] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1180.757442] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1180.757515] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1180.757625] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0dbf2bcd-0572-43ef-b18d-cc3cca7fcfd5 is going to be updated. [ 1180.815039] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.815039] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.815039] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1180.815039] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1180.815039] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1180.828148] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0dbf2bcd-0572-43ef-b18d-cc3cca7fcfd5 in Status: IN_PROGRESS for 2s [ 1180.863996] env[69980]: INFO networking_nsxv3.common.synchronization [req-8551f6c5-a5c3-45e4-9503-0148caa2ad14 req-2aa1616c-e0df-402c-8af8-6b0a332b6eb9 tempest-ServerActionsTestJSON-1479580870 tempest-ServerActionsTestJSON-1479580870-project-member] Enqueued Resource ID: 1c48b9d6-06bd-4429-a87d-c56109170df7 with Priority: HIGHEST for action security_group_members [ 1180.864677] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1c48b9d6-06bd-4429-a87d-c56109170df7 with Priority: HIGHEST for action security_group_members [ 1180.866191] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-1c48b9d6-06bd-4429-a87d-c56109170df7 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.866191] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1c48b9d6-06bd-4429-a87d-c56109170df7" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.866191] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1c48b9d6-06bd-4429-a87d-c56109170df7" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1180.866191] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1c48b9d6-06bd-4429-a87d-c56109170df7" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1180.866191] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.866191] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.866400] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1180.866431] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1180.866558] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1180.866715] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1c48b9d6-06bd-4429-a87d-c56109170df7',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1180.937342] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('bb697495-b311-499b-98c5-fa0133350846',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1181.062269] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.062269] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.062269] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.062269] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.062269] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.062269] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e63cb46c-ccab-4856-bf25-2380514e2780 is going to be updated. [ 1181.088556] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.088755] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.088755] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.088990] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.089073] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.103021] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e63cb46c-ccab-4856-bf25-2380514e2780 in Status: IN_PROGRESS for 2s [ 1181.105691] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d0e04be7-8718-489c-8ceb-fe661da4855a in Status: SUCCESS [ 1181.106240] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d0e04be7-8718-489c-8ceb-fe661da4855a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.106334] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d0e04be7-8718-489c-8ceb-fe661da4855a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.106547] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d0e04be7-8718-489c-8ceb-fe661da4855a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.106989] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.107149] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.107149] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.107695] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.107744] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.108558] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d0e04be7-8718-489c-8ceb-fe661da4855a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.108558] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d0e04be7-8718-489c-8ceb-fe661da4855a',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1181.320319] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock network-637 taken with stack trace [, , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.320319] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "network-637" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.320614] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "network-637" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.320710] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "network-637" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.320934] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.321199] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.321330] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.321555] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.321706] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.321920] env[69980]: DEBUG dogpile.cache.region [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] No value present for key: 'zone-id' {{(pid=69980) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1181.322077] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] NeedRegenerationException {{(pid=69980) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1181.322200] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] no value, waiting for create lock {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1181.322311] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] value creation lock acquired {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1181.322433] env[69980]: DEBUG dogpile.cache.region [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] No value present for key: 'zone-id' {{(pid=69980) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1181.322534] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Calling creation function for not-yet-present value {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1181.322670] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1181.341071] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1181.341155] env[69980]: DEBUG dogpile.cache.region [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=69980) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1181.341279] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Released creation lock {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1181.341469] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "network-637" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.341772] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock port-a6777bc8-5d88-445c-8dde-5ce4bc298b78 taken with stack trace [, , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.342017] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "port-a6777bc8-5d88-445c-8dde-5ce4bc298b78" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.342104] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "port-a6777bc8-5d88-445c-8dde-5ce4bc298b78" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.342383] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "port-a6777bc8-5d88-445c-8dde-5ce4bc298b78" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.342641] env[69980]: DEBUG networking_nsxv3.api.rpc [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a6777bc8-5d88-445c-8dde-5ce4bc298b78',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1181.369945] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.369945] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.369945] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.369945] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.369945] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.369945] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.369945] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.369945] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.369945] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.369945] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.369945] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1c48b9d6-06bd-4429-a87d-c56109170df7 already deleted. [ 1181.369945] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1c48b9d6-06bd-4429-a87d-c56109170df7" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.439701] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.440155] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.440436] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.440851] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.441117] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.441386] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bb697495-b311-499b-98c5-fa0133350846 is going to be created. [ 1181.465281] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.465558] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.465699] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.467440] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.467440] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.475725] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bb697495-b311-499b-98c5-fa0133350846 in Status: UNINITIALIZED for 2s [ 1181.610524] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-d0e04be7-8718-489c-8ceb-fe661da4855a taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.610524] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d0e04be7-8718-489c-8ceb-fe661da4855a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.610524] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d0e04be7-8718-489c-8ceb-fe661da4855a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.610771] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d0e04be7-8718-489c-8ceb-fe661da4855a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.610771] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.610881] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.610968] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.611184] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.611298] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.611393] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d0e04be7-8718-489c-8ceb-fe661da4855a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.611589] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-d0e04be7-8718-489c-8ceb-fe661da4855a taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.611738] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d0e04be7-8718-489c-8ceb-fe661da4855a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.611826] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d0e04be7-8718-489c-8ceb-fe661da4855a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.612022] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d0e04be7-8718-489c-8ceb-fe661da4855a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.612197] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.612294] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.612411] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.612495] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.612597] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.612688] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d0e04be7-8718-489c-8ceb-fe661da4855a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.612778] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d0e04be7-8718-489c-8ceb-fe661da4855a',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1181.627747] env[69980]: INFO networking_nsxv3.common.synchronization [req-d27b5505-f175-4b7d-aa84-42e57ac927ba req-8dd98882-e7ee-47e6-b2d5-cf4af2e72d59 tempest-ServerActionsTestOtherB-1413576659 tempest-ServerActionsTestOtherB-1413576659-project-member] Enqueued Resource ID: 72f0fad5-906a-4ed9-a922-fdb13010a34d with Priority: HIGHEST for action security_group_members [ 1181.628509] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 72f0fad5-906a-4ed9-a922-fdb13010a34d with Priority: HIGHEST for action security_group_members [ 1181.629829] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-72f0fad5-906a-4ed9-a922-fdb13010a34d taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.630000] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-72f0fad5-906a-4ed9-a922-fdb13010a34d" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.630117] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-72f0fad5-906a-4ed9-a922-fdb13010a34d" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.630400] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-72f0fad5-906a-4ed9-a922-fdb13010a34d" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.630676] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.630770] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.630837] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.634017] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.634017] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.634017] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('72f0fad5-906a-4ed9-a922-fdb13010a34d',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1181.844797] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.845170] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.845360] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.845675] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.845862] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.846039] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Segment Port a6777bc8-5d88-445c-8dde-5ce4bc298b78 not found, creating... [ 1181.846656] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.846952] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.847110] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.847393] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.847613] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.848184] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.848291] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.848340] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.848592] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.848756] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.848930] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Resource: SegmentPort with ID: a6777bc8-5d88-445c-8dde-5ce4bc298b78 is going to be created. [ 1181.875675] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.875907] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.876120] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.876473] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.876843] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.877110] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "port-a6777bc8-5d88-445c-8dde-5ce4bc298b78" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.117430] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d0e04be7-8718-489c-8ceb-fe661da4855a: rpc.has_security_group_logging(os_id): False [ 1182.134060] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.134060] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.134060] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1182.134060] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1182.134060] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.134060] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.134352] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.134352] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1182.134407] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1182.134517] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.134775] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.134941] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.135080] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1182.135236] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1182.135317] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.135581] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.135708] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.135794] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1182.135950] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1182.136077] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.136200] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d0e04be7-8718-489c-8ceb-fe661da4855a is going to be created. [ 1182.137613] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.137682] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.137765] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1182.137891] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1182.163719] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.165798] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.165798] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.165798] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1182.165798] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1182.165798] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.165798] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 72f0fad5-906a-4ed9-a922-fdb13010a34d is going to be updated. [ 1182.206207] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.206371] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.206461] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1182.206721] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1182.206865] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.217117] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 72f0fad5-906a-4ed9-a922-fdb13010a34d in Status: IN_PROGRESS for 2s [ 1182.221135] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.221135] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.221135] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1182.221135] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1182.221135] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.231595] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d0e04be7-8718-489c-8ceb-fe661da4855a in Status: IN_PROGRESS for 2s [ 1182.624031] env[69980]: INFO networking_nsxv3.common.synchronization [req-8551f6c5-a5c3-45e4-9503-0148caa2ad14 req-c7abff9e-9759-4e59-9e9c-816b2e5fa7dd service nova] Enqueued Resource ID: 1c48b9d6-06bd-4429-a87d-c56109170df7 with Priority: HIGHEST for action security_group_rules [ 1182.624031] env[69980]: INFO networking_nsxv3.common.synchronization [req-8551f6c5-a5c3-45e4-9503-0148caa2ad14 req-c7abff9e-9759-4e59-9e9c-816b2e5fa7dd service nova] Enqueued Resource ID: 1c48b9d6-06bd-4429-a87d-c56109170df7 with Priority: HIGHEST for action security_group_members [ 1182.624322] env[69980]: INFO networking_nsxv3.common.synchronization [req-8551f6c5-a5c3-45e4-9503-0148caa2ad14 req-c7abff9e-9759-4e59-9e9c-816b2e5fa7dd service nova] Enqueued Resource ID: a6777bc8-5d88-445c-8dde-5ce4bc298b78 with Priority: HIGHEST for action port [ 1182.624322] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1c48b9d6-06bd-4429-a87d-c56109170df7 with Priority: HIGHEST for action security_group_rules [ 1182.624397] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1c48b9d6-06bd-4429-a87d-c56109170df7 with Priority: HIGHEST for action security_group_members [ 1182.624525] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a6777bc8-5d88-445c-8dde-5ce4bc298b78 with Priority: HIGHEST for action port [ 1182.626722] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1c48b9d6-06bd-4429-a87d-c56109170df7 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.626722] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1c48b9d6-06bd-4429-a87d-c56109170df7" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.626722] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1c48b9d6-06bd-4429-a87d-c56109170df7" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1182.626722] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1c48b9d6-06bd-4429-a87d-c56109170df7" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1182.626917] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1c48b9d6-06bd-4429-a87d-c56109170df7',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1182.628911] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-1c48b9d6-06bd-4429-a87d-c56109170df7 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.629064] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1c48b9d6-06bd-4429-a87d-c56109170df7" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.629140] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1c48b9d6-06bd-4429-a87d-c56109170df7" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1182.630945] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1c48b9d6-06bd-4429-a87d-c56109170df7" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1182.631231] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.631231] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.631348] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1182.631429] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1182.631479] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.631574] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1c48b9d6-06bd-4429-a87d-c56109170df7',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1182.632475] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock port-a6777bc8-5d88-445c-8dde-5ce4bc298b78 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.632475] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a6777bc8-5d88-445c-8dde-5ce4bc298b78" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.632652] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a6777bc8-5d88-445c-8dde-5ce4bc298b78" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1182.632652] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a6777bc8-5d88-445c-8dde-5ce4bc298b78" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1182.632726] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a6777bc8-5d88-445c-8dde-5ce4bc298b78',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1182.840961] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0dbf2bcd-0572-43ef-b18d-cc3cca7fcfd5 in Status: SUCCESS [ 1182.841066] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0dbf2bcd-0572-43ef-b18d-cc3cca7fcfd5" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1183.110724] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e63cb46c-ccab-4856-bf25-2380514e2780 in Status: SUCCESS [ 1183.110947] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e63cb46c-ccab-4856-bf25-2380514e2780" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1183.111136] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e63cb46c-ccab-4856-bf25-2380514e2780" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.111352] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e63cb46c-ccab-4856-bf25-2380514e2780" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.111543] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.111710] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.111845] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.112086] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.112215] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1183.112352] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e63cb46c-ccab-4856-bf25-2380514e2780" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1183.112458] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e63cb46c-ccab-4856-bf25-2380514e2780',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1183.134169] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-1c48b9d6-06bd-4429-a87d-c56109170df7 taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.134320] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1c48b9d6-06bd-4429-a87d-c56109170df7" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.134508] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1c48b9d6-06bd-4429-a87d-c56109170df7',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1183.135376] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a6777bc8-5d88-445c-8dde-5ce4bc298b78 with status ACTIVE [ 1183.135570] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.135700] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.135761] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.135982] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.136099] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1183.136291] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.136400] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.136465] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.136683] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.136965] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1183.137189] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.137491] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.137491] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.137586] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.137620] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1183.137693] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a6777bc8-5d88-445c-8dde-5ce4bc298b78 is going to be updated. [ 1183.158523] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.158709] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.158709] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.158838] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.158990] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1183.159168] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a6777bc8-5d88-445c-8dde-5ce4bc298b78" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1183.489037] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bb697495-b311-499b-98c5-fa0133350846 in Status: SUCCESS [ 1183.489037] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bb697495-b311-499b-98c5-fa0133350846" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1183.489037] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bb697495-b311-499b-98c5-fa0133350846" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.489260] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bb697495-b311-499b-98c5-fa0133350846" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.489327] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.489447] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.489511] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.489667] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.489751] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1183.489835] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bb697495-b311-499b-98c5-fa0133350846" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1183.489928] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('bb697495-b311-499b-98c5-fa0133350846',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1183.614660] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-e63cb46c-ccab-4856-bf25-2380514e2780 taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.614911] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e63cb46c-ccab-4856-bf25-2380514e2780" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.614911] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e63cb46c-ccab-4856-bf25-2380514e2780" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.615161] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e63cb46c-ccab-4856-bf25-2380514e2780" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.615341] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.615509] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.615567] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.615790] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.615844] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1183.615946] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e63cb46c-ccab-4856-bf25-2380514e2780" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1183.616172] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-e63cb46c-ccab-4856-bf25-2380514e2780 taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.616304] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e63cb46c-ccab-4856-bf25-2380514e2780" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.616441] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e63cb46c-ccab-4856-bf25-2380514e2780" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.616684] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e63cb46c-ccab-4856-bf25-2380514e2780" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.616911] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.617066] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.617176] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.617431] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.617527] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1183.617573] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e63cb46c-ccab-4856-bf25-2380514e2780" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1183.617671] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e63cb46c-ccab-4856-bf25-2380514e2780',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1183.639792] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1c48b9d6-06bd-4429-a87d-c56109170df7',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1183.992287] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('bb697495-b311-499b-98c5-fa0133350846',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1184.119691] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e63cb46c-ccab-4856-bf25-2380514e2780: rpc.has_security_group_logging(os_id): False [ 1184.136868] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1184.137066] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1184.137161] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1184.137393] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1184.137517] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1184.137753] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1184.137870] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1184.137967] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1184.138173] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1184.138285] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1184.138539] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1184.138675] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1184.138756] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1184.138942] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1184.139080] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1184.139303] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1184.139428] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1184.139511] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1184.139726] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1184.139789] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1184.139909] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e63cb46c-ccab-4856-bf25-2380514e2780 is going to be updated. [ 1184.141291] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1184.141431] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1184.141505] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1184.141693] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1184.141781] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1184.141892] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1c48b9d6-06bd-4429-a87d-c56109170df7 is going to be created. [ 1184.165813] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1184.165948] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1184.165999] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1184.166222] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1184.166442] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1184.174729] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1c48b9d6-06bd-4429-a87d-c56109170df7 in Status: UNINITIALIZED for 2s [ 1184.208393] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1184.208393] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1184.208393] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1184.208605] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1184.208749] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1184.219680] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e63cb46c-ccab-4856-bf25-2380514e2780 in Status: IN_PROGRESS for 2s [ 1184.225614] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 72f0fad5-906a-4ed9-a922-fdb13010a34d in Status: SUCCESS [ 1184.225778] env[69980]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 72f0fad5-906a-4ed9-a922-fdb13010a34d deletion is rescheduled due to dependency. [ 1184.225891] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-72f0fad5-906a-4ed9-a922-fdb13010a34d" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1184.243526] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d0e04be7-8718-489c-8ceb-fe661da4855a in Status: SUCCESS [ 1184.243733] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d0e04be7-8718-489c-8ceb-fe661da4855a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1184.495224] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for bb697495-b311-499b-98c5-fa0133350846: rpc.has_security_group_logging(os_id): False [ 1184.533152] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1184.533403] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1184.533489] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1184.533742] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1184.533882] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1184.534125] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1184.534236] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1184.534300] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1184.534466] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1184.534560] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1184.534920] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bb697495-b311-499b-98c5-fa0133350846 is going to be created. [ 1184.635526] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1184.635748] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1184.635748] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1184.636155] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1184.636155] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1184.651273] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bb697495-b311-499b-98c5-fa0133350846 in Status: IN_PROGRESS for 2s [ 1185.162364] env[69980]: INFO networking_nsxv3.common.synchronization [req-1e6ed68e-a127-4f7a-a38a-d60605d3951a req-90b85cc0-c973-4cbb-b735-3bf06a83b5ef tempest-ServerDiskConfigTestJSON-214268531 tempest-ServerDiskConfigTestJSON-214268531-project-member] Enqueued Resource ID: 0dbf2bcd-0572-43ef-b18d-cc3cca7fcfd5 with Priority: HIGHEST for action security_group_members [ 1185.162933] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0dbf2bcd-0572-43ef-b18d-cc3cca7fcfd5 with Priority: HIGHEST for action security_group_members [ 1185.163290] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-0dbf2bcd-0572-43ef-b18d-cc3cca7fcfd5 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.163415] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0dbf2bcd-0572-43ef-b18d-cc3cca7fcfd5" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.163480] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0dbf2bcd-0572-43ef-b18d-cc3cca7fcfd5" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.163671] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0dbf2bcd-0572-43ef-b18d-cc3cca7fcfd5" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.163830] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.163928] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.163991] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.165179] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.165275] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1185.165373] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0dbf2bcd-0572-43ef-b18d-cc3cca7fcfd5',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1185.360877] env[69980]: INFO networking_nsxv3.common.synchronization [None req-67de9a05-796a-4a9d-8ff5-cbac95ece866 tempest-AttachInterfacesTestJSON-1782090316 tempest-AttachInterfacesTestJSON-1782090316-project-member] Enqueued Resource ID: e63cb46c-ccab-4856-bf25-2380514e2780 with Priority: HIGHEST for action security_group_members [ 1185.361386] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e63cb46c-ccab-4856-bf25-2380514e2780 with Priority: HIGHEST for action security_group_members [ 1185.361808] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-e63cb46c-ccab-4856-bf25-2380514e2780 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.361939] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e63cb46c-ccab-4856-bf25-2380514e2780" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.362016] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e63cb46c-ccab-4856-bf25-2380514e2780" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.362216] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e63cb46c-ccab-4856-bf25-2380514e2780" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.362399] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.362501] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.362575] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.362702] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.362783] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1185.362877] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e63cb46c-ccab-4856-bf25-2380514e2780',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1185.669036] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.669036] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.669036] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.669036] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.669036] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1185.669036] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.669036] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.669036] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.669684] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.669684] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1185.669684] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0dbf2bcd-0572-43ef-b18d-cc3cca7fcfd5 is going to be updated. [ 1185.710098] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.710322] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.710322] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.710528] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.710672] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1185.720150] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0dbf2bcd-0572-43ef-b18d-cc3cca7fcfd5 in Status: IN_PROGRESS for 2s [ 1185.864436] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e63cb46c-ccab-4856-bf25-2380514e2780',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1186.185069] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1c48b9d6-06bd-4429-a87d-c56109170df7 in Status: SUCCESS [ 1186.185296] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1c48b9d6-06bd-4429-a87d-c56109170df7" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1186.185455] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1c48b9d6-06bd-4429-a87d-c56109170df7" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1186.185667] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1c48b9d6-06bd-4429-a87d-c56109170df7" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1186.185853] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1186.185961] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1186.186030] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1186.186186] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1186.186265] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1186.186346] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1c48b9d6-06bd-4429-a87d-c56109170df7" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1186.186432] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1c48b9d6-06bd-4429-a87d-c56109170df7',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1186.237620] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e63cb46c-ccab-4856-bf25-2380514e2780 in Status: SUCCESS [ 1186.237875] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e63cb46c-ccab-4856-bf25-2380514e2780" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1186.370040] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e63cb46c-ccab-4856-bf25-2380514e2780',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1186.490020] env[69980]: INFO networking_nsxv3.common.synchronization [None req-47945e0c-1cab-4f4d-aafc-6a8aec5a8585 tempest-ServerRescueNegativeTestJSON-1270382253 tempest-ServerRescueNegativeTestJSON-1270382253-project-member] Enqueued Resource ID: c27e63f9-6090-4aea-a9d5-e84fb1046cb3 with Priority: HIGHEST for action security_group_rules [ 1186.490526] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c27e63f9-6090-4aea-a9d5-e84fb1046cb3 with Priority: HIGHEST for action security_group_rules [ 1186.490818] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c27e63f9-6090-4aea-a9d5-e84fb1046cb3 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1186.490933] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c27e63f9-6090-4aea-a9d5-e84fb1046cb3" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1186.490996] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c27e63f9-6090-4aea-a9d5-e84fb1046cb3" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1186.491390] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c27e63f9-6090-4aea-a9d5-e84fb1046cb3" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1186.491474] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c27e63f9-6090-4aea-a9d5-e84fb1046cb3',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1186.662611] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bb697495-b311-499b-98c5-fa0133350846 in Status: SUCCESS [ 1186.662840] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-bb697495-b311-499b-98c5-fa0133350846" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1186.669502] env[69980]: INFO networking_nsxv3.common.synchronization [None req-907c4e1d-7b7e-4df6-9902-07f4950e745a tempest-ServerRescueNegativeTestJSON-1270382253 tempest-ServerRescueNegativeTestJSON-1270382253-project-member] Enqueued Resource ID: c27e63f9-6090-4aea-a9d5-e84fb1046cb3 with Priority: HIGHEST for action security_group_rules [ 1186.669999] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c27e63f9-6090-4aea-a9d5-e84fb1046cb3 with Priority: HIGHEST for action security_group_rules [ 1186.670308] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c27e63f9-6090-4aea-a9d5-e84fb1046cb3 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1186.670410] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c27e63f9-6090-4aea-a9d5-e84fb1046cb3" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1186.689805] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1c48b9d6-06bd-4429-a87d-c56109170df7',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1186.872064] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1186.872248] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1186.872319] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1186.872535] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1186.872625] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1186.872725] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e63cb46c-ccab-4856-bf25-2380514e2780 is going to be updated. [ 1186.901058] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1186.901058] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1186.901058] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1186.901058] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1186.901058] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1186.909238] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e63cb46c-ccab-4856-bf25-2380514e2780 in Status: IN_PROGRESS for 2s [ 1187.011332] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.011484] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.011596] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.011757] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.012479] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.012479] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c27e63f9-6090-4aea-a9d5-e84fb1046cb3 already deleted. [ 1187.012479] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c27e63f9-6090-4aea-a9d5-e84fb1046cb3" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.012479] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c27e63f9-6090-4aea-a9d5-e84fb1046cb3" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.012479] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c27e63f9-6090-4aea-a9d5-e84fb1046cb3" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.012479] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c27e63f9-6090-4aea-a9d5-e84fb1046cb3',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1187.192068] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1c48b9d6-06bd-4429-a87d-c56109170df7: rpc.has_security_group_logging(os_id): False [ 1187.211858] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.211858] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.211858] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.211858] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.211858] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.211858] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.211858] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.211858] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.211858] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.211858] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.211858] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1c48b9d6-06bd-4429-a87d-c56109170df7 is going to be created. [ 1187.275403] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.275403] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.275403] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.275403] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.275403] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.288132] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1c48b9d6-06bd-4429-a87d-c56109170df7 in Status: IN_PROGRESS for 2s [ 1187.426843] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock network-762 taken with stack trace [, , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.427190] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "network-762" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.427420] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "network-762" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.427818] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "network-762" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.428176] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.428410] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.428592] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.428868] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.429085] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.429335] env[69980]: DEBUG dogpile.cache.region [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] No value present for key: 'zone-id' {{(pid=69980) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1187.429517] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] NeedRegenerationException {{(pid=69980) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1187.429667] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] no value, waiting for create lock {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1187.429820] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] value creation lock acquired {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1187.429978] env[69980]: DEBUG dogpile.cache.region [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] No value present for key: 'zone-id' {{(pid=69980) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1187.430157] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Calling creation function for not-yet-present value {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1187.430339] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1187.451980] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1187.452303] env[69980]: DEBUG dogpile.cache.region [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=69980) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1187.452538] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Released creation lock {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1187.452842] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "network-762" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.453369] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock port-1b83de31-44bd-4281-b0a6-1733b75322fe taken with stack trace [, , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.453651] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "port-1b83de31-44bd-4281-b0a6-1733b75322fe" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.453862] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "port-1b83de31-44bd-4281-b0a6-1733b75322fe" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.454480] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "port-1b83de31-44bd-4281-b0a6-1733b75322fe" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.454713] env[69980]: DEBUG networking_nsxv3.api.rpc [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1b83de31-44bd-4281-b0a6-1733b75322fe',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1187.532479] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.532824] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.532981] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.533307] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.533445] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.533591] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c27e63f9-6090-4aea-a9d5-e84fb1046cb3 already deleted. [ 1187.533720] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c27e63f9-6090-4aea-a9d5-e84fb1046cb3" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.733158] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0dbf2bcd-0572-43ef-b18d-cc3cca7fcfd5 in Status: SUCCESS [ 1187.733433] env[69980]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0dbf2bcd-0572-43ef-b18d-cc3cca7fcfd5 deletion is rescheduled due to dependency. [ 1187.733468] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0dbf2bcd-0572-43ef-b18d-cc3cca7fcfd5" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.957968] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.958281] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.958420] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.958731] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.958900] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.959078] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Segment Port 1b83de31-44bd-4281-b0a6-1733b75322fe not found, creating... [ 1187.959356] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.959527] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.959696] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.959933] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.960099] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.960395] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.960559] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.960681] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.960893] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.961059] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.961290] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Resource: SegmentPort with ID: 1b83de31-44bd-4281-b0a6-1733b75322fe is going to be created. [ 1187.980971] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.981221] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.981311] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.981594] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.981849] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.982081] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "port-1b83de31-44bd-4281-b0a6-1733b75322fe" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1188.874660] env[69980]: INFO networking_nsxv3.common.synchronization [req-dadf2325-474b-4d76-b580-604d09c9c036 req-854da4cd-5e7d-4dcb-8386-6ecadec83fe2 service nova] Enqueued Resource ID: e63cb46c-ccab-4856-bf25-2380514e2780 with Priority: HIGHEST for action security_group_rules [ 1188.874950] env[69980]: INFO networking_nsxv3.common.synchronization [req-dadf2325-474b-4d76-b580-604d09c9c036 req-854da4cd-5e7d-4dcb-8386-6ecadec83fe2 service nova] Enqueued Resource ID: e63cb46c-ccab-4856-bf25-2380514e2780 with Priority: HIGHEST for action security_group_members [ 1188.874950] env[69980]: INFO networking_nsxv3.common.synchronization [req-dadf2325-474b-4d76-b580-604d09c9c036 req-854da4cd-5e7d-4dcb-8386-6ecadec83fe2 service nova] Enqueued Resource ID: 1b83de31-44bd-4281-b0a6-1733b75322fe with Priority: HIGHEST for action port [ 1188.875161] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e63cb46c-ccab-4856-bf25-2380514e2780 with Priority: HIGHEST for action security_group_rules [ 1188.875297] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e63cb46c-ccab-4856-bf25-2380514e2780 with Priority: HIGHEST for action security_group_members [ 1188.875395] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1b83de31-44bd-4281-b0a6-1733b75322fe with Priority: HIGHEST for action port [ 1188.876127] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e63cb46c-ccab-4856-bf25-2380514e2780 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.876127] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e63cb46c-ccab-4856-bf25-2380514e2780" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.876127] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e63cb46c-ccab-4856-bf25-2380514e2780" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.876336] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e63cb46c-ccab-4856-bf25-2380514e2780" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.876423] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e63cb46c-ccab-4856-bf25-2380514e2780',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1188.877814] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-e63cb46c-ccab-4856-bf25-2380514e2780 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.877814] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e63cb46c-ccab-4856-bf25-2380514e2780" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.877814] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock port-1b83de31-44bd-4281-b0a6-1733b75322fe taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.877814] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1b83de31-44bd-4281-b0a6-1733b75322fe" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.877814] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1b83de31-44bd-4281-b0a6-1733b75322fe" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.878053] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1b83de31-44bd-4281-b0a6-1733b75322fe" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.878053] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1b83de31-44bd-4281-b0a6-1733b75322fe',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1188.919202] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e63cb46c-ccab-4856-bf25-2380514e2780 in Status: SUCCESS [ 1188.919366] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e63cb46c-ccab-4856-bf25-2380514e2780" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1188.919970] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e63cb46c-ccab-4856-bf25-2380514e2780" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.920270] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e63cb46c-ccab-4856-bf25-2380514e2780" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.920524] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.920783] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.920783] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.920984] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.921148] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1188.921289] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e63cb46c-ccab-4856-bf25-2380514e2780',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1189.299443] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1c48b9d6-06bd-4429-a87d-c56109170df7 in Status: SUCCESS [ 1189.299733] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1c48b9d6-06bd-4429-a87d-c56109170df7" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.379878] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-e63cb46c-ccab-4856-bf25-2380514e2780 taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.380084] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e63cb46c-ccab-4856-bf25-2380514e2780" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.382436] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 1b83de31-44bd-4281-b0a6-1733b75322fe with status ACTIVE [ 1189.382638] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.382756] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.382820] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1189.383078] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1189.383251] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.383350] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.383450] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.383508] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1189.383665] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1189.383743] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.383923] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.384044] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.384155] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1189.384259] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1189.384327] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.384411] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 1b83de31-44bd-4281-b0a6-1733b75322fe is going to be updated. [ 1189.405773] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.405913] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.406044] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1189.406203] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1189.406339] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.406657] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1b83de31-44bd-4281-b0a6-1733b75322fe" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.424114] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e63cb46c-ccab-4856-bf25-2380514e2780',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1189.817503] env[69980]: INFO networking_nsxv3.common.synchronization [req-1b4cd56f-5f93-407d-bf18-4b4be05d528b req-135a4b29-bb4c-42c3-85fc-0433e25d49df tempest-ServerActionsTestOtherB-1413576659 tempest-ServerActionsTestOtherB-1413576659-project-member] Enqueued Resource ID: 72f0fad5-906a-4ed9-a922-fdb13010a34d with Priority: HIGHEST for action security_group_members [ 1189.818516] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 72f0fad5-906a-4ed9-a922-fdb13010a34d with Priority: HIGHEST for action security_group_members [ 1189.818516] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-72f0fad5-906a-4ed9-a922-fdb13010a34d taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.818659] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-72f0fad5-906a-4ed9-a922-fdb13010a34d" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.818659] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-72f0fad5-906a-4ed9-a922-fdb13010a34d" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1189.818823] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-72f0fad5-906a-4ed9-a922-fdb13010a34d" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1189.818973] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.819670] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.819745] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1189.819912] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1189.820007] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.820113] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('72f0fad5-906a-4ed9-a922-fdb13010a34d',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1189.928441] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e63cb46c-ccab-4856-bf25-2380514e2780',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1190.322041] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1190.322226] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1190.322314] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1190.322540] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1190.322663] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1190.322874] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1190.323117] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1190.323117] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1190.323239] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1190.323268] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1190.323362] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 72f0fad5-906a-4ed9-a922-fdb13010a34d is going to be updated. [ 1190.340437] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock network-29 taken with stack trace [, , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1190.340652] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "network-29" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1190.340811] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "network-29" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1190.341051] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "network-29" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1190.341310] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1190.341825] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1190.341825] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1190.341825] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1190.342017] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1190.342404] env[69980]: DEBUG dogpile.cache.region [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] No value present for key: 'zone-id' {{(pid=69980) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1190.342532] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] NeedRegenerationException {{(pid=69980) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1190.342645] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] no value, waiting for create lock {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1190.342761] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] value creation lock acquired {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1190.342879] env[69980]: DEBUG dogpile.cache.region [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] No value present for key: 'zone-id' {{(pid=69980) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1190.342990] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Calling creation function for not-yet-present value {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1190.343144] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1190.345888] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1190.346039] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1190.346082] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1190.346254] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1190.346390] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1190.362784] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1190.362971] env[69980]: DEBUG dogpile.cache.region [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=69980) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1190.363136] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Released creation lock {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1190.363321] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "network-29" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1190.363655] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock port-fddb2882-2c68-4648-970d-23736fa5a265 taken with stack trace [, , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1190.363843] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "port-fddb2882-2c68-4648-970d-23736fa5a265" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1190.363977] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "port-fddb2882-2c68-4648-970d-23736fa5a265" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1190.364530] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "port-fddb2882-2c68-4648-970d-23736fa5a265" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1190.364694] env[69980]: DEBUG networking_nsxv3.api.rpc [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fddb2882-2c68-4648-970d-23736fa5a265',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1190.367338] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 72f0fad5-906a-4ed9-a922-fdb13010a34d in Status: IN_PROGRESS for 2s [ 1190.429419] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1190.429904] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1190.429904] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1190.430024] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1190.430083] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1190.430179] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e63cb46c-ccab-4856-bf25-2380514e2780 is going to be updated. [ 1190.469763] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1190.469992] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1190.470254] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1190.470360] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1190.470454] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1190.479963] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e63cb46c-ccab-4856-bf25-2380514e2780 in Status: IN_PROGRESS for 2s [ 1190.869184] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1190.869421] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1190.869556] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1190.869885] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1190.870076] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1190.870264] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Segment Port fddb2882-2c68-4648-970d-23736fa5a265 not found, creating... [ 1190.870550] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1190.870745] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1190.870901] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1190.871215] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1190.871411] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1190.871794] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1190.872150] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1190.872210] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1190.872424] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1190.872581] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1190.873162] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Resource: SegmentPort with ID: fddb2882-2c68-4648-970d-23736fa5a265 is going to be created. [ 1190.894600] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1190.895261] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1190.895261] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1190.895403] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1190.895734] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1190.896100] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "port-fddb2882-2c68-4648-970d-23736fa5a265" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1191.314466] env[69980]: INFO networking_nsxv3.common.synchronization [req-989d634c-35fc-45bd-9c39-c57b5dd6d10c req-fdb0c0a1-12f4-4ed5-9471-ad643acbd756 tempest-DeleteServersTestJSON-1084822395 tempest-DeleteServersTestJSON-1084822395-project-member] Enqueued Resource ID: d0e04be7-8718-489c-8ceb-fe661da4855a with Priority: HIGHEST for action security_group_members [ 1191.315057] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d0e04be7-8718-489c-8ceb-fe661da4855a with Priority: HIGHEST for action security_group_members [ 1191.315374] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-d0e04be7-8718-489c-8ceb-fe661da4855a taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1191.315500] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d0e04be7-8718-489c-8ceb-fe661da4855a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1191.315571] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d0e04be7-8718-489c-8ceb-fe661da4855a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1191.315765] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d0e04be7-8718-489c-8ceb-fe661da4855a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1191.315915] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1191.316044] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1191.316106] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1191.316256] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1191.316342] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1191.316433] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d0e04be7-8718-489c-8ceb-fe661da4855a',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1191.672584] env[69980]: INFO networking_nsxv3.common.synchronization [req-1b4cd56f-5f93-407d-bf18-4b4be05d528b req-2b8dedb7-e62a-40dc-965b-b4cca0b8555a service nova] Enqueued Resource ID: 72f0fad5-906a-4ed9-a922-fdb13010a34d with Priority: HIGHEST for action security_group_rules [ 1191.672882] env[69980]: INFO networking_nsxv3.common.synchronization [req-1b4cd56f-5f93-407d-bf18-4b4be05d528b req-2b8dedb7-e62a-40dc-965b-b4cca0b8555a service nova] Enqueued Resource ID: 72f0fad5-906a-4ed9-a922-fdb13010a34d with Priority: HIGHEST for action security_group_members [ 1191.673100] env[69980]: INFO networking_nsxv3.common.synchronization [req-1b4cd56f-5f93-407d-bf18-4b4be05d528b req-2b8dedb7-e62a-40dc-965b-b4cca0b8555a service nova] Enqueued Resource ID: fddb2882-2c68-4648-970d-23736fa5a265 with Priority: HIGHEST for action port [ 1191.673395] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 72f0fad5-906a-4ed9-a922-fdb13010a34d with Priority: HIGHEST for action security_group_rules [ 1191.673559] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 72f0fad5-906a-4ed9-a922-fdb13010a34d with Priority: HIGHEST for action security_group_members [ 1191.673707] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fddb2882-2c68-4648-970d-23736fa5a265 with Priority: HIGHEST for action port [ 1191.674630] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock rules-72f0fad5-906a-4ed9-a922-fdb13010a34d taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1191.674730] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-72f0fad5-906a-4ed9-a922-fdb13010a34d" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1191.674828] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-72f0fad5-906a-4ed9-a922-fdb13010a34d" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1191.675090] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-72f0fad5-906a-4ed9-a922-fdb13010a34d" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1191.675239] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('72f0fad5-906a-4ed9-a922-fdb13010a34d',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1191.676588] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-72f0fad5-906a-4ed9-a922-fdb13010a34d taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1191.677042] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-72f0fad5-906a-4ed9-a922-fdb13010a34d" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1191.677304] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock port-fddb2882-2c68-4648-970d-23736fa5a265 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1191.677448] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fddb2882-2c68-4648-970d-23736fa5a265" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1191.677640] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fddb2882-2c68-4648-970d-23736fa5a265" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1191.677897] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fddb2882-2c68-4648-970d-23736fa5a265" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1191.678023] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fddb2882-2c68-4648-970d-23736fa5a265',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1191.818233] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1191.818387] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1191.818387] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1191.821227] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1191.821227] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1191.821227] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1191.821227] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1191.821227] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1191.821227] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1191.821227] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1191.821227] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d0e04be7-8718-489c-8ceb-fe661da4855a is going to be updated. [ 1191.845852] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1191.846065] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1191.846145] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1191.847359] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1191.847359] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1191.857019] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d0e04be7-8718-489c-8ceb-fe661da4855a in Status: IN_PROGRESS for 2s [ 1191.931763] env[69980]: INFO networking_nsxv3.common.synchronization [req-43f5186d-df18-4b61-be37-e2795b2bba2b req-fe1375a2-33e3-40cf-90cd-3f4e507c4153 tempest-ServersTestJSON-2066262947 tempest-ServersTestJSON-2066262947-project-member] Enqueued Resource ID: 69e79787-6675-42a5-b381-7ffa87e43ee6 with Priority: HIGHEST for action security_group_members [ 1191.932333] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 69e79787-6675-42a5-b381-7ffa87e43ee6 with Priority: HIGHEST for action security_group_members [ 1191.932638] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-69e79787-6675-42a5-b381-7ffa87e43ee6 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1191.932779] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-69e79787-6675-42a5-b381-7ffa87e43ee6" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1191.932868] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-69e79787-6675-42a5-b381-7ffa87e43ee6" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1191.933295] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-69e79787-6675-42a5-b381-7ffa87e43ee6" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1191.933295] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1191.933295] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1191.933431] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1191.933459] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1191.933572] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1191.933614] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('69e79787-6675-42a5-b381-7ffa87e43ee6',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1192.180102] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-72f0fad5-906a-4ed9-a922-fdb13010a34d taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1192.180257] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-72f0fad5-906a-4ed9-a922-fdb13010a34d" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1192.180474] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port fddb2882-2c68-4648-970d-23736fa5a265 with status ACTIVE [ 1192.180651] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1192.180756] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1192.180827] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1192.181046] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1192.181137] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1192.181310] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1192.181409] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1192.181465] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1192.181620] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1192.181699] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1192.181885] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1192.181980] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1192.182053] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1192.182194] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1192.182266] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1192.182352] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: fddb2882-2c68-4648-970d-23736fa5a265 is going to be updated. [ 1192.202239] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1192.202361] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1192.202432] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1192.202622] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1192.202744] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1192.202900] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fddb2882-2c68-4648-970d-23736fa5a265" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1192.378097] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 72f0fad5-906a-4ed9-a922-fdb13010a34d in Status: SUCCESS [ 1192.378413] env[69980]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 72f0fad5-906a-4ed9-a922-fdb13010a34d deletion is rescheduled due to dependency. [ 1192.378413] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-72f0fad5-906a-4ed9-a922-fdb13010a34d" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1192.378616] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-72f0fad5-906a-4ed9-a922-fdb13010a34d" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1192.378762] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-72f0fad5-906a-4ed9-a922-fdb13010a34d" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1192.378947] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1192.379125] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1192.379190] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1192.379847] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1192.379847] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1192.379847] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('72f0fad5-906a-4ed9-a922-fdb13010a34d',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1192.436115] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1192.436400] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1192.436479] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1192.436699] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1192.458430] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1192.458685] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1192.458800] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1192.458866] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1192.459855] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1192.459855] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1192.459855] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 69e79787-6675-42a5-b381-7ffa87e43ee6 is going to be updated. [ 1192.483210] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1192.483372] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1192.483425] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1192.483602] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1192.483738] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1192.489724] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e63cb46c-ccab-4856-bf25-2380514e2780 in Status: SUCCESS [ 1192.489943] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e63cb46c-ccab-4856-bf25-2380514e2780" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1192.490128] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e63cb46c-ccab-4856-bf25-2380514e2780" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1192.490436] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e63cb46c-ccab-4856-bf25-2380514e2780" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1192.490616] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1192.490741] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1192.490741] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1192.491319] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1192.491319] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1192.491319] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e63cb46c-ccab-4856-bf25-2380514e2780" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1192.491319] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e63cb46c-ccab-4856-bf25-2380514e2780',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1192.496841] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 69e79787-6675-42a5-b381-7ffa87e43ee6 in Status: IN_PROGRESS for 2s [ 1192.882155] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('72f0fad5-906a-4ed9-a922-fdb13010a34d',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1192.996575] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-e63cb46c-ccab-4856-bf25-2380514e2780 taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1192.996748] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e63cb46c-ccab-4856-bf25-2380514e2780" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1192.999984] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e63cb46c-ccab-4856-bf25-2380514e2780" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1192.999984] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e63cb46c-ccab-4856-bf25-2380514e2780" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1192.999984] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1192.999984] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1192.999984] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1192.999984] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1192.999984] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1192.999984] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e63cb46c-ccab-4856-bf25-2380514e2780" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1192.999984] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-e63cb46c-ccab-4856-bf25-2380514e2780 taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1192.999984] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e63cb46c-ccab-4856-bf25-2380514e2780" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1192.999984] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e63cb46c-ccab-4856-bf25-2380514e2780" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1192.999984] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e63cb46c-ccab-4856-bf25-2380514e2780" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1192.999984] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1192.999984] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1192.999984] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1192.999984] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1192.999984] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1192.999984] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e63cb46c-ccab-4856-bf25-2380514e2780" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1193.000868] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e63cb46c-ccab-4856-bf25-2380514e2780',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1193.384615] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('72f0fad5-906a-4ed9-a922-fdb13010a34d',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1193.501145] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e63cb46c-ccab-4856-bf25-2380514e2780: rpc.has_security_group_logging(os_id): False [ 1193.518175] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.519653] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.519653] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1193.519653] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1193.519653] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1193.519653] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.519653] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.519653] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1193.519653] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1193.519653] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1193.519653] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.519653] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.519653] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1193.520245] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1193.520245] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1193.520245] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.520245] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.520245] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1193.520384] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1193.520535] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1193.520585] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e63cb46c-ccab-4856-bf25-2380514e2780 is going to be updated. [ 1193.590915] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.591223] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.591223] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1193.591443] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1193.591586] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1193.602740] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e63cb46c-ccab-4856-bf25-2380514e2780 in Status: IN_PROGRESS for 2s [ 1193.868391] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d0e04be7-8718-489c-8ceb-fe661da4855a in Status: SUCCESS [ 1193.868584] env[69980]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d0e04be7-8718-489c-8ceb-fe661da4855a deletion is rescheduled due to dependency. [ 1193.868700] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d0e04be7-8718-489c-8ceb-fe661da4855a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1193.887444] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.887546] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.887587] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1193.887854] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1193.887949] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1193.888054] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 72f0fad5-906a-4ed9-a922-fdb13010a34d is going to be updated. [ 1193.912330] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.912506] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.912582] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1193.912786] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1193.912930] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1193.922260] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 72f0fad5-906a-4ed9-a922-fdb13010a34d in Status: IN_PROGRESS for 2s [ 1194.314867] env[69980]: INFO networking_nsxv3.common.synchronization [req-c3ecf3a4-3f8a-4d1e-b8dd-134264b1cb8f req-53750b76-9aea-4b63-beb5-e223fec99a0d tempest-ServerRescueNegativeTestJSON-1270382253 tempest-ServerRescueNegativeTestJSON-1270382253-project-member] Enqueued Resource ID: c27e63f9-6090-4aea-a9d5-e84fb1046cb3 with Priority: HIGHEST for action security_group_members [ 1194.315441] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c27e63f9-6090-4aea-a9d5-e84fb1046cb3 with Priority: HIGHEST for action security_group_members [ 1194.315767] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-c27e63f9-6090-4aea-a9d5-e84fb1046cb3 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1194.315888] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c27e63f9-6090-4aea-a9d5-e84fb1046cb3" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1194.315976] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c27e63f9-6090-4aea-a9d5-e84fb1046cb3" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1194.316299] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c27e63f9-6090-4aea-a9d5-e84fb1046cb3" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1194.316473] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1194.316572] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1194.317293] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1194.317508] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1194.317605] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1194.317704] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c27e63f9-6090-4aea-a9d5-e84fb1046cb3',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1194.514153] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 69e79787-6675-42a5-b381-7ffa87e43ee6 in Status: SUCCESS [ 1194.514449] env[69980]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 69e79787-6675-42a5-b381-7ffa87e43ee6 deletion is rescheduled due to dependency. [ 1194.514449] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-69e79787-6675-42a5-b381-7ffa87e43ee6" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1194.691492] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock network-988 taken with stack trace [, , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1194.691697] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "network-988" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1194.691826] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "network-988" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1194.692124] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "network-988" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1194.692405] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1194.692570] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1194.692693] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1194.692935] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1194.693097] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1194.693313] env[69980]: DEBUG dogpile.cache.region [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] No value present for key: 'zone-id' {{(pid=69980) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1194.693432] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] NeedRegenerationException {{(pid=69980) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1194.693545] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] no value, waiting for create lock {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1194.693671] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] value creation lock acquired {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1194.693789] env[69980]: DEBUG dogpile.cache.region [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] No value present for key: 'zone-id' {{(pid=69980) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1194.693900] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Calling creation function for not-yet-present value {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1194.694286] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1194.714970] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1194.714970] env[69980]: DEBUG dogpile.cache.region [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=69980) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1194.714970] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Released creation lock {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1194.715143] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "network-988" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1194.715404] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock port-c75069fa-9c78-4336-8e51-763ae90f0c3b taken with stack trace [, , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1194.716292] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "port-c75069fa-9c78-4336-8e51-763ae90f0c3b" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1194.716292] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "port-c75069fa-9c78-4336-8e51-763ae90f0c3b" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1194.716292] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "port-c75069fa-9c78-4336-8e51-763ae90f0c3b" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1194.716292] env[69980]: DEBUG networking_nsxv3.api.rpc [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c75069fa-9c78-4336-8e51-763ae90f0c3b',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1194.821871] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1194.822050] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1194.822089] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1194.822320] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1194.822467] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1194.822735] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1194.822868] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1194.822938] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1194.823126] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1194.823208] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1194.823295] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c27e63f9-6090-4aea-a9d5-e84fb1046cb3 already deleted. [ 1194.823377] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c27e63f9-6090-4aea-a9d5-e84fb1046cb3" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1195.218908] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.219186] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.219319] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1195.219606] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1195.219760] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1195.219922] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Segment Port c75069fa-9c78-4336-8e51-763ae90f0c3b not found, creating... [ 1195.220212] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.220372] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.220540] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1195.220787] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1195.220846] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1195.221130] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.221293] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.221442] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1195.221613] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1195.221777] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1195.221870] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Resource: SegmentPort with ID: c75069fa-9c78-4336-8e51-763ae90f0c3b is going to be created. [ 1195.240873] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.241100] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.241231] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1195.241485] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1195.241708] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1195.241930] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "port-c75069fa-9c78-4336-8e51-763ae90f0c3b" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1195.616879] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e63cb46c-ccab-4856-bf25-2380514e2780 in Status: SUCCESS [ 1195.617253] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e63cb46c-ccab-4856-bf25-2380514e2780" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1195.939040] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 72f0fad5-906a-4ed9-a922-fdb13010a34d in Status: SUCCESS [ 1195.939040] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-72f0fad5-906a-4ed9-a922-fdb13010a34d" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1195.939040] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-72f0fad5-906a-4ed9-a922-fdb13010a34d" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1195.939040] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-72f0fad5-906a-4ed9-a922-fdb13010a34d" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1195.939040] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.939040] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.939040] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1195.939040] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1195.939040] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1195.939040] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-72f0fad5-906a-4ed9-a922-fdb13010a34d" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1195.939040] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('72f0fad5-906a-4ed9-a922-fdb13010a34d',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1196.185088] env[69980]: INFO networking_nsxv3.common.synchronization [req-c3ecf3a4-3f8a-4d1e-b8dd-134264b1cb8f req-fd41b439-4422-42ce-9818-00f4286feb28 service nova] Enqueued Resource ID: c27e63f9-6090-4aea-a9d5-e84fb1046cb3 with Priority: HIGHEST for action security_group_rules [ 1196.185088] env[69980]: INFO networking_nsxv3.common.synchronization [req-c3ecf3a4-3f8a-4d1e-b8dd-134264b1cb8f req-fd41b439-4422-42ce-9818-00f4286feb28 service nova] Enqueued Resource ID: c27e63f9-6090-4aea-a9d5-e84fb1046cb3 with Priority: HIGHEST for action security_group_members [ 1196.185088] env[69980]: INFO networking_nsxv3.common.synchronization [req-c3ecf3a4-3f8a-4d1e-b8dd-134264b1cb8f req-fd41b439-4422-42ce-9818-00f4286feb28 service nova] Enqueued Resource ID: c75069fa-9c78-4336-8e51-763ae90f0c3b with Priority: HIGHEST for action port [ 1196.185088] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c27e63f9-6090-4aea-a9d5-e84fb1046cb3 with Priority: HIGHEST for action security_group_rules [ 1196.185088] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c27e63f9-6090-4aea-a9d5-e84fb1046cb3 with Priority: HIGHEST for action security_group_members [ 1196.185088] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c75069fa-9c78-4336-8e51-763ae90f0c3b with Priority: HIGHEST for action port [ 1196.185088] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c27e63f9-6090-4aea-a9d5-e84fb1046cb3 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1196.185088] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c27e63f9-6090-4aea-a9d5-e84fb1046cb3" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1196.185088] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c27e63f9-6090-4aea-a9d5-e84fb1046cb3" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1196.185675] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c27e63f9-6090-4aea-a9d5-e84fb1046cb3" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1196.185782] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c27e63f9-6090-4aea-a9d5-e84fb1046cb3',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1196.187148] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-c27e63f9-6090-4aea-a9d5-e84fb1046cb3 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1196.187148] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c27e63f9-6090-4aea-a9d5-e84fb1046cb3" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1196.187148] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c27e63f9-6090-4aea-a9d5-e84fb1046cb3" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1196.187148] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c27e63f9-6090-4aea-a9d5-e84fb1046cb3" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1196.187323] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1196.187323] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1196.187323] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1196.187466] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1196.187570] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1196.187672] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c27e63f9-6090-4aea-a9d5-e84fb1046cb3',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1196.188385] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock port-c75069fa-9c78-4336-8e51-763ae90f0c3b taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1196.188505] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c75069fa-9c78-4336-8e51-763ae90f0c3b" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1196.188556] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c75069fa-9c78-4336-8e51-763ae90f0c3b" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1196.188694] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c75069fa-9c78-4336-8e51-763ae90f0c3b" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1196.188761] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c75069fa-9c78-4336-8e51-763ae90f0c3b',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1196.442387] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('72f0fad5-906a-4ed9-a922-fdb13010a34d',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1196.690905] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-c27e63f9-6090-4aea-a9d5-e84fb1046cb3 taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1196.690905] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c27e63f9-6090-4aea-a9d5-e84fb1046cb3" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1196.691262] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c27e63f9-6090-4aea-a9d5-e84fb1046cb3',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1196.692817] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c75069fa-9c78-4336-8e51-763ae90f0c3b with status ACTIVE [ 1196.693087] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1196.693262] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1196.693347] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1196.693602] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1196.693792] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1196.693981] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1196.694123] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1196.694185] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1196.694375] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1196.694459] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1196.694666] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1196.694770] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1196.694867] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1196.695045] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1196.695125] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1196.695223] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c75069fa-9c78-4336-8e51-763ae90f0c3b is going to be updated. [ 1196.714872] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1196.714872] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1196.714872] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1196.714872] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1196.714872] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1196.715199] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c75069fa-9c78-4336-8e51-763ae90f0c3b" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1196.944412] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 72f0fad5-906a-4ed9-a922-fdb13010a34d: rpc.has_security_group_logging(os_id): False [ 1196.962363] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1196.962363] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1196.962363] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1196.962564] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1196.962661] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1196.962946] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1196.963082] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1196.963150] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1196.963310] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1196.963415] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1196.963598] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 72f0fad5-906a-4ed9-a922-fdb13010a34d is going to be updated. [ 1197.020654] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1197.020857] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1197.020857] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1197.021036] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1197.021185] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1197.031889] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 72f0fad5-906a-4ed9-a922-fdb13010a34d in Status: IN_PROGRESS for 2s [ 1197.197822] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c27e63f9-6090-4aea-a9d5-e84fb1046cb3',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1197.700857] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1197.701214] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1197.701284] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1197.701514] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1197.701608] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1197.701708] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c27e63f9-6090-4aea-a9d5-e84fb1046cb3 is going to be created. [ 1197.725291] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1197.725530] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1197.725606] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1197.725867] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1197.726119] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1197.738214] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c27e63f9-6090-4aea-a9d5-e84fb1046cb3 in Status: UNINITIALIZED for 2s [ 1199.043631] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 72f0fad5-906a-4ed9-a922-fdb13010a34d in Status: SUCCESS [ 1199.044947] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-72f0fad5-906a-4ed9-a922-fdb13010a34d" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1199.749386] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c27e63f9-6090-4aea-a9d5-e84fb1046cb3 in Status: SUCCESS [ 1199.749600] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c27e63f9-6090-4aea-a9d5-e84fb1046cb3" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1199.749755] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c27e63f9-6090-4aea-a9d5-e84fb1046cb3" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1199.750074] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c27e63f9-6090-4aea-a9d5-e84fb1046cb3" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1199.750294] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1199.750432] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1199.751036] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1199.751036] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1199.751036] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1199.751036] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c27e63f9-6090-4aea-a9d5-e84fb1046cb3" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1199.751036] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c27e63f9-6090-4aea-a9d5-e84fb1046cb3',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1200.252823] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c27e63f9-6090-4aea-a9d5-e84fb1046cb3',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1200.755433] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c27e63f9-6090-4aea-a9d5-e84fb1046cb3: rpc.has_security_group_logging(os_id): False [ 1200.772641] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1200.772641] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1200.772641] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1200.772813] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1200.772868] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1200.773148] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1200.773250] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1200.773315] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1200.773477] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1200.773563] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1200.773650] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c27e63f9-6090-4aea-a9d5-e84fb1046cb3 is going to be created. [ 1200.828265] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1200.828415] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1200.828488] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1200.828703] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1200.828882] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1200.842277] env[69980]: INFO networking_nsxv3.common.synchronization [req-b0c7956d-f7eb-4080-9cf0-711cd555ed6d req-df206985-60e1-4f53-9096-3fa6d4becbfe tempest-DeleteServersTestJSON-1084822395 tempest-DeleteServersTestJSON-1084822395-project-member] Enqueued Resource ID: d0e04be7-8718-489c-8ceb-fe661da4855a with Priority: HIGHEST for action security_group_members [ 1200.843323] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c27e63f9-6090-4aea-a9d5-e84fb1046cb3 in Status: IN_PROGRESS for 2s [ 1200.844895] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d0e04be7-8718-489c-8ceb-fe661da4855a with Priority: HIGHEST for action security_group_members [ 1200.845393] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-d0e04be7-8718-489c-8ceb-fe661da4855a taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1200.845588] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d0e04be7-8718-489c-8ceb-fe661da4855a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1200.845700] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d0e04be7-8718-489c-8ceb-fe661da4855a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1200.845956] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d0e04be7-8718-489c-8ceb-fe661da4855a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1200.846184] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1200.846339] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1200.846463] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1200.846900] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1200.847072] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1200.847669] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d0e04be7-8718-489c-8ceb-fe661da4855a',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1200.987601] env[69980]: INFO networking_nsxv3.common.synchronization [req-d5bc4655-da2a-41c7-b1e3-2cee9267d195 req-e6a653c5-2d26-44aa-9787-97f65219bed1 tempest-AttachInterfacesTestJSON-1782090316 tempest-AttachInterfacesTestJSON-1782090316-project-member] Enqueued Resource ID: e63cb46c-ccab-4856-bf25-2380514e2780 with Priority: HIGHEST for action security_group_members [ 1200.991618] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e63cb46c-ccab-4856-bf25-2380514e2780 with Priority: HIGHEST for action security_group_members [ 1200.992190] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-e63cb46c-ccab-4856-bf25-2380514e2780 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1200.992456] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e63cb46c-ccab-4856-bf25-2380514e2780" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1200.992640] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e63cb46c-ccab-4856-bf25-2380514e2780" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1200.993043] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e63cb46c-ccab-4856-bf25-2380514e2780" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1200.993307] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1200.993533] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1200.993691] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1200.993964] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1200.994168] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1200.994355] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e63cb46c-ccab-4856-bf25-2380514e2780',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1201.219890] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock network-478 taken with stack trace [, , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1201.220123] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "network-478" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1201.220255] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "network-478" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1201.220527] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "network-478" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1201.220792] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1201.221042] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1201.221406] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1201.221721] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1201.221919] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1201.222211] env[69980]: DEBUG dogpile.cache.region [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] No value present for key: 'zone-id' {{(pid=69980) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1201.222377] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] NeedRegenerationException {{(pid=69980) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1201.222526] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] no value, waiting for create lock {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1201.222693] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] value creation lock acquired {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1201.222967] env[69980]: DEBUG dogpile.cache.region [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] No value present for key: 'zone-id' {{(pid=69980) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1201.223153] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Calling creation function for not-yet-present value {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1201.223328] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1201.245176] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1201.245423] env[69980]: DEBUG dogpile.cache.region [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=69980) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1201.245573] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Released creation lock {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1201.245790] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "network-478" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1201.246149] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock port-9f0ddfe9-4a7a-4ae8-adfd-40bfcabd6350 taken with stack trace [, , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1201.246336] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "port-9f0ddfe9-4a7a-4ae8-adfd-40bfcabd6350" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1201.246468] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "port-9f0ddfe9-4a7a-4ae8-adfd-40bfcabd6350" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1201.246810] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "port-9f0ddfe9-4a7a-4ae8-adfd-40bfcabd6350" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1201.247015] env[69980]: DEBUG networking_nsxv3.api.rpc [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9f0ddfe9-4a7a-4ae8-adfd-40bfcabd6350',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1201.349987] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1201.351464] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1201.351838] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1201.351938] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1201.352094] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1201.352406] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1201.352711] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1201.352711] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1201.353776] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1201.353776] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1201.353776] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d0e04be7-8718-489c-8ceb-fe661da4855a is going to be updated. [ 1201.379299] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1201.379602] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1201.379788] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1201.383286] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1201.383286] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1201.390874] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d0e04be7-8718-489c-8ceb-fe661da4855a in Status: IN_PROGRESS for 2s [ 1201.496145] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e63cb46c-ccab-4856-bf25-2380514e2780',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1201.753026] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1201.753026] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1201.753026] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1201.753026] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1201.753026] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1201.753026] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Segment Port 9f0ddfe9-4a7a-4ae8-adfd-40bfcabd6350 not found, creating... [ 1201.753026] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1201.753026] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1201.753026] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1201.753026] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1201.753026] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1201.753692] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1201.753692] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1201.753692] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1201.753692] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1201.753986] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1201.754264] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Resource: SegmentPort with ID: 9f0ddfe9-4a7a-4ae8-adfd-40bfcabd6350 is going to be created. [ 1201.774418] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1201.774860] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1201.775113] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1201.775471] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1201.775822] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1201.776170] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "port-9f0ddfe9-4a7a-4ae8-adfd-40bfcabd6350" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1201.915013] env[69980]: INFO networking_nsxv3.common.synchronization [None req-e042d13b-c53b-476a-8a78-aeb514cc8786 tempest-AttachInterfacesTestJSON-1782090316 tempest-AttachInterfacesTestJSON-1782090316-project-member] Enqueued Resource ID: e63cb46c-ccab-4856-bf25-2380514e2780 with Priority: HIGHEST for action security_group_members [ 1201.915577] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e63cb46c-ccab-4856-bf25-2380514e2780 with Priority: HIGHEST for action security_group_members [ 1201.915880] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-e63cb46c-ccab-4856-bf25-2380514e2780 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1201.915986] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e63cb46c-ccab-4856-bf25-2380514e2780" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1201.999335] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e63cb46c-ccab-4856-bf25-2380514e2780',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1202.501783] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1202.502196] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1202.502196] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1202.502297] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1202.502342] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1202.502423] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e63cb46c-ccab-4856-bf25-2380514e2780 is going to be updated. [ 1202.528761] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1202.528761] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1202.528761] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1202.528951] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1202.529081] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1202.539025] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e63cb46c-ccab-4856-bf25-2380514e2780 in Status: IN_PROGRESS for 2s [ 1202.641679] env[69980]: INFO networking_nsxv3.common.synchronization [None req-f1b25327-6c86-4405-8bf0-33a615743f97 None None] Enqueued Resource ID: b8943584-7577-4f71-b66a-263c83d6d032 with Priority: HIGHEST for action port [ 1202.641679] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b8943584-7577-4f71-b66a-263c83d6d032 with Priority: HIGHEST for action port [ 1202.641928] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock port-b8943584-7577-4f71-b66a-263c83d6d032 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1202.642079] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b8943584-7577-4f71-b66a-263c83d6d032" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1202.642146] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b8943584-7577-4f71-b66a-263c83d6d032" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1202.642495] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b8943584-7577-4f71-b66a-263c83d6d032" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1202.642584] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b8943584-7577-4f71-b66a-263c83d6d032',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1202.854282] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c27e63f9-6090-4aea-a9d5-e84fb1046cb3 in Status: SUCCESS [ 1202.854512] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c27e63f9-6090-4aea-a9d5-e84fb1046cb3" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1203.147542] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b8943584-7577-4f71-b66a-263c83d6d032 [ 1203.147833] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1203.148026] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1203.148146] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1203.148402] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1203.148509] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1203.148632] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b8943584-7577-4f71-b66a-263c83d6d032 already deleted. [ 1203.148728] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b8943584-7577-4f71-b66a-263c83d6d032" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1203.399140] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d0e04be7-8718-489c-8ceb-fe661da4855a in Status: SUCCESS [ 1203.399520] env[69980]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d0e04be7-8718-489c-8ceb-fe661da4855a deletion is rescheduled due to dependency. [ 1203.399684] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d0e04be7-8718-489c-8ceb-fe661da4855a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1203.405019] env[69980]: INFO networking_nsxv3.common.synchronization [req-b0c7956d-f7eb-4080-9cf0-711cd555ed6d req-aa101e70-2954-4836-90f9-9e65bd832239 service nova] Enqueued Resource ID: d0e04be7-8718-489c-8ceb-fe661da4855a with Priority: HIGHEST for action security_group_rules [ 1203.405225] env[69980]: INFO networking_nsxv3.common.synchronization [req-b0c7956d-f7eb-4080-9cf0-711cd555ed6d req-aa101e70-2954-4836-90f9-9e65bd832239 service nova] Enqueued Resource ID: d0e04be7-8718-489c-8ceb-fe661da4855a with Priority: HIGHEST for action security_group_members [ 1203.405367] env[69980]: INFO networking_nsxv3.common.synchronization [req-b0c7956d-f7eb-4080-9cf0-711cd555ed6d req-aa101e70-2954-4836-90f9-9e65bd832239 service nova] Enqueued Resource ID: 9f0ddfe9-4a7a-4ae8-adfd-40bfcabd6350 with Priority: HIGHEST for action port [ 1203.405591] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d0e04be7-8718-489c-8ceb-fe661da4855a with Priority: HIGHEST for action security_group_rules [ 1203.405717] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d0e04be7-8718-489c-8ceb-fe661da4855a with Priority: HIGHEST for action security_group_members [ 1203.405812] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9f0ddfe9-4a7a-4ae8-adfd-40bfcabd6350 with Priority: HIGHEST for action port [ 1203.406371] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d0e04be7-8718-489c-8ceb-fe661da4855a taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1203.406495] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d0e04be7-8718-489c-8ceb-fe661da4855a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1203.406562] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d0e04be7-8718-489c-8ceb-fe661da4855a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1203.406753] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d0e04be7-8718-489c-8ceb-fe661da4855a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1203.406831] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d0e04be7-8718-489c-8ceb-fe661da4855a',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1203.407773] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-d0e04be7-8718-489c-8ceb-fe661da4855a taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1203.411098] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d0e04be7-8718-489c-8ceb-fe661da4855a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1203.411195] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d0e04be7-8718-489c-8ceb-fe661da4855a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1203.411382] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d0e04be7-8718-489c-8ceb-fe661da4855a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1203.411541] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1203.411640] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1203.411703] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1203.411849] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1203.411933] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1203.412033] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d0e04be7-8718-489c-8ceb-fe661da4855a',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1203.413253] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock port-9f0ddfe9-4a7a-4ae8-adfd-40bfcabd6350 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1203.413350] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9f0ddfe9-4a7a-4ae8-adfd-40bfcabd6350" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1203.413350] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9f0ddfe9-4a7a-4ae8-adfd-40bfcabd6350" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1203.413488] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9f0ddfe9-4a7a-4ae8-adfd-40bfcabd6350" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1203.413757] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9f0ddfe9-4a7a-4ae8-adfd-40bfcabd6350',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1203.917384] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d0e04be7-8718-489c-8ceb-fe661da4855a',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1203.918782] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-d0e04be7-8718-489c-8ceb-fe661da4855a taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1203.918914] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d0e04be7-8718-489c-8ceb-fe661da4855a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1203.918999] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 9f0ddfe9-4a7a-4ae8-adfd-40bfcabd6350 with status ACTIVE [ 1203.921420] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1203.921420] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1203.921420] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1203.921420] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1203.921420] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1203.921420] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1203.921420] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1203.921420] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1203.921420] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1203.921420] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1203.921420] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1203.921420] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1203.921420] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1203.921420] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1203.921420] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1203.921420] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 9f0ddfe9-4a7a-4ae8-adfd-40bfcabd6350 is going to be updated. [ 1203.941906] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1203.942064] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1203.942139] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1203.942343] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1203.942475] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1203.942634] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9f0ddfe9-4a7a-4ae8-adfd-40bfcabd6350" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1204.422708] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d0e04be7-8718-489c-8ceb-fe661da4855a',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1204.545481] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e63cb46c-ccab-4856-bf25-2380514e2780 in Status: SUCCESS [ 1204.545716] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e63cb46c-ccab-4856-bf25-2380514e2780" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1204.545881] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e63cb46c-ccab-4856-bf25-2380514e2780" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1204.546126] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e63cb46c-ccab-4856-bf25-2380514e2780" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1204.546316] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1204.546434] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1204.546492] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1204.546650] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1204.546733] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1204.546827] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e63cb46c-ccab-4856-bf25-2380514e2780',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1204.606114] env[69980]: INFO networking_nsxv3.common.synchronization [req-a4c3ee95-3966-4259-9aad-5febe1d8de3c req-cec95b3e-7545-4440-8c6b-c2f784567b28 tempest-AttachInterfacesTestJSON-1782090316 tempest-AttachInterfacesTestJSON-1782090316-project-member] Enqueued Resource ID: 400b642e-7f7e-4993-9916-a3e96af018da with Priority: HIGHEST for action security_group_members [ 1204.606748] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 400b642e-7f7e-4993-9916-a3e96af018da with Priority: HIGHEST for action security_group_members [ 1204.607205] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-400b642e-7f7e-4993-9916-a3e96af018da taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1204.607969] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-400b642e-7f7e-4993-9916-a3e96af018da" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1204.607969] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-400b642e-7f7e-4993-9916-a3e96af018da" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1204.607969] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-400b642e-7f7e-4993-9916-a3e96af018da" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1204.607969] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1204.608360] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1204.608516] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1204.609778] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1204.609778] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1204.609778] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('400b642e-7f7e-4993-9916-a3e96af018da',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1204.640420] env[69980]: INFO networking_nsxv3.common.synchronization [None req-01675cf1-6448-4533-81ea-807267d3e864 None None] Enqueued Resource ID: 7692d696-860e-4311-b8c7-e472b2a482ab with Priority: HIGHEST for action port [ 1204.640420] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7692d696-860e-4311-b8c7-e472b2a482ab with Priority: HIGHEST for action port [ 1204.640420] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock port-7692d696-860e-4311-b8c7-e472b2a482ab taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1204.640420] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7692d696-860e-4311-b8c7-e472b2a482ab" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1204.640420] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7692d696-860e-4311-b8c7-e472b2a482ab" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1204.640420] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7692d696-860e-4311-b8c7-e472b2a482ab" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1204.640420] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7692d696-860e-4311-b8c7-e472b2a482ab',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1204.928631] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1204.928962] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1204.928962] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1204.929083] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1204.929174] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1204.929273] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d0e04be7-8718-489c-8ceb-fe661da4855a is going to be updated. [ 1204.956381] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1204.956520] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1204.956593] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1204.956813] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1204.956993] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1204.965580] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d0e04be7-8718-489c-8ceb-fe661da4855a in Status: IN_PROGRESS for 2s [ 1205.052017] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1205.052017] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1205.052017] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1205.052017] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1205.052017] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1205.052017] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1205.052017] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1205.052017] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1205.052017] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1205.052017] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1205.052017] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e63cb46c-ccab-4856-bf25-2380514e2780 is going to be updated. [ 1205.076805] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1205.076947] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1205.077050] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1205.077260] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1205.077397] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1205.085705] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e63cb46c-ccab-4856-bf25-2380514e2780 in Status: IN_PROGRESS for 2s [ 1205.111307] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1205.111465] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1205.111580] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1205.111726] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1205.133104] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1205.133364] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1205.133478] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1205.133540] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1205.133738] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1205.133815] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1205.133959] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 400b642e-7f7e-4993-9916-a3e96af018da is going to be updated. [ 1205.142580] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 7692d696-860e-4311-b8c7-e472b2a482ab [ 1205.143819] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1205.143819] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1205.143819] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1205.143819] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1205.143819] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1205.143819] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:7692d696-860e-4311-b8c7-e472b2a482ab already deleted. [ 1205.143819] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7692d696-860e-4311-b8c7-e472b2a482ab" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1205.157606] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1205.157740] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1205.157800] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1205.158043] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1205.158180] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1205.165896] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 400b642e-7f7e-4993-9916-a3e96af018da in Status: IN_PROGRESS for 2s [ 1206.975094] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d0e04be7-8718-489c-8ceb-fe661da4855a in Status: SUCCESS [ 1206.975446] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d0e04be7-8718-489c-8ceb-fe661da4855a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1206.975561] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d0e04be7-8718-489c-8ceb-fe661da4855a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1206.975829] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d0e04be7-8718-489c-8ceb-fe661da4855a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1206.976090] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1206.976247] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1206.976336] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1206.976556] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1206.976667] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1206.976783] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d0e04be7-8718-489c-8ceb-fe661da4855a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1206.976903] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d0e04be7-8718-489c-8ceb-fe661da4855a',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1207.094262] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e63cb46c-ccab-4856-bf25-2380514e2780 in Status: SUCCESS [ 1207.094467] env[69980]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e63cb46c-ccab-4856-bf25-2380514e2780 deletion is rescheduled due to dependency. [ 1207.094542] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e63cb46c-ccab-4856-bf25-2380514e2780" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1207.175281] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 400b642e-7f7e-4993-9916-a3e96af018da in Status: SUCCESS [ 1207.175281] env[69980]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 400b642e-7f7e-4993-9916-a3e96af018da deletion is rescheduled due to dependency. [ 1207.175491] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-400b642e-7f7e-4993-9916-a3e96af018da" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1207.479684] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-d0e04be7-8718-489c-8ceb-fe661da4855a taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1207.479868] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d0e04be7-8718-489c-8ceb-fe661da4855a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1207.479910] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d0e04be7-8718-489c-8ceb-fe661da4855a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1207.480168] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d0e04be7-8718-489c-8ceb-fe661da4855a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1207.480349] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1207.480567] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1207.480633] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1207.480793] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1207.480880] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1207.480970] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d0e04be7-8718-489c-8ceb-fe661da4855a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1207.481135] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-d0e04be7-8718-489c-8ceb-fe661da4855a taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1207.481229] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d0e04be7-8718-489c-8ceb-fe661da4855a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1207.481290] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d0e04be7-8718-489c-8ceb-fe661da4855a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1207.481430] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d0e04be7-8718-489c-8ceb-fe661da4855a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1207.481565] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1207.481656] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1207.481715] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1207.481849] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1207.481923] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1207.482013] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d0e04be7-8718-489c-8ceb-fe661da4855a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1207.482105] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d0e04be7-8718-489c-8ceb-fe661da4855a',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1207.984676] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d0e04be7-8718-489c-8ceb-fe661da4855a: rpc.has_security_group_logging(os_id): False [ 1208.001064] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1208.001271] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1208.001271] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1208.001493] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1208.001603] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1208.001840] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1208.001941] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1208.002012] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1208.002194] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1208.002309] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1208.002438] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1208.002530] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1208.002592] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1208.002729] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1208.002803] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1208.002981] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1208.003090] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1208.003207] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1208.003290] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1208.003363] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1208.003446] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d0e04be7-8718-489c-8ceb-fe661da4855a is going to be updated. [ 1208.059684] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1208.059894] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1208.059894] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1208.060183] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1208.060399] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1208.072558] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d0e04be7-8718-489c-8ceb-fe661da4855a in Status: IN_PROGRESS for 2s [ 1208.818378] env[69980]: INFO networking_nsxv3.common.synchronization [req-a2a2f69b-b86c-4109-b4f7-02abf9947fbb req-b5ad188f-7b6f-463b-b234-2ab7e309a2bf tempest-InstanceActionsV221TestJSON-1918617330 tempest-InstanceActionsV221TestJSON-1918617330-project-member] Enqueued Resource ID: 8f760c98-a5b2-4500-9310-d081ef00461d with Priority: HIGHEST for action security_group_members [ 1208.818889] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8f760c98-a5b2-4500-9310-d081ef00461d with Priority: HIGHEST for action security_group_members [ 1208.819202] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-8f760c98-a5b2-4500-9310-d081ef00461d taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1208.819349] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8f760c98-a5b2-4500-9310-d081ef00461d" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1208.819427] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8f760c98-a5b2-4500-9310-d081ef00461d" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1208.819689] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8f760c98-a5b2-4500-9310-d081ef00461d" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1208.819848] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1208.819950] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1208.820023] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1208.820177] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1208.820265] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1208.820358] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8f760c98-a5b2-4500-9310-d081ef00461d',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1209.097324] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock network-892 taken with stack trace [, , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1209.097641] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "network-892" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1209.097677] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "network-892" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1209.098046] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "network-892" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1209.098309] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1209.098475] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1209.098593] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1209.098821] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1209.098969] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1209.099198] env[69980]: DEBUG dogpile.cache.region [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] No value present for key: 'zone-id' {{(pid=69980) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1209.099321] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] NeedRegenerationException {{(pid=69980) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1209.099447] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] no value, waiting for create lock {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1209.099562] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] value creation lock acquired {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1209.099678] env[69980]: DEBUG dogpile.cache.region [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] No value present for key: 'zone-id' {{(pid=69980) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1209.099789] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Calling creation function for not-yet-present value {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1209.099924] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1209.118440] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1209.118625] env[69980]: DEBUG dogpile.cache.region [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=69980) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1209.118778] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Released creation lock {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1209.118952] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "network-892" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1209.119277] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock port-60c74687-9741-467e-b416-4811ad7986f1 taken with stack trace [, , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1209.119438] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "port-60c74687-9741-467e-b416-4811ad7986f1" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1209.119560] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "port-60c74687-9741-467e-b416-4811ad7986f1" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1209.119866] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "port-60c74687-9741-467e-b416-4811ad7986f1" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1209.120020] env[69980]: DEBUG networking_nsxv3.api.rpc [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('60c74687-9741-467e-b416-4811ad7986f1',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1209.322854] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1209.323081] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1209.323184] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1209.323442] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1209.323569] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1209.323838] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1209.323962] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1209.324027] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1209.324364] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1209.324364] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1209.324442] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8f760c98-a5b2-4500-9310-d081ef00461d already deleted. [ 1209.324476] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8f760c98-a5b2-4500-9310-d081ef00461d" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1209.621814] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1209.622071] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1209.622208] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1209.622506] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1209.622653] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1209.622809] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Segment Port 60c74687-9741-467e-b416-4811ad7986f1 not found, creating... [ 1209.623091] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1209.623525] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1209.623525] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1209.623623] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1209.623722] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1209.624016] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1209.624179] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1209.624300] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1209.624508] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1209.624645] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1209.624787] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Resource: SegmentPort with ID: 60c74687-9741-467e-b416-4811ad7986f1 is going to be created. [ 1209.643871] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1209.644097] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1209.644290] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1209.644590] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1209.644823] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1209.645101] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "port-60c74687-9741-467e-b416-4811ad7986f1" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1210.090618] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d0e04be7-8718-489c-8ceb-fe661da4855a in Status: SUCCESS [ 1210.090842] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d0e04be7-8718-489c-8ceb-fe661da4855a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1210.336810] env[69980]: INFO networking_nsxv3.common.synchronization [req-a2a2f69b-b86c-4109-b4f7-02abf9947fbb req-522bea14-5a3b-4a81-beaa-24c78f133b4b service nova] Enqueued Resource ID: 8f760c98-a5b2-4500-9310-d081ef00461d with Priority: HIGHEST for action security_group_rules [ 1210.337177] env[69980]: INFO networking_nsxv3.common.synchronization [req-a2a2f69b-b86c-4109-b4f7-02abf9947fbb req-522bea14-5a3b-4a81-beaa-24c78f133b4b service nova] Enqueued Resource ID: 8f760c98-a5b2-4500-9310-d081ef00461d with Priority: HIGHEST for action security_group_members [ 1210.337177] env[69980]: INFO networking_nsxv3.common.synchronization [req-a2a2f69b-b86c-4109-b4f7-02abf9947fbb req-522bea14-5a3b-4a81-beaa-24c78f133b4b service nova] Enqueued Resource ID: 60c74687-9741-467e-b416-4811ad7986f1 with Priority: HIGHEST for action port [ 1210.337442] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8f760c98-a5b2-4500-9310-d081ef00461d with Priority: HIGHEST for action security_group_rules [ 1210.337567] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8f760c98-a5b2-4500-9310-d081ef00461d with Priority: HIGHEST for action security_group_members [ 1210.337829] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 60c74687-9741-467e-b416-4811ad7986f1 with Priority: HIGHEST for action port [ 1210.338282] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8f760c98-a5b2-4500-9310-d081ef00461d taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.338451] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8f760c98-a5b2-4500-9310-d081ef00461d" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1210.338451] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8f760c98-a5b2-4500-9310-d081ef00461d" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1210.338758] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8f760c98-a5b2-4500-9310-d081ef00461d" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1210.338836] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8f760c98-a5b2-4500-9310-d081ef00461d',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1210.340768] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-8f760c98-a5b2-4500-9310-d081ef00461d taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.340768] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8f760c98-a5b2-4500-9310-d081ef00461d" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1210.340768] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8f760c98-a5b2-4500-9310-d081ef00461d" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1210.341271] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8f760c98-a5b2-4500-9310-d081ef00461d" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1210.341271] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.341271] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1210.341271] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1210.341400] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1210.341485] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1210.341634] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8f760c98-a5b2-4500-9310-d081ef00461d',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1210.342569] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock port-60c74687-9741-467e-b416-4811ad7986f1 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.342725] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-60c74687-9741-467e-b416-4811ad7986f1" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1210.342832] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-60c74687-9741-467e-b416-4811ad7986f1" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1210.343698] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-60c74687-9741-467e-b416-4811ad7986f1" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1210.343698] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('60c74687-9741-467e-b416-4811ad7986f1',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1210.845587] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-8f760c98-a5b2-4500-9310-d081ef00461d taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.845732] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8f760c98-a5b2-4500-9310-d081ef00461d" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1210.846552] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 60c74687-9741-467e-b416-4811ad7986f1 with status ACTIVE [ 1210.846552] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.846552] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1210.846552] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1210.846813] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1210.846813] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1210.847027] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.847196] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1210.847316] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1210.848033] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1210.848033] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1210.848033] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.848033] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1210.848033] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1210.848263] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1210.848263] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1210.848364] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 60c74687-9741-467e-b416-4811ad7986f1 is going to be updated. [ 1210.849444] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8f760c98-a5b2-4500-9310-d081ef00461d',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1210.869242] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.869442] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1210.869492] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1210.869671] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1210.869827] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1210.869991] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-60c74687-9741-467e-b416-4811ad7986f1" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1211.353884] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8f760c98-a5b2-4500-9310-d081ef00461d',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1211.484919] env[69980]: INFO networking_nsxv3.common.synchronization [None req-139c3c54-a9ee-4d21-b731-aaac0ad6f3d0 tempest-AttachInterfacesTestJSON-1782090316 tempest-AttachInterfacesTestJSON-1782090316-project-member] Enqueued Resource ID: 1f8e99ba-e1d1-4cdc-98f5-ccb8c37ca66e with Priority: HIGHEST for action security_group_rules [ 1211.485470] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1f8e99ba-e1d1-4cdc-98f5-ccb8c37ca66e with Priority: HIGHEST for action security_group_rules [ 1211.485774] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1f8e99ba-e1d1-4cdc-98f5-ccb8c37ca66e taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1211.485894] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1f8e99ba-e1d1-4cdc-98f5-ccb8c37ca66e" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1211.485976] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1f8e99ba-e1d1-4cdc-98f5-ccb8c37ca66e" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1211.486351] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1f8e99ba-e1d1-4cdc-98f5-ccb8c37ca66e" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1211.486440] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1f8e99ba-e1d1-4cdc-98f5-ccb8c37ca66e',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1211.570053] env[69980]: INFO networking_nsxv3.common.synchronization [None req-3684c10f-ccdf-407f-bfe3-dd35f99887dc tempest-AttachInterfacesTestJSON-1782090316 tempest-AttachInterfacesTestJSON-1782090316-project-member] Enqueued Resource ID: 1f8e99ba-e1d1-4cdc-98f5-ccb8c37ca66e with Priority: HIGHEST for action security_group_rules [ 1211.570053] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1f8e99ba-e1d1-4cdc-98f5-ccb8c37ca66e with Priority: HIGHEST for action security_group_rules [ 1211.570053] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1f8e99ba-e1d1-4cdc-98f5-ccb8c37ca66e taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1211.570053] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1f8e99ba-e1d1-4cdc-98f5-ccb8c37ca66e" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1211.856526] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1211.856707] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1211.856766] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1211.856989] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1211.857146] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1211.857254] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8f760c98-a5b2-4500-9310-d081ef00461d is going to be created. [ 1211.879123] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1211.879278] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1211.879331] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1211.879743] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1211.880091] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1211.888831] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8f760c98-a5b2-4500-9310-d081ef00461d in Status: UNINITIALIZED for 2s [ 1212.006902] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1212.006902] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1212.006902] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1212.006902] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1212.006902] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1212.006902] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1f8e99ba-e1d1-4cdc-98f5-ccb8c37ca66e already deleted. [ 1212.006902] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1f8e99ba-e1d1-4cdc-98f5-ccb8c37ca66e" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1212.006902] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1f8e99ba-e1d1-4cdc-98f5-ccb8c37ca66e" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1212.007279] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1f8e99ba-e1d1-4cdc-98f5-ccb8c37ca66e" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1212.007279] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1f8e99ba-e1d1-4cdc-98f5-ccb8c37ca66e',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1212.527392] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1212.527686] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1212.527686] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1212.527819] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1212.527885] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1212.527977] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1f8e99ba-e1d1-4cdc-98f5-ccb8c37ca66e already deleted. [ 1212.528528] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1f8e99ba-e1d1-4cdc-98f5-ccb8c37ca66e" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1213.898250] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8f760c98-a5b2-4500-9310-d081ef00461d in Status: SUCCESS [ 1213.898594] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8f760c98-a5b2-4500-9310-d081ef00461d" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1213.898842] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8f760c98-a5b2-4500-9310-d081ef00461d" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1213.899185] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8f760c98-a5b2-4500-9310-d081ef00461d" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1213.899528] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1213.899679] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1213.899752] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1213.899937] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1213.900034] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1213.900133] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8f760c98-a5b2-4500-9310-d081ef00461d" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1213.900226] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('8f760c98-a5b2-4500-9310-d081ef00461d',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1214.403085] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-8f760c98-a5b2-4500-9310-d081ef00461d taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1214.403347] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8f760c98-a5b2-4500-9310-d081ef00461d" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1214.403347] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8f760c98-a5b2-4500-9310-d081ef00461d" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1214.403547] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8f760c98-a5b2-4500-9310-d081ef00461d" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1214.403762] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1214.403919] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1214.404029] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1214.404176] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1214.404298] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1214.404412] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8f760c98-a5b2-4500-9310-d081ef00461d" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1214.404572] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-8f760c98-a5b2-4500-9310-d081ef00461d taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1214.404667] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8f760c98-a5b2-4500-9310-d081ef00461d" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1214.404727] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8f760c98-a5b2-4500-9310-d081ef00461d" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1214.404879] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8f760c98-a5b2-4500-9310-d081ef00461d" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1214.405106] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1214.405204] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1214.405204] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1214.405349] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1214.405450] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1214.405519] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8f760c98-a5b2-4500-9310-d081ef00461d" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1214.405588] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('8f760c98-a5b2-4500-9310-d081ef00461d',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1214.908907] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 8f760c98-a5b2-4500-9310-d081ef00461d: rpc.has_security_group_logging(os_id): False [ 1214.926935] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1214.927204] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1214.927266] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1214.927471] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1214.927571] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1214.927795] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1214.927928] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1214.928098] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1214.928169] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1214.928230] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1214.928426] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1214.928521] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1214.928592] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1214.928753] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1214.928849] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1214.929125] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1214.929238] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1214.929304] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1214.929452] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1214.929530] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1214.929636] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8f760c98-a5b2-4500-9310-d081ef00461d is going to be created. [ 1214.980969] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1214.981207] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1214.981207] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1214.981406] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1214.981590] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1214.990835] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8f760c98-a5b2-4500-9310-d081ef00461d in Status: IN_PROGRESS for 2s [ 1216.570721] env[69980]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1216.571106] env[69980]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1216.800863] env[69980]: INFO networking_nsxv3.common.synchronization [req-165c30a8-c276-4324-81eb-d656fc98b9f9 req-2a1ab511-782f-4122-bcb2-58622da32e1f tempest-AttachInterfacesUnderV243Test-838011731 tempest-AttachInterfacesUnderV243Test-838011731-project-member] Enqueued Resource ID: 142d9057-bcb0-4a21-b68c-c89aa62897bf with Priority: HIGHEST for action security_group_members [ 1216.800863] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 142d9057-bcb0-4a21-b68c-c89aa62897bf with Priority: HIGHEST for action security_group_members [ 1216.800863] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-142d9057-bcb0-4a21-b68c-c89aa62897bf taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1216.804308] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-142d9057-bcb0-4a21-b68c-c89aa62897bf" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1216.804437] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-142d9057-bcb0-4a21-b68c-c89aa62897bf" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1216.804651] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-142d9057-bcb0-4a21-b68c-c89aa62897bf" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1216.804836] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1216.804963] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1216.805342] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1216.805342] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1216.805342] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1216.805530] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('142d9057-bcb0-4a21-b68c-c89aa62897bf',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1216.826021] env[69980]: INFO networking_nsxv3.common.synchronization [req-165c30a8-c276-4324-81eb-d656fc98b9f9 req-2a1ab511-782f-4122-bcb2-58622da32e1f tempest-AttachInterfacesUnderV243Test-838011731 tempest-AttachInterfacesUnderV243Test-838011731-project-member] Enqueued Resource ID: 142d9057-bcb0-4a21-b68c-c89aa62897bf with Priority: HIGHEST for action security_group_rules [ 1216.826021] env[69980]: INFO networking_nsxv3.common.synchronization [req-165c30a8-c276-4324-81eb-d656fc98b9f9 req-2a1ab511-782f-4122-bcb2-58622da32e1f tempest-AttachInterfacesUnderV243Test-838011731 tempest-AttachInterfacesUnderV243Test-838011731-project-member] Enqueued Resource ID: 142d9057-bcb0-4a21-b68c-c89aa62897bf with Priority: HIGHEST for action security_group_members [ 1216.826021] env[69980]: INFO networking_nsxv3.common.synchronization [req-165c30a8-c276-4324-81eb-d656fc98b9f9 req-2a1ab511-782f-4122-bcb2-58622da32e1f tempest-AttachInterfacesUnderV243Test-838011731 tempest-AttachInterfacesUnderV243Test-838011731-project-member] Enqueued Resource ID: 34175dd9-72ca-491c-b458-ce73e251edac with Priority: HIGHEST for action port [ 1216.826021] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 142d9057-bcb0-4a21-b68c-c89aa62897bf with Priority: HIGHEST for action security_group_rules [ 1216.826021] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 142d9057-bcb0-4a21-b68c-c89aa62897bf with Priority: HIGHEST for action security_group_members [ 1216.826021] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 34175dd9-72ca-491c-b458-ce73e251edac with Priority: HIGHEST for action port [ 1216.826021] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock rules-142d9057-bcb0-4a21-b68c-c89aa62897bf taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1216.826021] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-142d9057-bcb0-4a21-b68c-c89aa62897bf" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1216.826021] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-142d9057-bcb0-4a21-b68c-c89aa62897bf" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1216.826803] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-142d9057-bcb0-4a21-b68c-c89aa62897bf" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1216.826957] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('142d9057-bcb0-4a21-b68c-c89aa62897bf',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1216.827949] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-142d9057-bcb0-4a21-b68c-c89aa62897bf taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1216.828367] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-142d9057-bcb0-4a21-b68c-c89aa62897bf" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1216.828670] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock port-34175dd9-72ca-491c-b458-ce73e251edac taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1216.829468] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-34175dd9-72ca-491c-b458-ce73e251edac" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1216.829639] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-34175dd9-72ca-491c-b458-ce73e251edac" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1216.829908] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-34175dd9-72ca-491c-b458-ce73e251edac" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1216.830399] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('34175dd9-72ca-491c-b458-ce73e251edac',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1217.003393] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8f760c98-a5b2-4500-9310-d081ef00461d in Status: SUCCESS [ 1217.003731] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8f760c98-a5b2-4500-9310-d081ef00461d" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1217.231291] env[69980]: INFO networking_nsxv3.common.synchronization [req-88237d81-81f4-403b-9c83-dee847394dc4 req-4796e865-1d51-450b-baec-a3b266171d21 tempest-AttachInterfacesTestJSON-1782090316 tempest-AttachInterfacesTestJSON-1782090316-project-member] Enqueued Resource ID: 1f8e99ba-e1d1-4cdc-98f5-ccb8c37ca66e with Priority: HIGHEST for action security_group_members [ 1217.231878] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1f8e99ba-e1d1-4cdc-98f5-ccb8c37ca66e with Priority: HIGHEST for action security_group_members [ 1217.232228] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-1f8e99ba-e1d1-4cdc-98f5-ccb8c37ca66e taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1217.232364] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1f8e99ba-e1d1-4cdc-98f5-ccb8c37ca66e" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1217.232428] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1f8e99ba-e1d1-4cdc-98f5-ccb8c37ca66e" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1217.232679] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1f8e99ba-e1d1-4cdc-98f5-ccb8c37ca66e" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1217.232840] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1217.232937] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1217.232999] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1217.233169] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1217.233254] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1217.233345] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1f8e99ba-e1d1-4cdc-98f5-ccb8c37ca66e',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1217.308383] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('142d9057-bcb0-4a21-b68c-c89aa62897bf',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1217.333101] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-142d9057-bcb0-4a21-b68c-c89aa62897bf taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1217.333319] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-142d9057-bcb0-4a21-b68c-c89aa62897bf" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1217.333558] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 34175dd9-72ca-491c-b458-ce73e251edac with status ACTIVE [ 1217.333781] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1217.333910] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1217.333969] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1217.334259] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1217.334368] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1217.334568] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1217.334698] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1217.334807] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1217.335033] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1217.335125] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1217.335324] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1217.335418] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1217.335477] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1217.335640] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1217.335748] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1217.335859] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 34175dd9-72ca-491c-b458-ce73e251edac is going to be updated. [ 1217.356877] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1217.357159] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1217.357432] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1217.357546] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1217.357610] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1217.357853] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-34175dd9-72ca-491c-b458-ce73e251edac" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1217.735956] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1217.736445] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1217.736445] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1217.736445] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1217.736618] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1217.736752] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1217.736872] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1217.736954] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1217.737191] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1217.737282] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1217.737386] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1f8e99ba-e1d1-4cdc-98f5-ccb8c37ca66e already deleted. [ 1217.737482] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1f8e99ba-e1d1-4cdc-98f5-ccb8c37ca66e" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1217.763479] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock network-762 taken with stack trace [, , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1217.763708] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "network-762" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1217.763808] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "network-762" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1217.764126] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "network-762" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1217.764510] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1217.764679] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1217.764802] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1217.765109] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1217.765254] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1217.765469] env[69980]: DEBUG dogpile.cache.region [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] No value present for key: 'zone-id' {{(pid=69980) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1217.765584] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] NeedRegenerationException {{(pid=69980) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1217.765697] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] no value, waiting for create lock {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1217.765807] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] value creation lock acquired {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1217.765919] env[69980]: DEBUG dogpile.cache.region [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] No value present for key: 'zone-id' {{(pid=69980) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1217.766197] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Calling creation function for not-yet-present value {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1217.766307] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1217.785670] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1217.785895] env[69980]: DEBUG dogpile.cache.region [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=69980) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1217.786132] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Released creation lock {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1217.786451] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "network-762" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1217.786754] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock port-dc8bb96b-48fa-4729-9e03-18f4f125f8af taken with stack trace [, , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1217.786984] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "port-dc8bb96b-48fa-4729-9e03-18f4f125f8af" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1217.787543] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "port-dc8bb96b-48fa-4729-9e03-18f4f125f8af" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1217.787630] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "port-dc8bb96b-48fa-4729-9e03-18f4f125f8af" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1217.787738] env[69980]: DEBUG networking_nsxv3.api.rpc [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('dc8bb96b-48fa-4729-9e03-18f4f125f8af',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1217.810548] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('142d9057-bcb0-4a21-b68c-c89aa62897bf',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1218.290861] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1218.291159] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1218.291251] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1218.291536] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1218.291690] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1218.291848] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Segment Port dc8bb96b-48fa-4729-9e03-18f4f125f8af not found, creating... [ 1218.292138] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1218.292311] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1218.292435] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1218.292657] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1218.292799] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1218.293113] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1218.293296] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1218.293424] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1218.293644] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1218.293787] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1218.293926] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Resource: SegmentPort with ID: dc8bb96b-48fa-4729-9e03-18f4f125f8af is going to be created. [ 1218.312752] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1218.312949] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1218.313046] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1218.313267] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1218.313371] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1218.313485] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 142d9057-bcb0-4a21-b68c-c89aa62897bf is going to be updated. [ 1218.315840] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1218.316079] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1218.316209] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1218.316497] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1218.316733] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1218.316956] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "port-dc8bb96b-48fa-4729-9e03-18f4f125f8af" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1218.344248] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1218.344477] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1218.344562] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1218.344828] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1218.344981] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1218.352884] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 142d9057-bcb0-4a21-b68c-c89aa62897bf in Status: IN_PROGRESS for 2s [ 1218.601319] env[69980]: INFO networking_nsxv3.common.synchronization [req-26a59641-508a-44a8-b954-6b68e7b32fc0 req-897fd1ef-fdd4-430e-8596-f6a1b3f5d47d tempest-DeleteServersTestJSON-1084822395 tempest-DeleteServersTestJSON-1084822395-project-member] Enqueued Resource ID: d0e04be7-8718-489c-8ceb-fe661da4855a with Priority: HIGHEST for action security_group_members [ 1218.601319] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d0e04be7-8718-489c-8ceb-fe661da4855a with Priority: HIGHEST for action security_group_members [ 1218.601319] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-d0e04be7-8718-489c-8ceb-fe661da4855a taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1218.601319] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d0e04be7-8718-489c-8ceb-fe661da4855a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1218.601319] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d0e04be7-8718-489c-8ceb-fe661da4855a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1218.601808] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d0e04be7-8718-489c-8ceb-fe661da4855a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1218.602132] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1218.602361] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1218.602573] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1218.603911] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1218.604114] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1218.604311] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d0e04be7-8718-489c-8ceb-fe661da4855a',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1219.080021] env[69980]: INFO networking_nsxv3.common.synchronization [req-88237d81-81f4-403b-9c83-dee847394dc4 req-27b50f59-08b4-4d06-9285-2494b1e91e89 service nova] Enqueued Resource ID: 1f8e99ba-e1d1-4cdc-98f5-ccb8c37ca66e with Priority: HIGHEST for action security_group_rules [ 1219.080021] env[69980]: INFO networking_nsxv3.common.synchronization [req-88237d81-81f4-403b-9c83-dee847394dc4 req-27b50f59-08b4-4d06-9285-2494b1e91e89 service nova] Enqueued Resource ID: 1f8e99ba-e1d1-4cdc-98f5-ccb8c37ca66e with Priority: HIGHEST for action security_group_members [ 1219.080021] env[69980]: INFO networking_nsxv3.common.synchronization [req-88237d81-81f4-403b-9c83-dee847394dc4 req-27b50f59-08b4-4d06-9285-2494b1e91e89 service nova] Enqueued Resource ID: dc8bb96b-48fa-4729-9e03-18f4f125f8af with Priority: HIGHEST for action port [ 1219.080021] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1f8e99ba-e1d1-4cdc-98f5-ccb8c37ca66e with Priority: HIGHEST for action security_group_rules [ 1219.080021] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1f8e99ba-e1d1-4cdc-98f5-ccb8c37ca66e with Priority: HIGHEST for action security_group_members [ 1219.080021] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dc8bb96b-48fa-4729-9e03-18f4f125f8af with Priority: HIGHEST for action port [ 1219.080021] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1f8e99ba-e1d1-4cdc-98f5-ccb8c37ca66e taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1219.080021] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1f8e99ba-e1d1-4cdc-98f5-ccb8c37ca66e" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1219.080021] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1f8e99ba-e1d1-4cdc-98f5-ccb8c37ca66e" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1219.080980] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1f8e99ba-e1d1-4cdc-98f5-ccb8c37ca66e" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1219.081179] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1f8e99ba-e1d1-4cdc-98f5-ccb8c37ca66e',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1219.082413] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-1f8e99ba-e1d1-4cdc-98f5-ccb8c37ca66e taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1219.082644] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1f8e99ba-e1d1-4cdc-98f5-ccb8c37ca66e" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1219.082784] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1f8e99ba-e1d1-4cdc-98f5-ccb8c37ca66e" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1219.083038] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1f8e99ba-e1d1-4cdc-98f5-ccb8c37ca66e" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1219.083287] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1219.085017] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1219.085017] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1219.085017] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1219.085017] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1219.085017] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1f8e99ba-e1d1-4cdc-98f5-ccb8c37ca66e',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1219.085017] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock port-dc8bb96b-48fa-4729-9e03-18f4f125f8af taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1219.085017] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-dc8bb96b-48fa-4729-9e03-18f4f125f8af" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1219.085017] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-dc8bb96b-48fa-4729-9e03-18f4f125f8af" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1219.085017] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-dc8bb96b-48fa-4729-9e03-18f4f125f8af" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1219.085017] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('dc8bb96b-48fa-4729-9e03-18f4f125f8af',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1219.109443] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1219.109443] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1219.109443] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1219.109443] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1219.109443] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1219.109443] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1219.109443] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1219.109443] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1219.109443] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1219.109443] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1219.109443] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d0e04be7-8718-489c-8ceb-fe661da4855a is going to be updated. [ 1219.135187] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1219.135187] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1219.135187] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1219.135187] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1219.135187] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1219.141509] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d0e04be7-8718-489c-8ceb-fe661da4855a in Status: IN_PROGRESS for 2s [ 1219.587038] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-1f8e99ba-e1d1-4cdc-98f5-ccb8c37ca66e taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1219.587260] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1f8e99ba-e1d1-4cdc-98f5-ccb8c37ca66e" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1219.587435] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1f8e99ba-e1d1-4cdc-98f5-ccb8c37ca66e',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1219.588510] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port dc8bb96b-48fa-4729-9e03-18f4f125f8af with status ACTIVE [ 1219.588639] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1219.588794] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1219.588907] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1219.589057] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1219.589145] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1219.589322] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1219.589432] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1219.589483] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1219.589608] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1219.589682] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1219.589858] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1219.589945] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1219.590014] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1219.590156] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1219.590231] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1219.590311] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: dc8bb96b-48fa-4729-9e03-18f4f125f8af is going to be updated. [ 1219.611298] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1219.611478] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1219.611478] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1219.611670] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1219.611796] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1219.611944] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-dc8bb96b-48fa-4729-9e03-18f4f125f8af" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1220.094800] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1f8e99ba-e1d1-4cdc-98f5-ccb8c37ca66e',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1220.226694] env[69980]: INFO networking_nsxv3.common.synchronization [req-d132e814-94e1-4c6b-9eca-f934283472b0 req-57939146-4b7a-4e66-bd66-f33d6a886c81 tempest-AttachInterfacesUnderV243Test-838011731 tempest-AttachInterfacesUnderV243Test-838011731-project-member] Enqueued Resource ID: 142d9057-bcb0-4a21-b68c-c89aa62897bf with Priority: HIGHEST for action security_group_members [ 1220.226694] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 142d9057-bcb0-4a21-b68c-c89aa62897bf with Priority: HIGHEST for action security_group_members [ 1220.227611] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-142d9057-bcb0-4a21-b68c-c89aa62897bf taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1220.227876] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-142d9057-bcb0-4a21-b68c-c89aa62897bf" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1220.240020] env[69980]: INFO networking_nsxv3.common.synchronization [req-d132e814-94e1-4c6b-9eca-f934283472b0 req-57939146-4b7a-4e66-bd66-f33d6a886c81 tempest-AttachInterfacesUnderV243Test-838011731 tempest-AttachInterfacesUnderV243Test-838011731-project-member] Enqueued Resource ID: 142d9057-bcb0-4a21-b68c-c89aa62897bf with Priority: HIGHEST for action security_group_rules [ 1220.240020] env[69980]: INFO networking_nsxv3.common.synchronization [req-d132e814-94e1-4c6b-9eca-f934283472b0 req-57939146-4b7a-4e66-bd66-f33d6a886c81 tempest-AttachInterfacesUnderV243Test-838011731 tempest-AttachInterfacesUnderV243Test-838011731-project-member] Enqueued Resource ID: 142d9057-bcb0-4a21-b68c-c89aa62897bf with Priority: HIGHEST for action security_group_members [ 1220.240020] env[69980]: INFO networking_nsxv3.common.synchronization [req-d132e814-94e1-4c6b-9eca-f934283472b0 req-57939146-4b7a-4e66-bd66-f33d6a886c81 tempest-AttachInterfacesUnderV243Test-838011731 tempest-AttachInterfacesUnderV243Test-838011731-project-member] Enqueued Resource ID: 34175dd9-72ca-491c-b458-ce73e251edac with Priority: HIGHEST for action port [ 1220.240020] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 142d9057-bcb0-4a21-b68c-c89aa62897bf with Priority: HIGHEST for action security_group_rules [ 1220.240020] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 142d9057-bcb0-4a21-b68c-c89aa62897bf with Priority: HIGHEST for action security_group_members [ 1220.240020] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 34175dd9-72ca-491c-b458-ce73e251edac with Priority: HIGHEST for action port [ 1220.240020] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock rules-142d9057-bcb0-4a21-b68c-c89aa62897bf taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1220.242739] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-142d9057-bcb0-4a21-b68c-c89aa62897bf" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1220.242739] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-142d9057-bcb0-4a21-b68c-c89aa62897bf taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1220.242739] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-142d9057-bcb0-4a21-b68c-c89aa62897bf" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1220.242739] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock port-34175dd9-72ca-491c-b458-ce73e251edac taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1220.242739] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-34175dd9-72ca-491c-b458-ce73e251edac" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1220.242739] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-34175dd9-72ca-491c-b458-ce73e251edac" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1220.242739] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-34175dd9-72ca-491c-b458-ce73e251edac" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1220.242739] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('34175dd9-72ca-491c-b458-ce73e251edac',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1220.362752] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 142d9057-bcb0-4a21-b68c-c89aa62897bf in Status: SUCCESS [ 1220.363173] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-142d9057-bcb0-4a21-b68c-c89aa62897bf" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1220.363401] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-142d9057-bcb0-4a21-b68c-c89aa62897bf" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1220.363719] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-142d9057-bcb0-4a21-b68c-c89aa62897bf" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1220.363986] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1220.364152] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1220.364287] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1220.364534] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1220.364633] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1220.364763] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('142d9057-bcb0-4a21-b68c-c89aa62897bf',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1220.596804] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1220.596894] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1220.596894] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1220.597193] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1220.597292] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1220.597392] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1f8e99ba-e1d1-4cdc-98f5-ccb8c37ca66e is going to be created. [ 1220.621721] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1220.621893] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1220.622869] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1220.622869] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1220.622869] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1220.624900] env[69980]: INFO networking_nsxv3.common.synchronization [req-2b083a51-0b20-42b8-b951-7a5cd22f7569 req-098bc51d-411d-4764-b988-532f3886e14a tempest-InstanceActionsV221TestJSON-1918617330 tempest-InstanceActionsV221TestJSON-1918617330-project-member] Enqueued Resource ID: 8f760c98-a5b2-4500-9310-d081ef00461d with Priority: HIGHEST for action security_group_members [ 1220.625578] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8f760c98-a5b2-4500-9310-d081ef00461d with Priority: HIGHEST for action security_group_members [ 1220.626154] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-8f760c98-a5b2-4500-9310-d081ef00461d taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1220.626274] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8f760c98-a5b2-4500-9310-d081ef00461d" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1220.626826] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8f760c98-a5b2-4500-9310-d081ef00461d" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1220.626826] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8f760c98-a5b2-4500-9310-d081ef00461d" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1220.626826] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1220.626826] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1220.626826] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1220.627075] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1220.627075] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1220.627156] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8f760c98-a5b2-4500-9310-d081ef00461d',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1220.636358] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1f8e99ba-e1d1-4cdc-98f5-ccb8c37ca66e in Status: UNINITIALIZED for 2s [ 1220.743435] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 34175dd9-72ca-491c-b458-ce73e251edac with status ACTIVE [ 1220.743680] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1220.743823] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1220.743895] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1220.744159] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1220.744254] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1220.744434] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1220.744532] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1220.744593] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1220.744742] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1220.744817] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1220.744995] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1220.745128] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1220.745259] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1220.745324] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1220.745398] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1220.745480] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 34175dd9-72ca-491c-b458-ce73e251edac is going to be updated. [ 1220.768091] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1220.768327] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1220.768327] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1220.768493] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1220.768639] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1220.768824] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-34175dd9-72ca-491c-b458-ce73e251edac" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1220.869282] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('142d9057-bcb0-4a21-b68c-c89aa62897bf',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1221.130068] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1221.133770] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1221.133770] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1221.133770] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1221.133770] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1221.133770] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1221.133770] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1221.133770] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1221.133770] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1221.133770] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1221.133770] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8f760c98-a5b2-4500-9310-d081ef00461d is going to be updated. [ 1221.149620] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d0e04be7-8718-489c-8ceb-fe661da4855a in Status: SUCCESS [ 1221.149802] env[69980]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d0e04be7-8718-489c-8ceb-fe661da4855a deletion is rescheduled due to dependency. [ 1221.149917] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d0e04be7-8718-489c-8ceb-fe661da4855a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1221.158818] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1221.158953] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1221.159123] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1221.159357] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1221.159524] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1221.169149] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8f760c98-a5b2-4500-9310-d081ef00461d in Status: IN_PROGRESS for 2s [ 1221.376651] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('142d9057-bcb0-4a21-b68c-c89aa62897bf',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1221.877361] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1221.877518] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1221.877649] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1221.877894] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1221.878029] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1221.878203] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 142d9057-bcb0-4a21-b68c-c89aa62897bf is going to be updated. [ 1221.906361] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1221.906550] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1221.906589] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1221.906810] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1221.906965] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1221.916022] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 142d9057-bcb0-4a21-b68c-c89aa62897bf in Status: IN_PROGRESS for 2s [ 1222.645221] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1f8e99ba-e1d1-4cdc-98f5-ccb8c37ca66e in Status: SUCCESS [ 1222.645560] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1f8e99ba-e1d1-4cdc-98f5-ccb8c37ca66e" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1222.645595] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1f8e99ba-e1d1-4cdc-98f5-ccb8c37ca66e" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1222.645817] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1f8e99ba-e1d1-4cdc-98f5-ccb8c37ca66e" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1222.646015] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1222.646168] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1222.646253] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1222.646393] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1222.646470] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1222.646544] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1f8e99ba-e1d1-4cdc-98f5-ccb8c37ca66e" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1222.646729] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1f8e99ba-e1d1-4cdc-98f5-ccb8c37ca66e',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1223.148827] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1f8e99ba-e1d1-4cdc-98f5-ccb8c37ca66e',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1223.177997] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8f760c98-a5b2-4500-9310-d081ef00461d in Status: SUCCESS [ 1223.178222] env[69980]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8f760c98-a5b2-4500-9310-d081ef00461d deletion is rescheduled due to dependency. [ 1223.178489] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8f760c98-a5b2-4500-9310-d081ef00461d" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1223.650831] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1f8e99ba-e1d1-4cdc-98f5-ccb8c37ca66e: rpc.has_security_group_logging(os_id): False [ 1223.667514] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1223.667753] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1223.667753] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1223.668023] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1223.668151] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1223.668591] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1223.668759] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1223.668860] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1223.669162] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1223.669253] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1223.669374] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1f8e99ba-e1d1-4cdc-98f5-ccb8c37ca66e is going to be created. [ 1223.752972] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1223.753206] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1223.753284] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1223.753499] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1223.753688] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1223.764226] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1f8e99ba-e1d1-4cdc-98f5-ccb8c37ca66e in Status: IN_PROGRESS for 2s [ 1223.870431] env[69980]: INFO networking_nsxv3.common.synchronization [req-097fa432-1ae7-40a2-b986-55695618cb0f req-71820fe6-1493-4771-8157-fabc5be3a086 tempest-AttachInterfacesUnderV243Test-838011731 tempest-AttachInterfacesUnderV243Test-838011731-project-member] Enqueued Resource ID: 142d9057-bcb0-4a21-b68c-c89aa62897bf with Priority: HIGHEST for action security_group_members [ 1223.870821] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 142d9057-bcb0-4a21-b68c-c89aa62897bf with Priority: HIGHEST for action security_group_members [ 1223.871123] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-142d9057-bcb0-4a21-b68c-c89aa62897bf taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1223.871232] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-142d9057-bcb0-4a21-b68c-c89aa62897bf" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1223.925884] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 142d9057-bcb0-4a21-b68c-c89aa62897bf in Status: SUCCESS [ 1223.926131] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-142d9057-bcb0-4a21-b68c-c89aa62897bf" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1223.930031] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-142d9057-bcb0-4a21-b68c-c89aa62897bf" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1223.930031] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-142d9057-bcb0-4a21-b68c-c89aa62897bf" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1223.930031] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1223.930031] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1223.930031] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1223.930031] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1223.930031] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1223.930031] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-142d9057-bcb0-4a21-b68c-c89aa62897bf" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1223.930031] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('142d9057-bcb0-4a21-b68c-c89aa62897bf',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1223.930031] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-142d9057-bcb0-4a21-b68c-c89aa62897bf" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1223.930031] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-142d9057-bcb0-4a21-b68c-c89aa62897bf" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1223.930031] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1223.930031] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1223.930031] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1223.930031] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1223.930031] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1223.930031] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('142d9057-bcb0-4a21-b68c-c89aa62897bf',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1224.432627] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('142d9057-bcb0-4a21-b68c-c89aa62897bf',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1224.434282] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1224.434525] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1224.434706] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1224.434934] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1224.435085] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1224.435308] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1224.435412] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1224.435475] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1224.435655] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1224.435737] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1224.435840] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 142d9057-bcb0-4a21-b68c-c89aa62897bf is going to be updated. [ 1224.461025] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1224.461025] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1224.461025] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1224.461303] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1224.461303] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1224.469215] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 142d9057-bcb0-4a21-b68c-c89aa62897bf in Status: IN_PROGRESS for 2s [ 1224.937671] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 142d9057-bcb0-4a21-b68c-c89aa62897bf: rpc.has_security_group_logging(os_id): False [ 1224.956656] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1224.956782] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1224.956825] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1224.957247] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1224.957247] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1224.957490] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1224.958430] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1224.958430] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1224.958430] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1224.958430] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1224.958430] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 142d9057-bcb0-4a21-b68c-c89aa62897bf is going to be updated. [ 1225.018337] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1225.018484] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1225.018484] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1225.018680] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1225.018851] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1225.031421] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 142d9057-bcb0-4a21-b68c-c89aa62897bf in Status: IN_PROGRESS for 2s [ 1225.779848] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1f8e99ba-e1d1-4cdc-98f5-ccb8c37ca66e in Status: SUCCESS [ 1225.779848] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1f8e99ba-e1d1-4cdc-98f5-ccb8c37ca66e" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1226.478444] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 142d9057-bcb0-4a21-b68c-c89aa62897bf in Status: SUCCESS [ 1226.478709] env[69980]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 142d9057-bcb0-4a21-b68c-c89aa62897bf deletion is rescheduled due to dependency. [ 1226.478880] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-142d9057-bcb0-4a21-b68c-c89aa62897bf" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1226.479127] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-142d9057-bcb0-4a21-b68c-c89aa62897bf" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1226.479355] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-142d9057-bcb0-4a21-b68c-c89aa62897bf" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1226.479548] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1226.479677] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1226.479743] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1226.479895] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1226.479979] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1226.480087] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('142d9057-bcb0-4a21-b68c-c89aa62897bf',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1226.983742] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1226.983914] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1226.983959] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1226.984211] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1226.984302] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1226.984802] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1226.984802] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1226.984802] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1226.984958] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1226.984958] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1226.985020] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 142d9057-bcb0-4a21-b68c-c89aa62897bf is going to be updated. [ 1227.011550] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1227.011771] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1227.011849] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1227.012147] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1227.012207] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1227.023668] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 142d9057-bcb0-4a21-b68c-c89aa62897bf in Status: IN_PROGRESS for 2s [ 1227.042497] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 142d9057-bcb0-4a21-b68c-c89aa62897bf in Status: SUCCESS [ 1227.042733] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-142d9057-bcb0-4a21-b68c-c89aa62897bf" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1227.042897] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-142d9057-bcb0-4a21-b68c-c89aa62897bf" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1227.043128] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-142d9057-bcb0-4a21-b68c-c89aa62897bf" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1227.044232] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('142d9057-bcb0-4a21-b68c-c89aa62897bf',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1227.562317] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1227.562621] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1227.562621] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1227.562742] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1227.562831] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1227.562926] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 142d9057-bcb0-4a21-b68c-c89aa62897bf is going to be deleted. [ 1227.613951] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1227.614174] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1227.614174] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1227.614412] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1227.614501] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1227.614627] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-142d9057-bcb0-4a21-b68c-c89aa62897bf" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1228.421954] env[69980]: INFO networking_nsxv3.common.synchronization [None req-34e36536-b521-4145-8442-95f0fcf06b49 None None] Enqueued Resource ID: b8280495-48ad-41c0-8021-61cf49cd4692 with Priority: HIGHEST for action port [ 1228.422560] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b8280495-48ad-41c0-8021-61cf49cd4692 with Priority: HIGHEST for action port [ 1228.422822] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock port-b8280495-48ad-41c0-8021-61cf49cd4692 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1228.422963] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b8280495-48ad-41c0-8021-61cf49cd4692" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1228.423020] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b8280495-48ad-41c0-8021-61cf49cd4692" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1228.423274] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b8280495-48ad-41c0-8021-61cf49cd4692" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1228.423357] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b8280495-48ad-41c0-8021-61cf49cd4692',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1228.926024] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b8280495-48ad-41c0-8021-61cf49cd4692 [ 1228.926427] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1228.926669] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1228.926785] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1228.927160] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1228.927313] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1228.927478] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b8280495-48ad-41c0-8021-61cf49cd4692 already deleted. [ 1228.927594] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b8280495-48ad-41c0-8021-61cf49cd4692" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1229.033568] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 142d9057-bcb0-4a21-b68c-c89aa62897bf in Status: SUCCESS [ 1229.033805] env[69980]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 142d9057-bcb0-4a21-b68c-c89aa62897bf deletion is rescheduled due to dependency. [ 1229.033968] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-142d9057-bcb0-4a21-b68c-c89aa62897bf" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1229.034248] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-142d9057-bcb0-4a21-b68c-c89aa62897bf" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1229.034538] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-142d9057-bcb0-4a21-b68c-c89aa62897bf" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1229.034793] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1229.034977] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1229.035116] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1229.035354] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1229.035495] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1229.035662] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('142d9057-bcb0-4a21-b68c-c89aa62897bf',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1229.538306] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1229.538510] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1229.538595] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1229.538852] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1229.538972] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1229.539219] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1229.539339] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1229.539418] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1229.539990] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1229.539990] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1229.539990] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 142d9057-bcb0-4a21-b68c-c89aa62897bf is going to be deleted. [ 1229.565961] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1229.566130] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1229.566195] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1229.566415] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1229.566505] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1229.566605] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-142d9057-bcb0-4a21-b68c-c89aa62897bf" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1230.216305] env[69980]: INFO networking_nsxv3.common.synchronization [req-7f1d8954-df9d-4c97-9bc0-6972fd273483 req-6ca280b8-3616-4783-b7be-3f3154c648d4 tempest-DeleteServersTestJSON-1084822395 tempest-DeleteServersTestJSON-1084822395-project-member] Enqueued Resource ID: d0e04be7-8718-489c-8ceb-fe661da4855a with Priority: HIGHEST for action security_group_members [ 1230.216824] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d0e04be7-8718-489c-8ceb-fe661da4855a with Priority: HIGHEST for action security_group_members [ 1230.217147] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-d0e04be7-8718-489c-8ceb-fe661da4855a taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1230.217432] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d0e04be7-8718-489c-8ceb-fe661da4855a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1230.217432] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d0e04be7-8718-489c-8ceb-fe661da4855a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1230.217554] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d0e04be7-8718-489c-8ceb-fe661da4855a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1230.217703] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1230.217795] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1230.217857] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1230.218054] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1230.218169] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1230.218265] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d0e04be7-8718-489c-8ceb-fe661da4855a',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1230.415957] env[69980]: INFO networking_nsxv3.common.synchronization [None req-531ad2a5-172d-4e04-b9bc-da323f80cdf1 None None] Enqueued Resource ID: dff22aea-4052-4828-9e0c-09b712cae631 with Priority: HIGHEST for action port [ 1230.416517] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dff22aea-4052-4828-9e0c-09b712cae631 with Priority: HIGHEST for action port [ 1230.417169] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock port-dff22aea-4052-4828-9e0c-09b712cae631 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1230.417390] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-dff22aea-4052-4828-9e0c-09b712cae631" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1230.417455] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-dff22aea-4052-4828-9e0c-09b712cae631" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1230.417672] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-dff22aea-4052-4828-9e0c-09b712cae631" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1230.417760] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('dff22aea-4052-4828-9e0c-09b712cae631',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1230.495428] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock network-478 taken with stack trace [, , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1230.495671] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "network-478" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1230.495806] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "network-478" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1230.496088] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "network-478" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1230.496389] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1230.496560] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1230.496711] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1230.496942] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1230.497348] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1230.497598] env[69980]: DEBUG dogpile.cache.region [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] No value present for key: 'zone-id' {{(pid=69980) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1230.497720] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] NeedRegenerationException {{(pid=69980) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1230.497834] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] no value, waiting for create lock {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1230.497948] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] value creation lock acquired {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1230.498101] env[69980]: DEBUG dogpile.cache.region [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] No value present for key: 'zone-id' {{(pid=69980) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1230.498226] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Calling creation function for not-yet-present value {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1230.498393] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1230.515960] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1230.516146] env[69980]: DEBUG dogpile.cache.region [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=69980) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1230.516329] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Released creation lock {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1230.516549] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "network-478" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1230.516874] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock port-3468ba89-aebb-42ee-b5ad-07c872200dfc taken with stack trace [, , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1230.517070] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "port-3468ba89-aebb-42ee-b5ad-07c872200dfc" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1230.517196] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "port-3468ba89-aebb-42ee-b5ad-07c872200dfc" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1230.517543] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "port-3468ba89-aebb-42ee-b5ad-07c872200dfc" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1230.517669] env[69980]: DEBUG networking_nsxv3.api.rpc [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3468ba89-aebb-42ee-b5ad-07c872200dfc',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1230.720978] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1230.721231] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1230.721357] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1230.721658] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1230.721768] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1230.722063] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1230.722224] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1230.722371] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1230.722587] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1230.722683] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1230.722779] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d0e04be7-8718-489c-8ceb-fe661da4855a is going to be updated. [ 1230.745856] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1230.746025] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1230.746100] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1230.746303] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1230.746439] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1230.754543] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d0e04be7-8718-489c-8ceb-fe661da4855a in Status: IN_PROGRESS for 2s [ 1230.919969] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port dff22aea-4052-4828-9e0c-09b712cae631 [ 1230.920344] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1230.920570] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1230.920687] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1230.921012] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1230.921177] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1230.921353] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:dff22aea-4052-4828-9e0c-09b712cae631 already deleted. [ 1230.921506] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-dff22aea-4052-4828-9e0c-09b712cae631" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1231.020870] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1231.021161] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1231.021332] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1231.021677] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1231.021862] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1231.022061] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Segment Port 3468ba89-aebb-42ee-b5ad-07c872200dfc not found, creating... [ 1231.022346] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1231.022552] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1231.022697] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1231.022977] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1231.023176] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1231.023515] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1231.023713] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1231.023872] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1231.024139] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1231.024322] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1231.024485] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Resource: SegmentPort with ID: 3468ba89-aebb-42ee-b5ad-07c872200dfc is going to be created. [ 1231.043021] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1231.043466] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1231.043466] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1231.043623] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1231.044083] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1231.044149] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "port-3468ba89-aebb-42ee-b5ad-07c872200dfc" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1231.742663] env[69980]: INFO networking_nsxv3.common.synchronization [req-7f1d8954-df9d-4c97-9bc0-6972fd273483 req-94989281-397b-4a49-a2fb-258808cc39ee service nova] Enqueued Resource ID: d0e04be7-8718-489c-8ceb-fe661da4855a with Priority: HIGHEST for action security_group_rules [ 1231.742921] env[69980]: INFO networking_nsxv3.common.synchronization [req-7f1d8954-df9d-4c97-9bc0-6972fd273483 req-94989281-397b-4a49-a2fb-258808cc39ee service nova] Enqueued Resource ID: d0e04be7-8718-489c-8ceb-fe661da4855a with Priority: HIGHEST for action security_group_members [ 1231.742997] env[69980]: INFO networking_nsxv3.common.synchronization [req-7f1d8954-df9d-4c97-9bc0-6972fd273483 req-94989281-397b-4a49-a2fb-258808cc39ee service nova] Enqueued Resource ID: 3468ba89-aebb-42ee-b5ad-07c872200dfc with Priority: HIGHEST for action port [ 1231.743251] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d0e04be7-8718-489c-8ceb-fe661da4855a with Priority: HIGHEST for action security_group_rules [ 1231.743396] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d0e04be7-8718-489c-8ceb-fe661da4855a with Priority: HIGHEST for action security_group_members [ 1231.743498] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3468ba89-aebb-42ee-b5ad-07c872200dfc with Priority: HIGHEST for action port [ 1231.744796] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d0e04be7-8718-489c-8ceb-fe661da4855a taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1231.744935] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d0e04be7-8718-489c-8ceb-fe661da4855a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1231.745013] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d0e04be7-8718-489c-8ceb-fe661da4855a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1231.745242] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d0e04be7-8718-489c-8ceb-fe661da4855a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1231.745348] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d0e04be7-8718-489c-8ceb-fe661da4855a',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1231.746190] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-d0e04be7-8718-489c-8ceb-fe661da4855a taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1231.746304] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d0e04be7-8718-489c-8ceb-fe661da4855a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1231.746491] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock port-3468ba89-aebb-42ee-b5ad-07c872200dfc taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1231.746567] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3468ba89-aebb-42ee-b5ad-07c872200dfc" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1231.746624] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3468ba89-aebb-42ee-b5ad-07c872200dfc" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1231.746793] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3468ba89-aebb-42ee-b5ad-07c872200dfc" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1231.746894] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3468ba89-aebb-42ee-b5ad-07c872200dfc',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1232.249747] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-d0e04be7-8718-489c-8ceb-fe661da4855a taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1232.249951] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d0e04be7-8718-489c-8ceb-fe661da4855a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1232.250097] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 3468ba89-aebb-42ee-b5ad-07c872200dfc with status ACTIVE [ 1232.250241] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1232.250382] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1232.250446] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1232.250617] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1232.250704] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1232.250868] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1232.250977] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1232.251059] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1232.251200] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1232.251278] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1232.251462] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1232.251566] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1232.251615] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1232.251746] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1232.251819] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1232.251901] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 3468ba89-aebb-42ee-b5ad-07c872200dfc is going to be updated. [ 1232.279673] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1232.279864] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1232.279966] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1232.280236] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1232.280438] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1232.280638] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3468ba89-aebb-42ee-b5ad-07c872200dfc" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1232.762938] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d0e04be7-8718-489c-8ceb-fe661da4855a in Status: SUCCESS [ 1232.763527] env[69980]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d0e04be7-8718-489c-8ceb-fe661da4855a deletion is rescheduled due to dependency. [ 1232.763527] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d0e04be7-8718-489c-8ceb-fe661da4855a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1232.763527] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d0e04be7-8718-489c-8ceb-fe661da4855a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1232.763650] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d0e04be7-8718-489c-8ceb-fe661da4855a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1232.763770] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1232.763908] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1232.763972] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1232.764163] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1232.764216] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1232.764313] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d0e04be7-8718-489c-8ceb-fe661da4855a',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1233.266519] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d0e04be7-8718-489c-8ceb-fe661da4855a',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1233.768838] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d0e04be7-8718-489c-8ceb-fe661da4855a',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1234.271815] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1234.271815] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1234.271815] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1234.271815] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1234.272058] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1234.272058] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d0e04be7-8718-489c-8ceb-fe661da4855a is going to be updated. [ 1234.299810] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1234.299961] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1234.300048] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1234.300251] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1234.300390] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1234.310722] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d0e04be7-8718-489c-8ceb-fe661da4855a in Status: IN_PROGRESS for 2s [ 1235.228755] env[69980]: INFO networking_nsxv3.common.synchronization [req-cde277bb-2e73-46e3-8e70-f91423627194 req-0f4e2afe-c648-44fc-9e42-714fa53796f9 tempest-AttachInterfacesTestJSON-1782090316 tempest-AttachInterfacesTestJSON-1782090316-project-member] Enqueued Resource ID: 1f8e99ba-e1d1-4cdc-98f5-ccb8c37ca66e with Priority: HIGHEST for action security_group_members [ 1235.229390] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1f8e99ba-e1d1-4cdc-98f5-ccb8c37ca66e with Priority: HIGHEST for action security_group_members [ 1235.232017] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-1f8e99ba-e1d1-4cdc-98f5-ccb8c37ca66e taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1235.232017] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1f8e99ba-e1d1-4cdc-98f5-ccb8c37ca66e" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1235.232017] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1f8e99ba-e1d1-4cdc-98f5-ccb8c37ca66e" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1235.232017] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1f8e99ba-e1d1-4cdc-98f5-ccb8c37ca66e" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1235.232017] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1235.232017] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1235.232017] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1235.232017] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1235.232017] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1235.232017] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1f8e99ba-e1d1-4cdc-98f5-ccb8c37ca66e',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1235.544787] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock network-762 taken with stack trace [, , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1235.545040] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "network-762" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1235.545203] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "network-762" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1235.545504] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "network-762" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1235.545809] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1235.546011] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1235.546171] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1235.546430] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1235.546613] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1235.546860] env[69980]: DEBUG dogpile.cache.region [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] No value present for key: 'zone-id' {{(pid=69980) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1235.547572] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] NeedRegenerationException {{(pid=69980) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1235.547572] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] no value, waiting for create lock {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1235.547572] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] value creation lock acquired {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1235.547572] env[69980]: DEBUG dogpile.cache.region [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] No value present for key: 'zone-id' {{(pid=69980) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1235.547572] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Calling creation function for not-yet-present value {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1235.547825] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1235.564573] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1235.564793] env[69980]: DEBUG dogpile.cache.region [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Cache value generated in 0.017 seconds for key(s): 'zone-id' {{(pid=69980) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1235.564939] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Released creation lock {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1235.565170] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "network-762" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1235.565523] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock port-9b18cb95-b8e8-4849-b624-0e5014344853 taken with stack trace [, , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1235.565730] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "port-9b18cb95-b8e8-4849-b624-0e5014344853" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1235.565900] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "port-9b18cb95-b8e8-4849-b624-0e5014344853" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1235.566245] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "port-9b18cb95-b8e8-4849-b624-0e5014344853" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1235.566414] env[69980]: DEBUG networking_nsxv3.api.rpc [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9b18cb95-b8e8-4849-b624-0e5014344853',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1235.733772] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1f8e99ba-e1d1-4cdc-98f5-ccb8c37ca66e',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1236.068473] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1236.068651] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1236.068811] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1236.069106] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1236.069550] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1236.069704] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Segment Port 9b18cb95-b8e8-4849-b624-0e5014344853 not found, creating... [ 1236.069985] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1236.070623] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1236.070623] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1236.070623] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1236.070754] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1236.070954] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1236.071115] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1236.071244] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1236.071449] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1236.071587] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1236.071731] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Resource: SegmentPort with ID: 9b18cb95-b8e8-4849-b624-0e5014344853 is going to be created. [ 1236.101368] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1236.101609] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1236.101869] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1236.102183] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1236.102421] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1236.102736] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "port-9b18cb95-b8e8-4849-b624-0e5014344853" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1236.235542] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1f8e99ba-e1d1-4cdc-98f5-ccb8c37ca66e',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1236.321167] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d0e04be7-8718-489c-8ceb-fe661da4855a in Status: SUCCESS [ 1236.321362] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d0e04be7-8718-489c-8ceb-fe661da4855a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1236.321528] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d0e04be7-8718-489c-8ceb-fe661da4855a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1236.321747] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d0e04be7-8718-489c-8ceb-fe661da4855a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1236.321944] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1236.322073] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1236.322140] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1236.322305] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1236.322388] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1236.322478] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d0e04be7-8718-489c-8ceb-fe661da4855a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1236.322644] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d0e04be7-8718-489c-8ceb-fe661da4855a',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1236.740350] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1236.740350] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1236.740350] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1236.740350] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1236.740350] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1236.740350] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1f8e99ba-e1d1-4cdc-98f5-ccb8c37ca66e is going to be updated. [ 1236.770295] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1236.770295] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1236.770295] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1236.770295] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1236.770295] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1236.777389] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1f8e99ba-e1d1-4cdc-98f5-ccb8c37ca66e in Status: IN_PROGRESS for 2s [ 1236.801501] env[69980]: INFO networking_nsxv3.common.synchronization [req-cde277bb-2e73-46e3-8e70-f91423627194 req-4f407ab5-267e-42a6-9810-ac3efa89c943 service nova] Enqueued Resource ID: 1f8e99ba-e1d1-4cdc-98f5-ccb8c37ca66e with Priority: HIGHEST for action security_group_rules [ 1236.801501] env[69980]: INFO networking_nsxv3.common.synchronization [req-cde277bb-2e73-46e3-8e70-f91423627194 req-4f407ab5-267e-42a6-9810-ac3efa89c943 service nova] Enqueued Resource ID: 1f8e99ba-e1d1-4cdc-98f5-ccb8c37ca66e with Priority: HIGHEST for action security_group_members [ 1236.801501] env[69980]: INFO networking_nsxv3.common.synchronization [req-cde277bb-2e73-46e3-8e70-f91423627194 req-4f407ab5-267e-42a6-9810-ac3efa89c943 service nova] Enqueued Resource ID: 9b18cb95-b8e8-4849-b624-0e5014344853 with Priority: HIGHEST for action port [ 1236.805150] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1f8e99ba-e1d1-4cdc-98f5-ccb8c37ca66e with Priority: HIGHEST for action security_group_rules [ 1236.805150] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1f8e99ba-e1d1-4cdc-98f5-ccb8c37ca66e with Priority: HIGHEST for action security_group_members [ 1236.805150] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9b18cb95-b8e8-4849-b624-0e5014344853 with Priority: HIGHEST for action port [ 1236.805150] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1f8e99ba-e1d1-4cdc-98f5-ccb8c37ca66e taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1236.805150] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1f8e99ba-e1d1-4cdc-98f5-ccb8c37ca66e" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1236.805150] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1f8e99ba-e1d1-4cdc-98f5-ccb8c37ca66e" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1236.805150] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1f8e99ba-e1d1-4cdc-98f5-ccb8c37ca66e" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1236.805150] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1f8e99ba-e1d1-4cdc-98f5-ccb8c37ca66e',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1236.808119] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-1f8e99ba-e1d1-4cdc-98f5-ccb8c37ca66e taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1236.808119] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1f8e99ba-e1d1-4cdc-98f5-ccb8c37ca66e" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1236.808119] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock port-9b18cb95-b8e8-4849-b624-0e5014344853 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1236.808119] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9b18cb95-b8e8-4849-b624-0e5014344853" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1236.808119] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9b18cb95-b8e8-4849-b624-0e5014344853" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1236.808119] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9b18cb95-b8e8-4849-b624-0e5014344853" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1236.808119] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9b18cb95-b8e8-4849-b624-0e5014344853',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1236.824997] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-d0e04be7-8718-489c-8ceb-fe661da4855a taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1236.825568] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d0e04be7-8718-489c-8ceb-fe661da4855a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1236.826317] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d0e04be7-8718-489c-8ceb-fe661da4855a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1236.827662] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d0e04be7-8718-489c-8ceb-fe661da4855a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1236.827662] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1236.827662] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1236.827662] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1236.827662] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1236.827662] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1236.827662] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d0e04be7-8718-489c-8ceb-fe661da4855a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1236.829018] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-d0e04be7-8718-489c-8ceb-fe661da4855a taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1236.829018] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d0e04be7-8718-489c-8ceb-fe661da4855a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1236.829018] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d0e04be7-8718-489c-8ceb-fe661da4855a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1236.829018] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d0e04be7-8718-489c-8ceb-fe661da4855a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1236.829018] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1236.829018] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1236.829018] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1236.829018] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1236.830192] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1236.830387] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d0e04be7-8718-489c-8ceb-fe661da4855a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1236.830567] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d0e04be7-8718-489c-8ceb-fe661da4855a',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1237.308406] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-1f8e99ba-e1d1-4cdc-98f5-ccb8c37ca66e taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1237.308698] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1f8e99ba-e1d1-4cdc-98f5-ccb8c37ca66e" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1237.309911] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 9b18cb95-b8e8-4849-b624-0e5014344853 with status ACTIVE [ 1237.310180] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1237.310312] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1237.310381] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1237.310595] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1237.310733] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1237.310932] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1237.311094] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1237.311184] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1237.311384] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1237.311490] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1237.311710] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1237.311840] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1237.311840] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1237.311993] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1237.312127] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1237.312243] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 9b18cb95-b8e8-4849-b624-0e5014344853 is going to be updated. [ 1237.332499] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1237.332634] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1237.332713] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1237.332922] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1237.333336] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1237.333336] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9b18cb95-b8e8-4849-b624-0e5014344853" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1237.333423] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d0e04be7-8718-489c-8ceb-fe661da4855a: rpc.has_security_group_logging(os_id): False [ 1237.349156] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1237.349300] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1237.349343] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1237.349517] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1237.349610] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1237.349838] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1237.349938] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1237.350009] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1237.350163] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1237.350245] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1237.350470] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1237.350574] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1237.350637] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1237.350786] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1237.350854] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1237.351074] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1237.351173] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1237.351227] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1237.351367] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1237.351444] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1237.351529] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d0e04be7-8718-489c-8ceb-fe661da4855a is going to be updated. [ 1237.411058] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1237.411218] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1237.411291] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1237.411502] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1237.411644] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1237.427479] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d0e04be7-8718-489c-8ceb-fe661da4855a in Status: IN_PROGRESS for 2s [ 1238.785969] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1f8e99ba-e1d1-4cdc-98f5-ccb8c37ca66e in Status: SUCCESS [ 1238.786314] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1f8e99ba-e1d1-4cdc-98f5-ccb8c37ca66e" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1238.786361] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1f8e99ba-e1d1-4cdc-98f5-ccb8c37ca66e" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1238.786576] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1f8e99ba-e1d1-4cdc-98f5-ccb8c37ca66e" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1238.786768] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1238.786881] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1238.786946] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1238.787123] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1238.787209] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1238.787306] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1f8e99ba-e1d1-4cdc-98f5-ccb8c37ca66e',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1239.289433] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1f8e99ba-e1d1-4cdc-98f5-ccb8c37ca66e',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1239.446758] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d0e04be7-8718-489c-8ceb-fe661da4855a in Status: SUCCESS [ 1239.447016] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d0e04be7-8718-489c-8ceb-fe661da4855a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1239.791588] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1f8e99ba-e1d1-4cdc-98f5-ccb8c37ca66e',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1239.847141] env[69980]: INFO networking_nsxv3.common.synchronization [req-88d81220-30a9-4eff-b0af-fde9927b76f4 req-ca8a164e-915a-4d4f-ab6f-3743acaff988 tempest-ServerMetadataNegativeTestJSON-1729858799 tempest-ServerMetadataNegativeTestJSON-1729858799-project-member] Enqueued Resource ID: 190dbbe3-e412-4523-ae5a-c437b3c11354 with Priority: HIGHEST for action security_group_members [ 1239.847141] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 190dbbe3-e412-4523-ae5a-c437b3c11354 with Priority: HIGHEST for action security_group_members [ 1239.847141] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-190dbbe3-e412-4523-ae5a-c437b3c11354 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1239.847141] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-190dbbe3-e412-4523-ae5a-c437b3c11354" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1239.847141] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-190dbbe3-e412-4523-ae5a-c437b3c11354" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1239.847141] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-190dbbe3-e412-4523-ae5a-c437b3c11354" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1239.847141] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1239.847141] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1239.847141] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1239.847141] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1239.851453] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1239.851690] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('190dbbe3-e412-4523-ae5a-c437b3c11354',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1240.133292] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock network-717 taken with stack trace [, , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1240.133521] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "network-717" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1240.133665] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "network-717" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1240.134054] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "network-717" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1240.134350] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1240.134533] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1240.134657] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1240.134908] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1240.135097] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1240.135328] env[69980]: DEBUG dogpile.cache.region [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] No value present for key: 'zone-id' {{(pid=69980) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1240.135449] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] NeedRegenerationException {{(pid=69980) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1240.135573] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] no value, waiting for create lock {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1240.135704] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] value creation lock acquired {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1240.135827] env[69980]: DEBUG dogpile.cache.region [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] No value present for key: 'zone-id' {{(pid=69980) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1240.135950] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Calling creation function for not-yet-present value {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1240.136113] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1240.161746] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1240.161919] env[69980]: DEBUG dogpile.cache.region [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Cache value generated in 0.026 seconds for key(s): 'zone-id' {{(pid=69980) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1240.162079] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Released creation lock {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1240.162272] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "network-717" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1240.162623] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock port-9dc9f2d1-5497-4a9c-886d-aea9c707ca48 taken with stack trace [, , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1240.162820] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "port-9dc9f2d1-5497-4a9c-886d-aea9c707ca48" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1240.162944] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "port-9dc9f2d1-5497-4a9c-886d-aea9c707ca48" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1240.163302] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "port-9dc9f2d1-5497-4a9c-886d-aea9c707ca48" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1240.163465] env[69980]: DEBUG networking_nsxv3.api.rpc [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9dc9f2d1-5497-4a9c-886d-aea9c707ca48',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1240.294293] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1240.294498] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1240.294498] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1240.294722] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1240.294817] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1240.294914] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1f8e99ba-e1d1-4cdc-98f5-ccb8c37ca66e is going to be updated. [ 1240.325310] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1240.325483] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1240.325526] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1240.325723] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1240.325884] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1240.334713] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1f8e99ba-e1d1-4cdc-98f5-ccb8c37ca66e in Status: IN_PROGRESS for 2s [ 1240.358380] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1240.358546] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1240.358586] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1240.358815] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1240.358907] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1240.359128] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1240.359231] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1240.359296] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1240.359467] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1240.359549] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1240.359641] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 190dbbe3-e412-4523-ae5a-c437b3c11354 already deleted. [ 1240.359764] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-190dbbe3-e412-4523-ae5a-c437b3c11354" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1240.665503] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1240.665710] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1240.665786] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1240.666080] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1240.666238] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1240.666410] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Segment Port 9dc9f2d1-5497-4a9c-886d-aea9c707ca48 not found, creating... [ 1240.666688] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1240.666873] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1240.666994] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1240.667268] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1240.667465] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1240.667859] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1240.668077] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1240.668240] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1240.668519] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1240.668708] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1240.668913] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Resource: SegmentPort with ID: 9dc9f2d1-5497-4a9c-886d-aea9c707ca48 is going to be created. [ 1240.687429] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1240.687676] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1240.687815] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1240.688176] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1240.688504] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1240.688867] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "port-9dc9f2d1-5497-4a9c-886d-aea9c707ca48" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1241.396485] env[69980]: INFO networking_nsxv3.common.synchronization [req-88d81220-30a9-4eff-b0af-fde9927b76f4 req-6fc0170c-d216-43c2-a950-da5d1f399e61 service nova] Enqueued Resource ID: 190dbbe3-e412-4523-ae5a-c437b3c11354 with Priority: HIGHEST for action security_group_rules [ 1241.396804] env[69980]: INFO networking_nsxv3.common.synchronization [req-88d81220-30a9-4eff-b0af-fde9927b76f4 req-6fc0170c-d216-43c2-a950-da5d1f399e61 service nova] Enqueued Resource ID: 190dbbe3-e412-4523-ae5a-c437b3c11354 with Priority: HIGHEST for action security_group_members [ 1241.396804] env[69980]: INFO networking_nsxv3.common.synchronization [req-88d81220-30a9-4eff-b0af-fde9927b76f4 req-6fc0170c-d216-43c2-a950-da5d1f399e61 service nova] Enqueued Resource ID: 9dc9f2d1-5497-4a9c-886d-aea9c707ca48 with Priority: HIGHEST for action port [ 1241.397042] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 190dbbe3-e412-4523-ae5a-c437b3c11354 with Priority: HIGHEST for action security_group_rules [ 1241.397206] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 190dbbe3-e412-4523-ae5a-c437b3c11354 with Priority: HIGHEST for action security_group_members [ 1241.397275] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9dc9f2d1-5497-4a9c-886d-aea9c707ca48 with Priority: HIGHEST for action port [ 1241.397845] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock rules-190dbbe3-e412-4523-ae5a-c437b3c11354 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1241.397979] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-190dbbe3-e412-4523-ae5a-c437b3c11354" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1241.398050] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-190dbbe3-e412-4523-ae5a-c437b3c11354" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1241.398284] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-190dbbe3-e412-4523-ae5a-c437b3c11354" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1241.398366] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('190dbbe3-e412-4523-ae5a-c437b3c11354',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1241.399187] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-190dbbe3-e412-4523-ae5a-c437b3c11354 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1241.399301] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-190dbbe3-e412-4523-ae5a-c437b3c11354" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1241.399376] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-190dbbe3-e412-4523-ae5a-c437b3c11354" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1241.399539] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-190dbbe3-e412-4523-ae5a-c437b3c11354" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1241.399682] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1241.399798] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1241.399860] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1241.400013] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1241.400105] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1241.400190] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('190dbbe3-e412-4523-ae5a-c437b3c11354',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1241.401197] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock port-9dc9f2d1-5497-4a9c-886d-aea9c707ca48 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1241.401300] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9dc9f2d1-5497-4a9c-886d-aea9c707ca48" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1241.401373] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9dc9f2d1-5497-4a9c-886d-aea9c707ca48" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1241.401520] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9dc9f2d1-5497-4a9c-886d-aea9c707ca48" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1241.401595] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9dc9f2d1-5497-4a9c-886d-aea9c707ca48',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1241.904033] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-190dbbe3-e412-4523-ae5a-c437b3c11354 taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1241.904033] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-190dbbe3-e412-4523-ae5a-c437b3c11354" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1241.904033] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('190dbbe3-e412-4523-ae5a-c437b3c11354',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1241.905045] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 9dc9f2d1-5497-4a9c-886d-aea9c707ca48 with status ACTIVE [ 1241.905234] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1241.905347] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1241.905433] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1241.905614] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1241.905796] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1241.905861] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1241.905954] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1241.906028] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1241.906177] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1241.906252] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1241.906433] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1241.906571] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1241.906615] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1241.906728] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1241.906827] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1241.906871] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 9dc9f2d1-5497-4a9c-886d-aea9c707ca48 is going to be updated. [ 1241.926171] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1241.926289] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1241.926371] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1241.926569] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1241.926721] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1241.926882] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9dc9f2d1-5497-4a9c-886d-aea9c707ca48" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1242.345636] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1f8e99ba-e1d1-4cdc-98f5-ccb8c37ca66e in Status: SUCCESS [ 1242.345943] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1f8e99ba-e1d1-4cdc-98f5-ccb8c37ca66e" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1242.346161] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1f8e99ba-e1d1-4cdc-98f5-ccb8c37ca66e" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1242.346404] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1f8e99ba-e1d1-4cdc-98f5-ccb8c37ca66e" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1242.346694] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1242.346876] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1242.346930] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1242.347129] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1242.347245] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1242.347334] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1f8e99ba-e1d1-4cdc-98f5-ccb8c37ca66e" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1242.347476] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1f8e99ba-e1d1-4cdc-98f5-ccb8c37ca66e',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1242.408966] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('190dbbe3-e412-4523-ae5a-c437b3c11354',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1242.851556] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1f8e99ba-e1d1-4cdc-98f5-ccb8c37ca66e',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1242.911438] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1242.911675] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1242.911675] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1242.911854] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1242.911946] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1242.912061] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 190dbbe3-e412-4523-ae5a-c437b3c11354 is going to be created. [ 1242.933807] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1242.933994] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1242.933994] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1242.934209] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1242.934363] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1242.943843] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 190dbbe3-e412-4523-ae5a-c437b3c11354 in Status: UNINITIALIZED for 2s [ 1243.352645] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1f8e99ba-e1d1-4cdc-98f5-ccb8c37ca66e: rpc.has_security_group_logging(os_id): False [ 1243.370805] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1243.371046] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1243.371182] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1243.371522] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1243.371690] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1243.372103] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1243.372289] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1243.372402] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1243.372939] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1243.372939] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1243.373058] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1f8e99ba-e1d1-4cdc-98f5-ccb8c37ca66e is going to be updated. [ 1243.441696] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1243.442098] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1243.442098] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1243.442193] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1243.442260] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1243.458307] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1f8e99ba-e1d1-4cdc-98f5-ccb8c37ca66e in Status: IN_PROGRESS for 2s [ 1244.953350] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 190dbbe3-e412-4523-ae5a-c437b3c11354 in Status: SUCCESS [ 1244.953634] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-190dbbe3-e412-4523-ae5a-c437b3c11354" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1244.953878] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-190dbbe3-e412-4523-ae5a-c437b3c11354" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1244.953936] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-190dbbe3-e412-4523-ae5a-c437b3c11354" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1244.954145] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1244.954267] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1244.954328] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1244.954491] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1244.954574] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1244.954658] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-190dbbe3-e412-4523-ae5a-c437b3c11354" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1244.954750] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('190dbbe3-e412-4523-ae5a-c437b3c11354',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1245.457404] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-190dbbe3-e412-4523-ae5a-c437b3c11354 taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1245.457602] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-190dbbe3-e412-4523-ae5a-c437b3c11354" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1245.457678] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-190dbbe3-e412-4523-ae5a-c437b3c11354" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1245.458175] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-190dbbe3-e412-4523-ae5a-c437b3c11354" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1245.458405] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1245.458543] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1245.458647] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1245.458842] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1245.458964] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1245.459117] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-190dbbe3-e412-4523-ae5a-c437b3c11354" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1245.459327] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-190dbbe3-e412-4523-ae5a-c437b3c11354 taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1245.459457] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-190dbbe3-e412-4523-ae5a-c437b3c11354" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1245.459528] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-190dbbe3-e412-4523-ae5a-c437b3c11354" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1245.459700] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-190dbbe3-e412-4523-ae5a-c437b3c11354" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1245.459866] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1245.459985] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1245.460076] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1245.460261] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1245.460359] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1245.460466] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-190dbbe3-e412-4523-ae5a-c437b3c11354" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1245.460578] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('190dbbe3-e412-4523-ae5a-c437b3c11354',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1245.473700] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1f8e99ba-e1d1-4cdc-98f5-ccb8c37ca66e in Status: SUCCESS [ 1245.473935] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1f8e99ba-e1d1-4cdc-98f5-ccb8c37ca66e" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1245.964066] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 190dbbe3-e412-4523-ae5a-c437b3c11354: rpc.has_security_group_logging(os_id): False [ 1245.981930] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1245.982175] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1245.982175] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1245.982400] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1245.982475] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1245.982690] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1245.982793] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1245.982857] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1245.983034] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1245.983099] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1245.983283] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1245.983379] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1245.983442] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1245.983581] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1245.983657] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1245.983833] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1245.983925] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1245.983986] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1245.984141] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1245.984217] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1245.984302] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 190dbbe3-e412-4523-ae5a-c437b3c11354 is going to be created. [ 1246.042102] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1246.042102] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1246.042102] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1246.042102] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1246.042444] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1246.066765] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 190dbbe3-e412-4523-ae5a-c437b3c11354 in Status: IN_PROGRESS for 2s [ 1246.398109] env[69980]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1246.398239] env[69980]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1247.037939] env[69980]: INFO networking_nsxv3.common.synchronization [None req-09e1cc04-d60f-42e2-9f65-96922fa4b328 tempest-AttachInterfacesTestJSON-1782090316 tempest-AttachInterfacesTestJSON-1782090316-project-member] Enqueued Resource ID: e63cb46c-ccab-4856-bf25-2380514e2780 with Priority: HIGHEST for action security_group_members [ 1247.038604] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e63cb46c-ccab-4856-bf25-2380514e2780 with Priority: HIGHEST for action security_group_members [ 1247.038929] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-e63cb46c-ccab-4856-bf25-2380514e2780 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1247.040959] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e63cb46c-ccab-4856-bf25-2380514e2780" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1247.040959] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e63cb46c-ccab-4856-bf25-2380514e2780" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1247.040959] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e63cb46c-ccab-4856-bf25-2380514e2780" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1247.040959] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1247.040959] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1247.040959] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1247.040959] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1247.040959] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1247.040959] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e63cb46c-ccab-4856-bf25-2380514e2780',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1247.542653] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1247.542827] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1247.542902] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1247.543165] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1247.543262] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1247.543469] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1247.543574] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1247.543643] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1247.543802] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1247.543880] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1247.543968] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e63cb46c-ccab-4856-bf25-2380514e2780 is going to be updated. [ 1247.567663] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1247.567921] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1247.567921] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1247.568124] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1247.568267] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1247.576137] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e63cb46c-ccab-4856-bf25-2380514e2780 in Status: IN_PROGRESS for 2s [ 1248.081642] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 190dbbe3-e412-4523-ae5a-c437b3c11354 in Status: SUCCESS [ 1248.081642] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-190dbbe3-e412-4523-ae5a-c437b3c11354" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1249.587072] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e63cb46c-ccab-4856-bf25-2380514e2780 in Status: SUCCESS [ 1249.587432] env[69980]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e63cb46c-ccab-4856-bf25-2380514e2780 deletion is rescheduled due to dependency. [ 1249.587552] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e63cb46c-ccab-4856-bf25-2380514e2780" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1250.655904] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock network-472 taken with stack trace [, , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1250.656245] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "network-472" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1250.656245] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "network-472" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1250.656518] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "network-472" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1250.656776] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1250.656932] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1250.657062] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1250.657301] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1250.657444] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1250.657691] env[69980]: DEBUG dogpile.cache.region [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] No value present for key: 'zone-id' {{(pid=69980) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1250.657806] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] NeedRegenerationException {{(pid=69980) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1250.657917] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] no value, waiting for create lock {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1250.658040] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] value creation lock acquired {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1250.658157] env[69980]: DEBUG dogpile.cache.region [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] No value present for key: 'zone-id' {{(pid=69980) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1250.658266] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Calling creation function for not-yet-present value {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1250.658403] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1250.676165] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1250.676239] env[69980]: DEBUG dogpile.cache.region [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=69980) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1250.676540] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Released creation lock {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1250.676540] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "network-472" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1250.676863] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock port-917b0999-9a9f-41ad-b7ca-4827aab2a90f taken with stack trace [, , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1250.677059] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "port-917b0999-9a9f-41ad-b7ca-4827aab2a90f" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1250.677191] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "port-917b0999-9a9f-41ad-b7ca-4827aab2a90f" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1250.677452] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "port-917b0999-9a9f-41ad-b7ca-4827aab2a90f" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1250.677619] env[69980]: DEBUG networking_nsxv3.api.rpc [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('917b0999-9a9f-41ad-b7ca-4827aab2a90f',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1251.180830] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1251.180830] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1251.181119] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1251.181378] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1251.181586] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1251.181988] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1251.182228] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1251.182397] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1251.182684] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1251.182879] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1251.183286] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1251.183508] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1251.183679] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1251.183955] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1251.184156] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1251.184357] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Resource: SegmentPort with ID: 917b0999-9a9f-41ad-b7ca-4827aab2a90f is going to be updated. [ 1251.209313] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1251.209547] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1251.209655] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1251.209946] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1251.210165] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1251.210396] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "port-917b0999-9a9f-41ad-b7ca-4827aab2a90f" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1251.975648] env[69980]: INFO networking_nsxv3.common.synchronization [req-17c3f37d-f9bc-4880-bcdc-484263971ea3 req-859a2e91-74c8-45bb-b2ee-bc839280abd7 service nova] Enqueued Resource ID: 3909a119-b9ca-4e95-b2b4-3541d0886a49 with Priority: HIGHEST for action security_group_rules [ 1251.975908] env[69980]: INFO networking_nsxv3.common.synchronization [req-17c3f37d-f9bc-4880-bcdc-484263971ea3 req-859a2e91-74c8-45bb-b2ee-bc839280abd7 service nova] Enqueued Resource ID: 3909a119-b9ca-4e95-b2b4-3541d0886a49 with Priority: HIGHEST for action security_group_members [ 1251.975969] env[69980]: INFO networking_nsxv3.common.synchronization [req-17c3f37d-f9bc-4880-bcdc-484263971ea3 req-859a2e91-74c8-45bb-b2ee-bc839280abd7 service nova] Enqueued Resource ID: 917b0999-9a9f-41ad-b7ca-4827aab2a90f with Priority: HIGHEST for action port [ 1251.976411] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3909a119-b9ca-4e95-b2b4-3541d0886a49 with Priority: HIGHEST for action security_group_rules [ 1251.976411] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3909a119-b9ca-4e95-b2b4-3541d0886a49 with Priority: HIGHEST for action security_group_members [ 1251.976411] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 917b0999-9a9f-41ad-b7ca-4827aab2a90f with Priority: HIGHEST for action port [ 1251.977366] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3909a119-b9ca-4e95-b2b4-3541d0886a49 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1251.977366] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3909a119-b9ca-4e95-b2b4-3541d0886a49" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1251.977366] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3909a119-b9ca-4e95-b2b4-3541d0886a49" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1251.977485] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3909a119-b9ca-4e95-b2b4-3541d0886a49" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1251.977485] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3909a119-b9ca-4e95-b2b4-3541d0886a49',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1251.980927] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-3909a119-b9ca-4e95-b2b4-3541d0886a49 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1251.980927] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3909a119-b9ca-4e95-b2b4-3541d0886a49" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1251.980927] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3909a119-b9ca-4e95-b2b4-3541d0886a49" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1251.980927] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3909a119-b9ca-4e95-b2b4-3541d0886a49" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1251.980927] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1251.980927] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1251.980927] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1251.980927] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1251.980927] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1251.980927] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3909a119-b9ca-4e95-b2b4-3541d0886a49',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1251.980927] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock port-917b0999-9a9f-41ad-b7ca-4827aab2a90f taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1251.980927] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-917b0999-9a9f-41ad-b7ca-4827aab2a90f" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1251.980927] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-917b0999-9a9f-41ad-b7ca-4827aab2a90f" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1251.980927] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-917b0999-9a9f-41ad-b7ca-4827aab2a90f" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1251.980927] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('917b0999-9a9f-41ad-b7ca-4827aab2a90f',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1252.483715] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3909a119-b9ca-4e95-b2b4-3541d0886a49',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1252.486016] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-3909a119-b9ca-4e95-b2b4-3541d0886a49 taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1252.486016] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3909a119-b9ca-4e95-b2b4-3541d0886a49" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1252.486016] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 917b0999-9a9f-41ad-b7ca-4827aab2a90f with status ACTIVE [ 1252.486016] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1252.486016] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1252.486016] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1252.486016] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1252.486016] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1252.486016] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1252.486016] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1252.486016] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1252.486594] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1252.486594] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1252.486594] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1252.486594] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1252.486594] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1252.486800] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1252.486800] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1252.486800] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 917b0999-9a9f-41ad-b7ca-4827aab2a90f is going to be updated. [ 1252.510117] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1252.510278] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1252.510333] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1252.510539] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1252.510678] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1252.510925] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-917b0999-9a9f-41ad-b7ca-4827aab2a90f" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1252.992561] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3909a119-b9ca-4e95-b2b4-3541d0886a49',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1253.495511] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1253.495895] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1253.496110] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1253.496459] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1253.496587] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1253.496725] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3909a119-b9ca-4e95-b2b4-3541d0886a49 is going to be updated. [ 1253.524015] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1253.524211] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1253.524299] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1253.524508] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1253.524652] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1253.533836] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3909a119-b9ca-4e95-b2b4-3541d0886a49 in Status: IN_PROGRESS for 2s [ 1254.126375] env[69980]: INFO networking_nsxv3.common.synchronization [req-a390b864-c14f-46d9-8791-54a2d5318f51 req-14a48f52-7934-4916-86ee-d09527504c06 tempest-ServerMetadataNegativeTestJSON-1729858799 tempest-ServerMetadataNegativeTestJSON-1729858799-project-member] Enqueued Resource ID: 190dbbe3-e412-4523-ae5a-c437b3c11354 with Priority: HIGHEST for action security_group_members [ 1254.126375] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 190dbbe3-e412-4523-ae5a-c437b3c11354 with Priority: HIGHEST for action security_group_members [ 1254.126375] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-190dbbe3-e412-4523-ae5a-c437b3c11354 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1254.126375] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-190dbbe3-e412-4523-ae5a-c437b3c11354" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1254.126375] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-190dbbe3-e412-4523-ae5a-c437b3c11354" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1254.126741] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-190dbbe3-e412-4523-ae5a-c437b3c11354" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1254.126741] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1254.126817] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1254.126885] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1254.127052] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1254.127142] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1254.127237] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('190dbbe3-e412-4523-ae5a-c437b3c11354',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1254.629778] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1254.629778] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1254.629778] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1254.630024] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1254.630024] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1254.630160] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1254.630255] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1254.630312] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1254.630461] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1254.630538] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1254.630625] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 190dbbe3-e412-4523-ae5a-c437b3c11354 is going to be updated. [ 1254.656600] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1254.656745] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1254.656803] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1254.657201] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1254.657382] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1254.664728] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 190dbbe3-e412-4523-ae5a-c437b3c11354 in Status: IN_PROGRESS for 2s [ 1255.542987] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3909a119-b9ca-4e95-b2b4-3541d0886a49 in Status: SUCCESS [ 1255.543261] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3909a119-b9ca-4e95-b2b4-3541d0886a49" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1255.543468] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3909a119-b9ca-4e95-b2b4-3541d0886a49" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1255.543712] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3909a119-b9ca-4e95-b2b4-3541d0886a49" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1255.543934] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1255.544076] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1255.544161] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1255.544340] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1255.544434] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1255.544523] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3909a119-b9ca-4e95-b2b4-3541d0886a49" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1255.544617] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('3909a119-b9ca-4e95-b2b4-3541d0886a49',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1256.046987] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('3909a119-b9ca-4e95-b2b4-3541d0886a49',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1256.549497] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 3909a119-b9ca-4e95-b2b4-3541d0886a49: rpc.has_security_group_logging(os_id): False [ 1256.568087] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1256.568191] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1256.568233] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1256.568936] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1256.585655] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1256.585950] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1256.586083] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1256.586154] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1256.586351] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1256.586434] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1256.586521] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3909a119-b9ca-4e95-b2b4-3541d0886a49 is going to be updated. [ 1256.637844] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1256.638063] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1256.638126] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1256.638444] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1256.638627] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1256.660353] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3909a119-b9ca-4e95-b2b4-3541d0886a49 in Status: IN_PROGRESS for 2s [ 1256.680856] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 190dbbe3-e412-4523-ae5a-c437b3c11354 in Status: SUCCESS [ 1256.681151] env[69980]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 190dbbe3-e412-4523-ae5a-c437b3c11354 deletion is rescheduled due to dependency. [ 1256.681320] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-190dbbe3-e412-4523-ae5a-c437b3c11354" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1258.673552] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3909a119-b9ca-4e95-b2b4-3541d0886a49 in Status: SUCCESS [ 1258.674092] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3909a119-b9ca-4e95-b2b4-3541d0886a49" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1259.127575] env[69980]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1259.127778] env[69980]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1262.011425] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock network-762 taken with stack trace [, , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1262.011863] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "network-762" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1262.011863] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "network-762" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1262.012075] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "network-762" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1262.012370] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1262.012533] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1262.012720] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1262.013020] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1262.013191] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1262.013413] env[69980]: DEBUG dogpile.cache.region [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] No value present for key: 'zone-id' {{(pid=69980) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1262.013531] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] NeedRegenerationException {{(pid=69980) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1262.013642] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] no value, waiting for create lock {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1262.013754] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] value creation lock acquired {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1262.013921] env[69980]: DEBUG dogpile.cache.region [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] No value present for key: 'zone-id' {{(pid=69980) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1262.014084] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Calling creation function for not-yet-present value {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1262.014229] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1262.034843] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1262.035100] env[69980]: DEBUG dogpile.cache.region [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=69980) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1262.035276] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Released creation lock {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1262.035465] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "network-762" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1262.036066] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock port-9cb972be-6982-4e58-9c4e-2e51da834def taken with stack trace [, , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1262.036259] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "port-9cb972be-6982-4e58-9c4e-2e51da834def" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1262.036380] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "port-9cb972be-6982-4e58-9c4e-2e51da834def" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1262.036720] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "port-9cb972be-6982-4e58-9c4e-2e51da834def" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1262.036880] env[69980]: DEBUG networking_nsxv3.api.rpc [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9cb972be-6982-4e58-9c4e-2e51da834def',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1262.539471] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1262.539680] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1262.539760] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1262.540159] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1262.540332] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1262.540500] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Segment Port 9cb972be-6982-4e58-9c4e-2e51da834def not found, creating... [ 1262.540793] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1262.540962] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1262.541103] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1262.541343] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1262.541501] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1262.541798] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1262.541960] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1262.542096] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1262.542320] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1262.542453] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1262.542600] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Resource: SegmentPort with ID: 9cb972be-6982-4e58-9c4e-2e51da834def is going to be created. [ 1262.563392] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1262.563628] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1262.563741] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1262.564046] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1262.564295] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1262.564531] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "port-9cb972be-6982-4e58-9c4e-2e51da834def" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1263.254586] env[69980]: INFO networking_nsxv3.common.synchronization [req-ebf62cef-bd91-43c9-b88d-e25f86aed6da req-a4caa7bc-ce95-4d0b-8a7b-1881e70e7cb5 service nova] Enqueued Resource ID: e63cb46c-ccab-4856-bf25-2380514e2780 with Priority: HIGHEST for action security_group_rules [ 1263.254821] env[69980]: INFO networking_nsxv3.common.synchronization [req-ebf62cef-bd91-43c9-b88d-e25f86aed6da req-a4caa7bc-ce95-4d0b-8a7b-1881e70e7cb5 service nova] Enqueued Resource ID: e63cb46c-ccab-4856-bf25-2380514e2780 with Priority: HIGHEST for action security_group_members [ 1263.254901] env[69980]: INFO networking_nsxv3.common.synchronization [req-ebf62cef-bd91-43c9-b88d-e25f86aed6da req-a4caa7bc-ce95-4d0b-8a7b-1881e70e7cb5 service nova] Enqueued Resource ID: 9cb972be-6982-4e58-9c4e-2e51da834def with Priority: HIGHEST for action port [ 1263.255165] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e63cb46c-ccab-4856-bf25-2380514e2780 with Priority: HIGHEST for action security_group_rules [ 1263.255295] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e63cb46c-ccab-4856-bf25-2380514e2780 with Priority: HIGHEST for action security_group_members [ 1263.255390] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9cb972be-6982-4e58-9c4e-2e51da834def with Priority: HIGHEST for action port [ 1263.255955] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e63cb46c-ccab-4856-bf25-2380514e2780 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1263.256205] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e63cb46c-ccab-4856-bf25-2380514e2780" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1263.256280] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e63cb46c-ccab-4856-bf25-2380514e2780" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1263.256482] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e63cb46c-ccab-4856-bf25-2380514e2780" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1263.256565] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e63cb46c-ccab-4856-bf25-2380514e2780',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1263.257919] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-e63cb46c-ccab-4856-bf25-2380514e2780 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1263.257919] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e63cb46c-ccab-4856-bf25-2380514e2780" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1263.257919] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e63cb46c-ccab-4856-bf25-2380514e2780" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1263.257919] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e63cb46c-ccab-4856-bf25-2380514e2780" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1263.258131] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1263.258131] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1263.258131] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1263.258266] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1263.258380] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1263.258430] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e63cb46c-ccab-4856-bf25-2380514e2780',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1263.259216] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock port-9cb972be-6982-4e58-9c4e-2e51da834def taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1263.259285] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9cb972be-6982-4e58-9c4e-2e51da834def" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1263.259412] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9cb972be-6982-4e58-9c4e-2e51da834def" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1263.260105] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9cb972be-6982-4e58-9c4e-2e51da834def" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1263.260105] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9cb972be-6982-4e58-9c4e-2e51da834def',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1263.761675] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-e63cb46c-ccab-4856-bf25-2380514e2780 taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1263.761840] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e63cb46c-ccab-4856-bf25-2380514e2780" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1263.762034] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e63cb46c-ccab-4856-bf25-2380514e2780',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1263.762929] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 9cb972be-6982-4e58-9c4e-2e51da834def with status ACTIVE [ 1263.763113] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1263.764611] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1263.764611] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1263.764611] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1263.764611] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1263.764611] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1263.764611] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1263.764611] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1263.764611] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1263.764611] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1263.764611] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1263.764611] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1263.764611] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1263.764611] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1263.764611] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1263.765366] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 9cb972be-6982-4e58-9c4e-2e51da834def is going to be updated. [ 1263.783087] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1263.783255] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1263.783292] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1263.783585] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1263.783664] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1263.783840] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9cb972be-6982-4e58-9c4e-2e51da834def" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1264.266593] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e63cb46c-ccab-4856-bf25-2380514e2780',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1264.769857] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1264.770073] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1264.770239] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1264.770528] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1264.770659] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1264.770814] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e63cb46c-ccab-4856-bf25-2380514e2780 is going to be updated. [ 1264.796636] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1264.796847] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1264.796896] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1264.797211] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1264.797330] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1264.804988] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e63cb46c-ccab-4856-bf25-2380514e2780 in Status: IN_PROGRESS for 2s [ 1266.815478] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e63cb46c-ccab-4856-bf25-2380514e2780 in Status: SUCCESS [ 1266.815791] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e63cb46c-ccab-4856-bf25-2380514e2780" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1266.815918] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e63cb46c-ccab-4856-bf25-2380514e2780" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1266.816194] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e63cb46c-ccab-4856-bf25-2380514e2780" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1266.816330] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1266.816452] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1266.816512] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1266.816672] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1266.816754] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1266.816858] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e63cb46c-ccab-4856-bf25-2380514e2780" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1266.816969] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e63cb46c-ccab-4856-bf25-2380514e2780',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1267.320612] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-e63cb46c-ccab-4856-bf25-2380514e2780 taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1267.320851] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e63cb46c-ccab-4856-bf25-2380514e2780" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1267.320939] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e63cb46c-ccab-4856-bf25-2380514e2780" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1267.321252] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e63cb46c-ccab-4856-bf25-2380514e2780" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1267.321359] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1267.321493] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1267.321556] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1267.322080] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1267.322246] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1267.322392] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e63cb46c-ccab-4856-bf25-2380514e2780" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1267.322571] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-e63cb46c-ccab-4856-bf25-2380514e2780 taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1267.322674] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e63cb46c-ccab-4856-bf25-2380514e2780" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1267.322739] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e63cb46c-ccab-4856-bf25-2380514e2780" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1267.322886] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e63cb46c-ccab-4856-bf25-2380514e2780" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1267.323040] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1267.323134] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1267.323193] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1267.323328] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1267.323399] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1267.323477] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e63cb46c-ccab-4856-bf25-2380514e2780" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1267.323566] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e63cb46c-ccab-4856-bf25-2380514e2780',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1267.826646] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e63cb46c-ccab-4856-bf25-2380514e2780: rpc.has_security_group_logging(os_id): False [ 1267.843520] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1267.843662] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1267.843724] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1267.843944] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1267.844056] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1267.844255] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1267.844357] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1267.844418] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1267.844570] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1267.844646] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1267.844852] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1267.844957] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1267.845070] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1267.845242] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1267.845321] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1267.845511] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1267.845613] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1267.845683] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1267.845829] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1267.845905] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1267.845990] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e63cb46c-ccab-4856-bf25-2380514e2780 is going to be updated. [ 1267.903235] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1267.903394] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1267.903449] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1267.903764] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1267.903965] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1267.919050] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e63cb46c-ccab-4856-bf25-2380514e2780 in Status: IN_PROGRESS for 2s [ 1268.256221] env[69980]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1268.256303] env[69980]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1269.934743] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e63cb46c-ccab-4856-bf25-2380514e2780 in Status: SUCCESS [ 1269.935041] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e63cb46c-ccab-4856-bf25-2380514e2780" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1271.978500] env[69980]: INFO networking_nsxv3.common.synchronization [req-836be6c9-c9de-4248-abc2-cf5780862488 req-ebd44976-1a9d-4df4-9110-dd7be0f8e7d0 tempest-DeleteServersTestJSON-1084822395 tempest-DeleteServersTestJSON-1084822395-project-member] Enqueued Resource ID: d0e04be7-8718-489c-8ceb-fe661da4855a with Priority: HIGHEST for action security_group_members [ 1271.979069] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d0e04be7-8718-489c-8ceb-fe661da4855a with Priority: HIGHEST for action security_group_members [ 1271.979435] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-d0e04be7-8718-489c-8ceb-fe661da4855a taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1271.979559] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d0e04be7-8718-489c-8ceb-fe661da4855a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1271.979625] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d0e04be7-8718-489c-8ceb-fe661da4855a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1271.979820] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d0e04be7-8718-489c-8ceb-fe661da4855a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1271.980120] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1271.980229] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1271.980294] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1271.980442] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1271.980526] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1271.980649] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d0e04be7-8718-489c-8ceb-fe661da4855a',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1272.483666] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1272.483893] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1272.483944] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1272.484215] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1272.484314] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1272.484532] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1272.484643] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1272.484705] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1272.484858] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1272.484937] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1272.485081] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d0e04be7-8718-489c-8ceb-fe661da4855a is going to be updated. [ 1272.511036] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1272.511208] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1272.511271] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1272.511524] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1272.511724] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1272.520171] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d0e04be7-8718-489c-8ceb-fe661da4855a in Status: IN_PROGRESS for 2s [ 1274.529960] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d0e04be7-8718-489c-8ceb-fe661da4855a in Status: SUCCESS [ 1274.530205] env[69980]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d0e04be7-8718-489c-8ceb-fe661da4855a deletion is rescheduled due to dependency. [ 1274.530302] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d0e04be7-8718-489c-8ceb-fe661da4855a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1276.980799] env[69980]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1276.981159] env[69980]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1277.278739] env[69980]: INFO networking_nsxv3.common.synchronization [req-7d8dceee-c7fa-4099-9740-ee9ce78f10e3 req-67018537-6794-4ea7-872e-e3aa73efdb41 tempest-ServerActionsTestOtherA-1240783872 tempest-ServerActionsTestOtherA-1240783872-project-member] Enqueued Resource ID: c64c611c-a81f-411b-a88c-f87f4d86a64a with Priority: HIGHEST for action security_group_members [ 1277.279290] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c64c611c-a81f-411b-a88c-f87f4d86a64a with Priority: HIGHEST for action security_group_members [ 1277.279590] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-c64c611c-a81f-411b-a88c-f87f4d86a64a taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1277.279710] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c64c611c-a81f-411b-a88c-f87f4d86a64a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1277.279770] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c64c611c-a81f-411b-a88c-f87f4d86a64a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1277.279960] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c64c611c-a81f-411b-a88c-f87f4d86a64a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1277.280233] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1277.280402] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1277.280402] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1277.280562] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1277.280619] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1277.280713] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c64c611c-a81f-411b-a88c-f87f4d86a64a',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1277.782871] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1277.783056] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1277.783056] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1277.783259] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1277.803223] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1277.803436] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1277.804111] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1277.804111] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1277.804111] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1277.804111] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1277.804111] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c64c611c-a81f-411b-a88c-f87f4d86a64a is going to be updated. [ 1277.839899] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1277.840108] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1277.840108] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1277.840367] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1277.840467] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1277.849207] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c64c611c-a81f-411b-a88c-f87f4d86a64a in Status: IN_PROGRESS for 2s [ 1279.860117] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c64c611c-a81f-411b-a88c-f87f4d86a64a in Status: SUCCESS [ 1279.860117] env[69980]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c64c611c-a81f-411b-a88c-f87f4d86a64a deletion is rescheduled due to dependency. [ 1279.860117] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c64c611c-a81f-411b-a88c-f87f4d86a64a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1282.034937] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock network-762 taken with stack trace [, , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1282.035289] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "network-762" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1282.035328] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "network-762" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1282.035568] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "network-762" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1282.035869] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1282.036137] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1282.036322] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1282.036562] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1282.036795] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1282.037080] env[69980]: DEBUG dogpile.cache.region [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] No value present for key: 'zone-id' {{(pid=69980) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1282.037208] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] NeedRegenerationException {{(pid=69980) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1282.037339] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] no value, waiting for create lock {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1282.037459] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] value creation lock acquired {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1282.037574] env[69980]: DEBUG dogpile.cache.region [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] No value present for key: 'zone-id' {{(pid=69980) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1282.037683] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Calling creation function for not-yet-present value {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1282.037821] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1282.058047] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1282.058220] env[69980]: DEBUG dogpile.cache.region [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=69980) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1282.058361] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Released creation lock {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1282.058526] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "network-762" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1282.058812] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock port-9cb972be-6982-4e58-9c4e-2e51da834def taken with stack trace [, , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1282.058976] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "port-9cb972be-6982-4e58-9c4e-2e51da834def" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1282.059111] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "port-9cb972be-6982-4e58-9c4e-2e51da834def" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1282.059349] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "port-9cb972be-6982-4e58-9c4e-2e51da834def" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1282.059485] env[69980]: DEBUG networking_nsxv3.api.rpc [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9cb972be-6982-4e58-9c4e-2e51da834def',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1282.280615] env[69980]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1282.281100] env[69980]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1282.561879] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1282.562131] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1282.562273] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1282.562545] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1282.562702] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1282.562989] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1282.563168] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1282.563289] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1282.563502] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1282.563642] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1282.563931] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1282.564106] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1282.564247] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1282.564460] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1282.564600] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1282.564745] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Resource: SegmentPort with ID: 9cb972be-6982-4e58-9c4e-2e51da834def is going to be updated. [ 1282.587150] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1282.587150] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1282.587150] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1282.587422] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1282.587545] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1282.587761] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "port-9cb972be-6982-4e58-9c4e-2e51da834def" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1283.353024] env[69980]: INFO networking_nsxv3.common.synchronization [req-fa0ef4a4-6636-40cf-a1ab-ddc0a37d54c9 req-34199102-ee62-4a2f-8a47-c796b0683b73 service nova] Enqueued Resource ID: e63cb46c-ccab-4856-bf25-2380514e2780 with Priority: HIGHEST for action security_group_rules [ 1283.353024] env[69980]: INFO networking_nsxv3.common.synchronization [req-fa0ef4a4-6636-40cf-a1ab-ddc0a37d54c9 req-34199102-ee62-4a2f-8a47-c796b0683b73 service nova] Enqueued Resource ID: e63cb46c-ccab-4856-bf25-2380514e2780 with Priority: HIGHEST for action security_group_members [ 1283.353024] env[69980]: INFO networking_nsxv3.common.synchronization [req-fa0ef4a4-6636-40cf-a1ab-ddc0a37d54c9 req-34199102-ee62-4a2f-8a47-c796b0683b73 service nova] Enqueued Resource ID: 9cb972be-6982-4e58-9c4e-2e51da834def with Priority: HIGHEST for action port [ 1283.353024] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e63cb46c-ccab-4856-bf25-2380514e2780 with Priority: HIGHEST for action security_group_rules [ 1283.353024] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e63cb46c-ccab-4856-bf25-2380514e2780 with Priority: HIGHEST for action security_group_members [ 1283.353024] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9cb972be-6982-4e58-9c4e-2e51da834def with Priority: HIGHEST for action port [ 1283.353024] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e63cb46c-ccab-4856-bf25-2380514e2780 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1283.353024] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e63cb46c-ccab-4856-bf25-2380514e2780" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1283.353024] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e63cb46c-ccab-4856-bf25-2380514e2780" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1283.355047] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e63cb46c-ccab-4856-bf25-2380514e2780" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1283.355047] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e63cb46c-ccab-4856-bf25-2380514e2780',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1283.355476] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-e63cb46c-ccab-4856-bf25-2380514e2780 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1283.356112] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e63cb46c-ccab-4856-bf25-2380514e2780" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1283.356112] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e63cb46c-ccab-4856-bf25-2380514e2780" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1283.356112] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e63cb46c-ccab-4856-bf25-2380514e2780" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1283.358141] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1283.358141] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1283.358141] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1283.358141] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1283.358141] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1283.358141] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e63cb46c-ccab-4856-bf25-2380514e2780',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1283.358141] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock port-9cb972be-6982-4e58-9c4e-2e51da834def taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1283.358141] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9cb972be-6982-4e58-9c4e-2e51da834def" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1283.360699] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9cb972be-6982-4e58-9c4e-2e51da834def" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1283.360699] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9cb972be-6982-4e58-9c4e-2e51da834def" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1283.360699] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9cb972be-6982-4e58-9c4e-2e51da834def',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1283.539365] env[69980]: INFO networking_nsxv3.common.synchronization [req-873c055f-b032-458f-a180-54eeedcd4d82 req-1318988b-afbd-4328-9263-aa7018e2a636 tempest-ServerActionsTestJSON-1479580870 tempest-ServerActionsTestJSON-1479580870-project-member] Enqueued Resource ID: 1c48b9d6-06bd-4429-a87d-c56109170df7 with Priority: HIGHEST for action security_group_members [ 1283.539977] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1c48b9d6-06bd-4429-a87d-c56109170df7 with Priority: HIGHEST for action security_group_members [ 1283.540729] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-1c48b9d6-06bd-4429-a87d-c56109170df7 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1283.540729] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1c48b9d6-06bd-4429-a87d-c56109170df7" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1283.540729] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1c48b9d6-06bd-4429-a87d-c56109170df7" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1283.541026] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1c48b9d6-06bd-4429-a87d-c56109170df7" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1283.541171] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1283.542107] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1283.542200] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1283.543214] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1283.543677] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1283.543812] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1c48b9d6-06bd-4429-a87d-c56109170df7',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1283.860947] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-e63cb46c-ccab-4856-bf25-2380514e2780 taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1283.861163] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e63cb46c-ccab-4856-bf25-2380514e2780" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1283.861348] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e63cb46c-ccab-4856-bf25-2380514e2780',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1283.866023] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 9cb972be-6982-4e58-9c4e-2e51da834def with status ACTIVE [ 1283.866023] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1283.866023] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1283.866023] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1283.866023] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1283.866023] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1283.866023] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1283.866023] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1283.866023] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1283.866023] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1283.866023] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1283.866023] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1283.866023] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1283.866023] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1283.866023] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1283.866023] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1283.866023] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 9cb972be-6982-4e58-9c4e-2e51da834def is going to be updated. [ 1283.886342] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1283.886538] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1283.886538] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1283.886888] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1283.887039] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1283.887197] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9cb972be-6982-4e58-9c4e-2e51da834def" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1284.046163] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1284.046418] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1284.046418] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1284.046715] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1284.046854] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1284.047133] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1284.047260] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1284.047319] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1284.047489] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1284.047566] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1284.047644] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1c48b9d6-06bd-4429-a87d-c56109170df7 is going to be updated. [ 1284.077811] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1284.077811] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1284.078017] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1284.078187] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1284.078296] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1284.086769] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1c48b9d6-06bd-4429-a87d-c56109170df7 in Status: IN_PROGRESS for 2s [ 1284.366811] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e63cb46c-ccab-4856-bf25-2380514e2780',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1284.869748] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1284.869748] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1284.869748] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1284.869748] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1284.869748] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1284.870101] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e63cb46c-ccab-4856-bf25-2380514e2780 is going to be updated. [ 1284.897684] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1284.897684] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1284.897684] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1284.897684] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1284.897684] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1284.905702] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e63cb46c-ccab-4856-bf25-2380514e2780 in Status: IN_PROGRESS for 2s [ 1286.096813] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1c48b9d6-06bd-4429-a87d-c56109170df7 in Status: SUCCESS [ 1286.097152] env[69980]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1c48b9d6-06bd-4429-a87d-c56109170df7 deletion is rescheduled due to dependency. [ 1286.097152] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1c48b9d6-06bd-4429-a87d-c56109170df7" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1286.917780] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e63cb46c-ccab-4856-bf25-2380514e2780 in Status: SUCCESS [ 1286.918131] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e63cb46c-ccab-4856-bf25-2380514e2780" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1286.918352] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e63cb46c-ccab-4856-bf25-2380514e2780" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1286.918631] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e63cb46c-ccab-4856-bf25-2380514e2780" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1286.918878] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1286.919075] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1286.919155] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1286.919378] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1286.919468] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1286.919603] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e63cb46c-ccab-4856-bf25-2380514e2780" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1286.919707] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e63cb46c-ccab-4856-bf25-2380514e2780',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1287.423886] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-e63cb46c-ccab-4856-bf25-2380514e2780 taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1287.424213] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e63cb46c-ccab-4856-bf25-2380514e2780" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1287.424213] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e63cb46c-ccab-4856-bf25-2380514e2780" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1287.424353] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e63cb46c-ccab-4856-bf25-2380514e2780" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1287.424516] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1287.424612] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1287.424675] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1287.424826] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1287.424911] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1287.424997] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e63cb46c-ccab-4856-bf25-2380514e2780" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1287.425279] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-e63cb46c-ccab-4856-bf25-2380514e2780 taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1287.425279] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e63cb46c-ccab-4856-bf25-2380514e2780" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1287.425411] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e63cb46c-ccab-4856-bf25-2380514e2780" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1287.425447] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e63cb46c-ccab-4856-bf25-2380514e2780" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1287.425557] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1287.425644] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1287.425703] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1287.425832] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1287.425904] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1287.426022] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e63cb46c-ccab-4856-bf25-2380514e2780" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1287.426123] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e63cb46c-ccab-4856-bf25-2380514e2780',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1287.726409] env[69980]: INFO networking_nsxv3.common.synchronization [req-378528ff-8840-42f8-9d77-2b34d32c44e0 req-a6b25e27-1825-4391-8aaf-fe12e7aaafc5 tempest-ServerActionsTestOtherA-1240783872 tempest-ServerActionsTestOtherA-1240783872-project-member] Enqueued Resource ID: 724b248c-fcba-4659-94d6-7aefe563ad89 with Priority: HIGHEST for action security_group_members [ 1287.726728] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 724b248c-fcba-4659-94d6-7aefe563ad89 with Priority: HIGHEST for action security_group_members [ 1287.727239] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-724b248c-fcba-4659-94d6-7aefe563ad89 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1287.727410] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-724b248c-fcba-4659-94d6-7aefe563ad89" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1287.727512] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-724b248c-fcba-4659-94d6-7aefe563ad89" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1287.727769] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-724b248c-fcba-4659-94d6-7aefe563ad89" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1287.728032] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1287.728141] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1287.728247] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1287.728373] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1287.728437] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1287.728566] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('724b248c-fcba-4659-94d6-7aefe563ad89',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1287.930379] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e63cb46c-ccab-4856-bf25-2380514e2780: rpc.has_security_group_logging(os_id): False [ 1287.947486] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1287.947678] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1287.947733] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1287.947988] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1287.948118] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1287.948372] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1287.948499] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1287.948582] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1287.948768] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1287.948868] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1287.949178] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1287.949305] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1287.949391] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1287.949586] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1287.949747] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1287.949939] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1287.950109] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1287.950172] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1287.950373] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1287.950476] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1287.950595] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e63cb46c-ccab-4856-bf25-2380514e2780 is going to be updated. [ 1288.008747] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1288.008885] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1288.008975] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1288.009212] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1288.009359] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1288.024113] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e63cb46c-ccab-4856-bf25-2380514e2780 in Status: IN_PROGRESS for 2s [ 1288.057968] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock network-714 taken with stack trace [, , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1288.058319] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "network-714" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1288.058462] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "network-714" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1288.058729] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "network-714" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1288.059011] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1288.059180] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1288.059301] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1288.059522] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1288.059673] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1288.059889] env[69980]: DEBUG dogpile.cache.region [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] No value present for key: 'zone-id' {{(pid=69980) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1288.059999] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] NeedRegenerationException {{(pid=69980) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1288.060125] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] no value, waiting for create lock {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1288.060235] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] value creation lock acquired {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1288.060346] env[69980]: DEBUG dogpile.cache.region [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] No value present for key: 'zone-id' {{(pid=69980) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1288.060452] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Calling creation function for not-yet-present value {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1288.060586] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1288.103552] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1288.103715] env[69980]: DEBUG dogpile.cache.region [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Cache value generated in 0.043 seconds for key(s): 'zone-id' {{(pid=69980) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1288.103852] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Released creation lock {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1288.104046] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "network-714" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1288.104368] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock port-001c8319-deac-4602-8f00-ea2170e1afd7 taken with stack trace [, , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1288.104544] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "port-001c8319-deac-4602-8f00-ea2170e1afd7" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1288.104666] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "port-001c8319-deac-4602-8f00-ea2170e1afd7" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1288.104995] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "port-001c8319-deac-4602-8f00-ea2170e1afd7" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1288.105191] env[69980]: DEBUG networking_nsxv3.api.rpc [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('001c8319-deac-4602-8f00-ea2170e1afd7',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1288.238112] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1288.238323] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1288.238380] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1288.238583] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1288.238674] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1288.238872] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1288.239038] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1288.239135] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1288.239243] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1288.239322] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1288.239415] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 724b248c-fcba-4659-94d6-7aefe563ad89 is going to be deleted. [ 1288.265902] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1288.266034] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1288.266118] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1288.266271] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1288.266361] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1288.266454] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-724b248c-fcba-4659-94d6-7aefe563ad89" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1288.608935] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1288.608935] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1288.608935] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1288.608935] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1288.609542] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1288.609542] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Segment Port 001c8319-deac-4602-8f00-ea2170e1afd7 not found, creating... [ 1288.609616] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1288.609780] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1288.609908] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1288.610161] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1288.610338] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1288.610671] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1288.610885] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1288.611042] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1288.611267] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1288.611441] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1288.611586] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Resource: SegmentPort with ID: 001c8319-deac-4602-8f00-ea2170e1afd7 is going to be created. [ 1288.631749] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1288.632097] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1288.632347] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1288.632686] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1288.632985] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1288.633374] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "port-001c8319-deac-4602-8f00-ea2170e1afd7" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1289.487515] env[69980]: INFO networking_nsxv3.common.synchronization [req-378528ff-8840-42f8-9d77-2b34d32c44e0 req-4c31f394-d007-4131-ba63-ed207ea4f1a0 service nova] Enqueued Resource ID: 724b248c-fcba-4659-94d6-7aefe563ad89 with Priority: HIGHEST for action security_group_rules [ 1289.487515] env[69980]: INFO networking_nsxv3.common.synchronization [req-378528ff-8840-42f8-9d77-2b34d32c44e0 req-4c31f394-d007-4131-ba63-ed207ea4f1a0 service nova] Enqueued Resource ID: 724b248c-fcba-4659-94d6-7aefe563ad89 with Priority: HIGHEST for action security_group_members [ 1289.487515] env[69980]: INFO networking_nsxv3.common.synchronization [req-378528ff-8840-42f8-9d77-2b34d32c44e0 req-4c31f394-d007-4131-ba63-ed207ea4f1a0 service nova] Enqueued Resource ID: 001c8319-deac-4602-8f00-ea2170e1afd7 with Priority: HIGHEST for action port [ 1289.487515] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 724b248c-fcba-4659-94d6-7aefe563ad89 with Priority: HIGHEST for action security_group_rules [ 1289.487515] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 724b248c-fcba-4659-94d6-7aefe563ad89 with Priority: HIGHEST for action security_group_members [ 1289.487515] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 001c8319-deac-4602-8f00-ea2170e1afd7 with Priority: HIGHEST for action port [ 1289.487515] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock rules-724b248c-fcba-4659-94d6-7aefe563ad89 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1289.487515] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-724b248c-fcba-4659-94d6-7aefe563ad89" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1289.487515] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-724b248c-fcba-4659-94d6-7aefe563ad89" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1289.487515] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-724b248c-fcba-4659-94d6-7aefe563ad89" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1289.487949] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('724b248c-fcba-4659-94d6-7aefe563ad89',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1289.489419] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-724b248c-fcba-4659-94d6-7aefe563ad89 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1289.489611] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-724b248c-fcba-4659-94d6-7aefe563ad89" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1289.489660] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-724b248c-fcba-4659-94d6-7aefe563ad89" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1289.489872] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-724b248c-fcba-4659-94d6-7aefe563ad89" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1289.490069] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1289.490166] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1289.490224] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1289.490366] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1289.490443] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1289.490590] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('724b248c-fcba-4659-94d6-7aefe563ad89',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1289.491685] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock port-001c8319-deac-4602-8f00-ea2170e1afd7 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1289.491806] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-001c8319-deac-4602-8f00-ea2170e1afd7" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1289.491898] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-001c8319-deac-4602-8f00-ea2170e1afd7" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1289.492439] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-001c8319-deac-4602-8f00-ea2170e1afd7" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1289.492572] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('001c8319-deac-4602-8f00-ea2170e1afd7',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1289.994484] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-724b248c-fcba-4659-94d6-7aefe563ad89 taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1289.994804] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-724b248c-fcba-4659-94d6-7aefe563ad89" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1289.994804] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('724b248c-fcba-4659-94d6-7aefe563ad89',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1289.995717] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 001c8319-deac-4602-8f00-ea2170e1afd7 with status ACTIVE [ 1289.995911] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1289.996134] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1289.996255] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1289.997421] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1289.997421] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1289.997421] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1289.997421] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1289.997421] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1289.997421] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1289.997758] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1289.997758] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1289.998153] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1289.998153] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1289.998333] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1289.998615] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1289.998738] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 001c8319-deac-4602-8f00-ea2170e1afd7 is going to be updated. [ 1290.020119] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1290.020119] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1290.020119] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1290.020382] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1290.020382] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1290.021047] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-001c8319-deac-4602-8f00-ea2170e1afd7" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1290.037708] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e63cb46c-ccab-4856-bf25-2380514e2780 in Status: SUCCESS [ 1290.038420] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e63cb46c-ccab-4856-bf25-2380514e2780" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1290.501102] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('724b248c-fcba-4659-94d6-7aefe563ad89',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1291.006749] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1291.007103] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1291.007103] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1291.007231] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1291.007278] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1291.007382] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 724b248c-fcba-4659-94d6-7aefe563ad89 is going to be created. [ 1291.028430] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1291.028633] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1291.028633] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1291.028807] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1291.028955] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1291.037256] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 724b248c-fcba-4659-94d6-7aefe563ad89 in Status: UNINITIALIZED for 2s [ 1293.049654] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 724b248c-fcba-4659-94d6-7aefe563ad89 in Status: SUCCESS [ 1293.049923] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-724b248c-fcba-4659-94d6-7aefe563ad89" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1293.050111] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-724b248c-fcba-4659-94d6-7aefe563ad89" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1293.050340] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-724b248c-fcba-4659-94d6-7aefe563ad89" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1293.050551] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1293.050698] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1293.050780] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1293.050962] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1293.051077] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1293.051185] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-724b248c-fcba-4659-94d6-7aefe563ad89" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1293.051281] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('724b248c-fcba-4659-94d6-7aefe563ad89',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1293.240235] env[69980]: INFO networking_nsxv3.common.synchronization [req-53db6ecc-39ad-4fa1-be1e-1509bd1486dd req-85aaec27-9526-4eed-830f-dcf44de8881e tempest-ServerActionsTestOtherB-1413576659 tempest-ServerActionsTestOtherB-1413576659-project-member] Enqueued Resource ID: 72f0fad5-906a-4ed9-a922-fdb13010a34d with Priority: HIGHEST for action security_group_members [ 1293.240822] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 72f0fad5-906a-4ed9-a922-fdb13010a34d with Priority: HIGHEST for action security_group_members [ 1293.241189] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-72f0fad5-906a-4ed9-a922-fdb13010a34d taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1293.241325] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-72f0fad5-906a-4ed9-a922-fdb13010a34d" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1293.241390] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-72f0fad5-906a-4ed9-a922-fdb13010a34d" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1293.241975] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-72f0fad5-906a-4ed9-a922-fdb13010a34d" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1293.241975] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1293.241975] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1293.241975] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1293.242258] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1293.242258] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1293.242386] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('72f0fad5-906a-4ed9-a922-fdb13010a34d',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1293.553867] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-724b248c-fcba-4659-94d6-7aefe563ad89 taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1293.554080] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-724b248c-fcba-4659-94d6-7aefe563ad89" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1293.554080] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-724b248c-fcba-4659-94d6-7aefe563ad89" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1293.554405] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-724b248c-fcba-4659-94d6-7aefe563ad89" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1293.554553] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1293.554661] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1293.554726] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1293.554878] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1293.554967] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1293.555068] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-724b248c-fcba-4659-94d6-7aefe563ad89" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1293.555217] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-724b248c-fcba-4659-94d6-7aefe563ad89 taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1293.555306] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-724b248c-fcba-4659-94d6-7aefe563ad89" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1293.555365] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-724b248c-fcba-4659-94d6-7aefe563ad89" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1293.555504] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-724b248c-fcba-4659-94d6-7aefe563ad89" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1293.555641] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1293.555965] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1293.555965] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1293.556085] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1293.556117] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1293.556205] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-724b248c-fcba-4659-94d6-7aefe563ad89" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1293.556292] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('724b248c-fcba-4659-94d6-7aefe563ad89',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1293.745225] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1293.745421] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1293.745531] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1293.745807] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1293.745882] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1293.746261] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1293.746518] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1293.746518] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1293.746688] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1293.746749] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1293.746825] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 72f0fad5-906a-4ed9-a922-fdb13010a34d is going to be updated. [ 1293.772320] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1293.772538] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1293.772538] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1293.772773] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1293.772920] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1293.781507] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 72f0fad5-906a-4ed9-a922-fdb13010a34d in Status: IN_PROGRESS for 2s [ 1294.059257] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 724b248c-fcba-4659-94d6-7aefe563ad89: rpc.has_security_group_logging(os_id): False [ 1294.075946] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1294.076158] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1294.076229] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1294.076433] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1294.076522] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1294.076703] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1294.076802] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1294.076863] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1294.077026] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1294.077104] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1294.077381] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1294.077381] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1294.077496] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1294.077571] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1294.077641] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1294.077821] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1294.077910] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1294.077968] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1294.078181] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1294.078248] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1294.078336] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 724b248c-fcba-4659-94d6-7aefe563ad89 is going to be created. [ 1294.141604] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1294.141780] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1294.141828] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1294.142096] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1294.142304] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1294.154538] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 724b248c-fcba-4659-94d6-7aefe563ad89 in Status: IN_PROGRESS for 2s [ 1295.791165] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 72f0fad5-906a-4ed9-a922-fdb13010a34d in Status: SUCCESS [ 1295.791457] env[69980]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 72f0fad5-906a-4ed9-a922-fdb13010a34d deletion is rescheduled due to dependency. [ 1295.791457] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-72f0fad5-906a-4ed9-a922-fdb13010a34d" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1296.168962] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 724b248c-fcba-4659-94d6-7aefe563ad89 in Status: SUCCESS [ 1296.169285] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-724b248c-fcba-4659-94d6-7aefe563ad89" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1298.241534] env[69980]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1298.241818] env[69980]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1298.530992] env[69980]: INFO networking_nsxv3.common.synchronization [req-0095539b-ceb7-40f9-aaee-ec66a37d07c8 req-103b2d12-28c3-42a9-8355-082e7a82d8ed tempest-ServerActionsTestOtherA-1240783872 tempest-ServerActionsTestOtherA-1240783872-project-member] Enqueued Resource ID: 724b248c-fcba-4659-94d6-7aefe563ad89 with Priority: HIGHEST for action security_group_members [ 1298.531608] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 724b248c-fcba-4659-94d6-7aefe563ad89 with Priority: HIGHEST for action security_group_members [ 1298.532286] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-724b248c-fcba-4659-94d6-7aefe563ad89 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1298.532286] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-724b248c-fcba-4659-94d6-7aefe563ad89" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1298.532286] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-724b248c-fcba-4659-94d6-7aefe563ad89" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1298.532804] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-724b248c-fcba-4659-94d6-7aefe563ad89" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1298.532804] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1298.532804] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1298.532963] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1298.533113] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1298.533290] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1298.533384] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('724b248c-fcba-4659-94d6-7aefe563ad89',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1298.582309] env[69980]: INFO networking_nsxv3.common.synchronization [req-0095539b-ceb7-40f9-aaee-ec66a37d07c8 req-103b2d12-28c3-42a9-8355-082e7a82d8ed tempest-ServerActionsTestOtherA-1240783872 tempest-ServerActionsTestOtherA-1240783872-project-member] Enqueued Resource ID: 001c8319-deac-4602-8f00-ea2170e1afd7 with Priority: HIGHEST for action port [ 1298.582613] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 001c8319-deac-4602-8f00-ea2170e1afd7 with Priority: HIGHEST for action port [ 1298.583024] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock port-001c8319-deac-4602-8f00-ea2170e1afd7 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1298.583082] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-001c8319-deac-4602-8f00-ea2170e1afd7" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1298.583128] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-001c8319-deac-4602-8f00-ea2170e1afd7" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1298.583329] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-001c8319-deac-4602-8f00-ea2170e1afd7" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1298.583386] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('001c8319-deac-4602-8f00-ea2170e1afd7',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1299.035761] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1299.036042] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1299.036193] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1299.036463] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1299.036847] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1299.036847] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1299.036979] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1299.036979] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1299.037105] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1299.037187] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1299.037271] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 724b248c-fcba-4659-94d6-7aefe563ad89 is going to be updated. [ 1299.073923] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1299.074051] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1299.074162] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1299.074526] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1299.074751] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1299.083240] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 724b248c-fcba-4659-94d6-7aefe563ad89 in Status: IN_PROGRESS for 2s [ 1299.087327] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 001c8319-deac-4602-8f00-ea2170e1afd7 with status ACTIVE [ 1299.087327] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1299.087327] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1299.087327] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1299.087327] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1299.087327] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1299.087327] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1299.087327] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1299.087327] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1299.087327] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1299.087327] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1299.087327] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1299.087327] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1299.087327] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1299.087776] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1299.087776] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1299.087776] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 001c8319-deac-4602-8f00-ea2170e1afd7 is going to be updated. [ 1299.109039] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1299.109181] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1299.109279] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1299.109462] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1299.109647] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1299.109886] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-001c8319-deac-4602-8f00-ea2170e1afd7" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1300.547737] env[69980]: INFO networking_nsxv3.common.synchronization [req-e5bbaff1-d80b-46d6-a3f8-2ad1dc970ee4 req-191c4834-255f-4d3e-8d5f-97072f139b48 tempest-AttachInterfacesTestJSON-1782090316 tempest-AttachInterfacesTestJSON-1782090316-project-member] Enqueued Resource ID: 1f8e99ba-e1d1-4cdc-98f5-ccb8c37ca66e with Priority: HIGHEST for action security_group_members [ 1300.548345] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1f8e99ba-e1d1-4cdc-98f5-ccb8c37ca66e with Priority: HIGHEST for action security_group_members [ 1300.548660] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-1f8e99ba-e1d1-4cdc-98f5-ccb8c37ca66e taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1300.548781] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1f8e99ba-e1d1-4cdc-98f5-ccb8c37ca66e" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1300.548846] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1f8e99ba-e1d1-4cdc-98f5-ccb8c37ca66e" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1300.549050] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1f8e99ba-e1d1-4cdc-98f5-ccb8c37ca66e" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1300.549235] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1300.549330] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1300.549444] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1300.549537] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1300.549676] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1300.549730] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1f8e99ba-e1d1-4cdc-98f5-ccb8c37ca66e',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1301.051644] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1f8e99ba-e1d1-4cdc-98f5-ccb8c37ca66e',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1301.092028] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 724b248c-fcba-4659-94d6-7aefe563ad89 in Status: SUCCESS [ 1301.092138] env[69980]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 724b248c-fcba-4659-94d6-7aefe563ad89 deletion is rescheduled due to dependency. [ 1301.092203] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-724b248c-fcba-4659-94d6-7aefe563ad89" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1301.553903] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1f8e99ba-e1d1-4cdc-98f5-ccb8c37ca66e',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1302.056790] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1302.056966] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1302.057039] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1302.057257] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1302.057351] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1302.057452] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1f8e99ba-e1d1-4cdc-98f5-ccb8c37ca66e is going to be updated. [ 1302.085689] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1302.085920] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1302.085920] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1302.086189] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1302.086332] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1302.094907] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1f8e99ba-e1d1-4cdc-98f5-ccb8c37ca66e in Status: IN_PROGRESS for 2s [ 1303.814813] env[69980]: INFO networking_nsxv3.common.synchronization [req-28716b23-ad46-45cd-a97c-97431e1d2dfe req-b5058d26-0d08-4dc3-b625-a57a506cb540 tempest-ServerActionsTestOtherB-1413576659 tempest-ServerActionsTestOtherB-1413576659-project-member] Enqueued Resource ID: 72f0fad5-906a-4ed9-a922-fdb13010a34d with Priority: HIGHEST for action security_group_members [ 1303.815357] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 72f0fad5-906a-4ed9-a922-fdb13010a34d with Priority: HIGHEST for action security_group_members [ 1303.815685] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-72f0fad5-906a-4ed9-a922-fdb13010a34d taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1303.815819] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-72f0fad5-906a-4ed9-a922-fdb13010a34d" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1303.815888] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-72f0fad5-906a-4ed9-a922-fdb13010a34d" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1303.816134] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-72f0fad5-906a-4ed9-a922-fdb13010a34d" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1303.816297] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1303.816381] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1303.816444] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1303.816589] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1303.816675] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1303.816766] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('72f0fad5-906a-4ed9-a922-fdb13010a34d',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1304.083932] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock network-29 taken with stack trace [, , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1304.084223] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "network-29" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1304.084312] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "network-29" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1304.084581] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "network-29" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1304.084848] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1304.085015] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1304.085138] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1304.085406] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1304.085594] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1304.085829] env[69980]: DEBUG dogpile.cache.region [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] No value present for key: 'zone-id' {{(pid=69980) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1304.085948] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] NeedRegenerationException {{(pid=69980) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1304.086071] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] no value, waiting for create lock {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1304.086206] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] value creation lock acquired {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1304.086324] env[69980]: DEBUG dogpile.cache.region [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] No value present for key: 'zone-id' {{(pid=69980) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1304.086431] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Calling creation function for not-yet-present value {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1304.086566] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1304.109612] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1f8e99ba-e1d1-4cdc-98f5-ccb8c37ca66e in Status: SUCCESS [ 1304.109825] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1f8e99ba-e1d1-4cdc-98f5-ccb8c37ca66e" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1304.110669] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1304.110831] env[69980]: DEBUG dogpile.cache.region [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=69980) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1304.110973] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Released creation lock {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1304.111156] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "network-29" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1304.111453] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock port-ddf3c49c-2d22-47b7-935b-0c412d6949fd taken with stack trace [, , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1304.111623] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "port-ddf3c49c-2d22-47b7-935b-0c412d6949fd" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1304.111776] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "port-ddf3c49c-2d22-47b7-935b-0c412d6949fd" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1304.112055] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "port-ddf3c49c-2d22-47b7-935b-0c412d6949fd" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1304.112205] env[69980]: DEBUG networking_nsxv3.api.rpc [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ddf3c49c-2d22-47b7-935b-0c412d6949fd',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1304.318555] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1304.318758] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1304.318804] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1304.318989] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1304.319097] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1304.319307] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1304.319447] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1304.319531] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1304.319675] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1304.319752] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1304.319838] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 72f0fad5-906a-4ed9-a922-fdb13010a34d is going to be updated. [ 1304.348741] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1304.348966] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1304.349087] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1304.349413] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1304.349647] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1304.358444] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 72f0fad5-906a-4ed9-a922-fdb13010a34d in Status: IN_PROGRESS for 2s [ 1304.618261] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1304.618261] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1304.618261] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1304.618638] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1304.618879] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1304.619078] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Segment Port ddf3c49c-2d22-47b7-935b-0c412d6949fd not found, creating... [ 1304.619421] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1304.619626] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1304.619792] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1304.620067] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1304.620268] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1304.620603] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1304.620775] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1304.620875] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1304.624099] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1304.624291] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1304.624506] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Resource: SegmentPort with ID: ddf3c49c-2d22-47b7-935b-0c412d6949fd is going to be created. [ 1304.644818] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1304.645117] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1304.645253] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1304.645594] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1304.646025] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1304.646722] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "port-ddf3c49c-2d22-47b7-935b-0c412d6949fd" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1305.379466] env[69980]: INFO networking_nsxv3.common.synchronization [req-28716b23-ad46-45cd-a97c-97431e1d2dfe req-31e9ab7c-ffe2-403d-9e68-6ea1808c5987 service nova] Enqueued Resource ID: 72f0fad5-906a-4ed9-a922-fdb13010a34d with Priority: HIGHEST for action security_group_rules [ 1305.379466] env[69980]: INFO networking_nsxv3.common.synchronization [req-28716b23-ad46-45cd-a97c-97431e1d2dfe req-31e9ab7c-ffe2-403d-9e68-6ea1808c5987 service nova] Enqueued Resource ID: 72f0fad5-906a-4ed9-a922-fdb13010a34d with Priority: HIGHEST for action security_group_members [ 1305.379466] env[69980]: INFO networking_nsxv3.common.synchronization [req-28716b23-ad46-45cd-a97c-97431e1d2dfe req-31e9ab7c-ffe2-403d-9e68-6ea1808c5987 service nova] Enqueued Resource ID: ddf3c49c-2d22-47b7-935b-0c412d6949fd with Priority: HIGHEST for action port [ 1305.379466] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 72f0fad5-906a-4ed9-a922-fdb13010a34d with Priority: HIGHEST for action security_group_rules [ 1305.379466] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 72f0fad5-906a-4ed9-a922-fdb13010a34d with Priority: HIGHEST for action security_group_members [ 1305.379836] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ddf3c49c-2d22-47b7-935b-0c412d6949fd with Priority: HIGHEST for action port [ 1305.380574] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock rules-72f0fad5-906a-4ed9-a922-fdb13010a34d taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1305.380574] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-72f0fad5-906a-4ed9-a922-fdb13010a34d" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1305.380574] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-72f0fad5-906a-4ed9-a922-fdb13010a34d" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1305.380574] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-72f0fad5-906a-4ed9-a922-fdb13010a34d" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1305.380574] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('72f0fad5-906a-4ed9-a922-fdb13010a34d',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1305.382193] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-72f0fad5-906a-4ed9-a922-fdb13010a34d taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1305.382193] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-72f0fad5-906a-4ed9-a922-fdb13010a34d" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1305.382193] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock port-ddf3c49c-2d22-47b7-935b-0c412d6949fd taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1305.382193] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ddf3c49c-2d22-47b7-935b-0c412d6949fd" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1305.382193] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ddf3c49c-2d22-47b7-935b-0c412d6949fd" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1305.382193] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ddf3c49c-2d22-47b7-935b-0c412d6949fd" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1305.382193] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ddf3c49c-2d22-47b7-935b-0c412d6949fd',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1305.884600] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-72f0fad5-906a-4ed9-a922-fdb13010a34d taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1305.884852] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-72f0fad5-906a-4ed9-a922-fdb13010a34d" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1305.884925] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port ddf3c49c-2d22-47b7-935b-0c412d6949fd with status ACTIVE [ 1305.885081] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1305.885189] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1305.885246] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1305.885488] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1305.885584] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1305.885758] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1305.885857] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1305.885913] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1305.886098] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1305.886194] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1305.886379] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1305.886474] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1305.886532] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1305.886671] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1305.886783] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1305.886833] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: ddf3c49c-2d22-47b7-935b-0c412d6949fd is going to be updated. [ 1305.912689] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1305.912874] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1305.912874] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1305.913078] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1305.913212] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1305.913369] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ddf3c49c-2d22-47b7-935b-0c412d6949fd" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1306.368939] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 72f0fad5-906a-4ed9-a922-fdb13010a34d in Status: SUCCESS [ 1306.369197] env[69980]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 72f0fad5-906a-4ed9-a922-fdb13010a34d deletion is rescheduled due to dependency. [ 1306.369334] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-72f0fad5-906a-4ed9-a922-fdb13010a34d" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1306.369553] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-72f0fad5-906a-4ed9-a922-fdb13010a34d" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1306.369832] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-72f0fad5-906a-4ed9-a922-fdb13010a34d" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1306.370077] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1306.370232] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1306.370332] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1306.370509] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1306.370658] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1306.370762] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('72f0fad5-906a-4ed9-a922-fdb13010a34d',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1306.873603] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('72f0fad5-906a-4ed9-a922-fdb13010a34d',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1307.376424] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('72f0fad5-906a-4ed9-a922-fdb13010a34d',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1307.663156] env[69980]: INFO networking_nsxv3.common.synchronization [req-85a563af-496c-4533-ac42-0a8d648e7cd8 req-3222f022-009a-4676-962c-442d89b83156 tempest-AttachInterfacesTestJSON-1782090316 tempest-AttachInterfacesTestJSON-1782090316-project-member] Enqueued Resource ID: 1f8e99ba-e1d1-4cdc-98f5-ccb8c37ca66e with Priority: HIGHEST for action security_group_members [ 1307.663829] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1f8e99ba-e1d1-4cdc-98f5-ccb8c37ca66e with Priority: HIGHEST for action security_group_members [ 1307.664179] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-1f8e99ba-e1d1-4cdc-98f5-ccb8c37ca66e taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1307.664684] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1f8e99ba-e1d1-4cdc-98f5-ccb8c37ca66e" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1307.664684] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1f8e99ba-e1d1-4cdc-98f5-ccb8c37ca66e" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1307.664684] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1f8e99ba-e1d1-4cdc-98f5-ccb8c37ca66e" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1307.664950] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1307.664950] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1307.664950] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1307.665072] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1307.665202] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1307.665240] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1f8e99ba-e1d1-4cdc-98f5-ccb8c37ca66e',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1307.878711] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1307.878993] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1307.878993] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1307.879185] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1307.879283] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1307.879384] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 72f0fad5-906a-4ed9-a922-fdb13010a34d is going to be updated. [ 1307.906519] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1307.906519] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1307.906665] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1307.906849] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1307.906995] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1307.916860] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 72f0fad5-906a-4ed9-a922-fdb13010a34d in Status: IN_PROGRESS for 2s [ 1308.167992] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1308.168131] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1308.168289] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1308.168475] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1308.168532] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1308.168709] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1308.168809] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1308.168870] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1308.169021] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1308.169099] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1308.169184] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1f8e99ba-e1d1-4cdc-98f5-ccb8c37ca66e is going to be updated. [ 1308.195139] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1308.195265] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1308.195368] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1308.195521] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1308.195652] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1308.203738] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1f8e99ba-e1d1-4cdc-98f5-ccb8c37ca66e in Status: IN_PROGRESS for 2s [ 1309.926068] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 72f0fad5-906a-4ed9-a922-fdb13010a34d in Status: SUCCESS [ 1309.927150] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-72f0fad5-906a-4ed9-a922-fdb13010a34d" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1309.927150] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-72f0fad5-906a-4ed9-a922-fdb13010a34d" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1309.927150] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-72f0fad5-906a-4ed9-a922-fdb13010a34d" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1309.927150] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1309.927150] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1309.927150] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1309.927383] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1309.927383] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1309.927447] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-72f0fad5-906a-4ed9-a922-fdb13010a34d" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1309.927511] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('72f0fad5-906a-4ed9-a922-fdb13010a34d',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1310.213746] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1f8e99ba-e1d1-4cdc-98f5-ccb8c37ca66e in Status: SUCCESS [ 1310.213932] env[69980]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1f8e99ba-e1d1-4cdc-98f5-ccb8c37ca66e deletion is rescheduled due to dependency. [ 1310.214066] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1f8e99ba-e1d1-4cdc-98f5-ccb8c37ca66e" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1310.431191] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('72f0fad5-906a-4ed9-a922-fdb13010a34d',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1310.934360] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 72f0fad5-906a-4ed9-a922-fdb13010a34d: rpc.has_security_group_logging(os_id): False [ 1310.954964] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1310.955203] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1310.955322] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1310.955626] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1310.955765] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1310.956131] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1310.956278] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1310.956370] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1310.956593] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1310.956727] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1310.956863] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 72f0fad5-906a-4ed9-a922-fdb13010a34d is going to be updated. [ 1311.023448] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1311.023675] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1311.023795] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1311.024134] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1311.024333] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1311.037244] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 72f0fad5-906a-4ed9-a922-fdb13010a34d in Status: IN_PROGRESS for 2s [ 1312.073041] env[69980]: INFO networking_nsxv3.common.synchronization [None req-920cf9e4-bb14-427e-940b-88c93b058473 tempest-AttachInterfacesTestJSON-1782090316 tempest-AttachInterfacesTestJSON-1782090316-project-member] Enqueued Resource ID: e63cb46c-ccab-4856-bf25-2380514e2780 with Priority: HIGHEST for action security_group_members [ 1312.073418] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e63cb46c-ccab-4856-bf25-2380514e2780 with Priority: HIGHEST for action security_group_members [ 1312.073519] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-e63cb46c-ccab-4856-bf25-2380514e2780 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1312.073695] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e63cb46c-ccab-4856-bf25-2380514e2780" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1312.074788] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e63cb46c-ccab-4856-bf25-2380514e2780" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1312.075109] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e63cb46c-ccab-4856-bf25-2380514e2780" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1312.075391] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1312.075571] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1312.075657] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1312.075936] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1312.076111] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1312.076299] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e63cb46c-ccab-4856-bf25-2380514e2780',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1312.581089] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1312.581089] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1312.581089] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1312.581089] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1312.581089] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1312.581089] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1312.581089] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1312.581089] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1312.581089] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1312.581089] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1312.581089] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e63cb46c-ccab-4856-bf25-2380514e2780 is going to be updated. [ 1312.608440] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1312.609054] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1312.609338] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1312.609734] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1312.611094] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1312.618298] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e63cb46c-ccab-4856-bf25-2380514e2780 in Status: IN_PROGRESS for 2s [ 1312.693211] env[69980]: INFO networking_nsxv3.common.synchronization [req-b768b496-80c4-4839-91bc-0288e0170df3 req-266a3fef-4de3-41d2-8e5b-2c6625be7bff tempest-AttachVolumeShelveTestJSON-1941643989 tempest-AttachVolumeShelveTestJSON-1941643989-project-member] Enqueued Resource ID: 3909a119-b9ca-4e95-b2b4-3541d0886a49 with Priority: HIGHEST for action security_group_members [ 1312.693211] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3909a119-b9ca-4e95-b2b4-3541d0886a49 with Priority: HIGHEST for action security_group_members [ 1312.695712] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-3909a119-b9ca-4e95-b2b4-3541d0886a49 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1312.695712] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3909a119-b9ca-4e95-b2b4-3541d0886a49" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1312.695712] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3909a119-b9ca-4e95-b2b4-3541d0886a49" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1312.695712] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3909a119-b9ca-4e95-b2b4-3541d0886a49" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1312.695712] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1312.695712] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1312.695712] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1312.695712] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1312.695712] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1312.696282] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3909a119-b9ca-4e95-b2b4-3541d0886a49',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1313.051259] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 72f0fad5-906a-4ed9-a922-fdb13010a34d in Status: SUCCESS [ 1313.051259] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-72f0fad5-906a-4ed9-a922-fdb13010a34d" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1313.203119] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1313.203119] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1313.203119] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1313.203119] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1313.203119] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1313.203119] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1313.203119] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1313.203119] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1313.203119] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1313.203119] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1313.203119] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3909a119-b9ca-4e95-b2b4-3541d0886a49 is going to be updated. [ 1313.227178] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1313.229687] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1313.229687] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1313.229687] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1313.229687] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1313.235988] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3909a119-b9ca-4e95-b2b4-3541d0886a49 in Status: IN_PROGRESS for 2s [ 1314.628358] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e63cb46c-ccab-4856-bf25-2380514e2780 in Status: IN_PROGRESS for 4s [ 1315.246053] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3909a119-b9ca-4e95-b2b4-3541d0886a49 in Status: SUCCESS [ 1315.246053] env[69980]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3909a119-b9ca-4e95-b2b4-3541d0886a49 deletion is rescheduled due to dependency. [ 1315.246257] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3909a119-b9ca-4e95-b2b4-3541d0886a49" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1316.638168] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e63cb46c-ccab-4856-bf25-2380514e2780 in Status: SUCCESS [ 1316.638482] env[69980]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e63cb46c-ccab-4856-bf25-2380514e2780 deletion is rescheduled due to dependency. [ 1316.638538] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e63cb46c-ccab-4856-bf25-2380514e2780" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1317.676989] env[69980]: INFO networking_nsxv3.common.synchronization [req-56ea8a11-ffe4-4b4c-82f7-0e2b4c94fb2b req-b1a25780-bce0-41da-a479-7669a346bdc2 tempest-ServerRescueNegativeTestJSON-1270382253 tempest-ServerRescueNegativeTestJSON-1270382253-project-member] Enqueued Resource ID: c27e63f9-6090-4aea-a9d5-e84fb1046cb3 with Priority: HIGHEST for action security_group_members [ 1317.677972] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c27e63f9-6090-4aea-a9d5-e84fb1046cb3 with Priority: HIGHEST for action security_group_members [ 1317.677972] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-c27e63f9-6090-4aea-a9d5-e84fb1046cb3 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1317.677972] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c27e63f9-6090-4aea-a9d5-e84fb1046cb3" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1317.678155] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c27e63f9-6090-4aea-a9d5-e84fb1046cb3" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1317.678592] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c27e63f9-6090-4aea-a9d5-e84fb1046cb3" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1317.678592] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1317.678592] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1317.678592] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1317.678776] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1317.678776] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1317.678873] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c27e63f9-6090-4aea-a9d5-e84fb1046cb3',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1318.043815] env[69980]: INFO networking_nsxv3.common.synchronization [None req-a5d099fc-5474-445f-8346-e567f9a7e4e7 tempest-AttachVolumeShelveTestJSON-1941643989 tempest-AttachVolumeShelveTestJSON-1941643989-project-member] Enqueued Resource ID: 23fa8e46-c46e-429c-b533-b6ee73936de0 with Priority: HIGHEST for action security_group_rules [ 1318.044432] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 23fa8e46-c46e-429c-b533-b6ee73936de0 with Priority: HIGHEST for action security_group_rules [ 1318.044709] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock rules-23fa8e46-c46e-429c-b533-b6ee73936de0 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1318.044852] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-23fa8e46-c46e-429c-b533-b6ee73936de0" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1318.044922] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-23fa8e46-c46e-429c-b533-b6ee73936de0" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1318.046888] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-23fa8e46-c46e-429c-b533-b6ee73936de0" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1318.046888] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('23fa8e46-c46e-429c-b533-b6ee73936de0',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1318.125234] env[69980]: INFO networking_nsxv3.common.synchronization [None req-9e9b9171-cf30-4cc9-be52-1711f98d2e68 tempest-AttachVolumeShelveTestJSON-1941643989 tempest-AttachVolumeShelveTestJSON-1941643989-project-member] Enqueued Resource ID: 23fa8e46-c46e-429c-b533-b6ee73936de0 with Priority: HIGHEST for action security_group_rules [ 1318.125661] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 23fa8e46-c46e-429c-b533-b6ee73936de0 with Priority: HIGHEST for action security_group_rules [ 1318.126020] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock rules-23fa8e46-c46e-429c-b533-b6ee73936de0 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1318.126138] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-23fa8e46-c46e-429c-b533-b6ee73936de0" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1318.181311] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1318.181478] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1318.181478] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1318.181692] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1318.181785] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1318.181981] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1318.182093] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1318.182167] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1318.182367] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1318.182367] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1318.182519] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c27e63f9-6090-4aea-a9d5-e84fb1046cb3 is going to be updated. [ 1318.208172] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1318.208326] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1318.208562] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1318.208773] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1318.208928] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1318.217366] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c27e63f9-6090-4aea-a9d5-e84fb1046cb3 in Status: IN_PROGRESS for 2s [ 1318.566726] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1318.566870] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1318.566947] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1318.567195] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1318.567286] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1318.567383] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 23fa8e46-c46e-429c-b533-b6ee73936de0 already deleted. [ 1318.567465] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-23fa8e46-c46e-429c-b533-b6ee73936de0" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1318.567614] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-23fa8e46-c46e-429c-b533-b6ee73936de0" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1318.567772] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-23fa8e46-c46e-429c-b533-b6ee73936de0" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1318.567855] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('23fa8e46-c46e-429c-b533-b6ee73936de0',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1318.901616] env[69980]: INFO networking_nsxv3.common.synchronization [req-5a2ddcba-60ce-4c65-ad50-db5acd69819b req-a3f68eb6-12f6-4f3d-b4c3-de774e44d6cb tempest-ServerActionsTestJSON-1479580870 tempest-ServerActionsTestJSON-1479580870-project-member] Enqueued Resource ID: 00f20236-2b69-46dc-a00f-0c4d6b93c17a with Priority: HIGHEST for action security_group_members [ 1318.902155] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 00f20236-2b69-46dc-a00f-0c4d6b93c17a with Priority: HIGHEST for action security_group_members [ 1318.902714] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-00f20236-2b69-46dc-a00f-0c4d6b93c17a taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1318.902714] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-00f20236-2b69-46dc-a00f-0c4d6b93c17a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1318.902714] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-00f20236-2b69-46dc-a00f-0c4d6b93c17a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1318.902892] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-00f20236-2b69-46dc-a00f-0c4d6b93c17a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1318.903422] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1318.903422] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1318.903422] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1318.903586] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1318.903586] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1318.905917] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('00f20236-2b69-46dc-a00f-0c4d6b93c17a',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1319.091341] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1319.091517] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1319.091602] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1319.091768] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1319.091851] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1319.091948] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 23fa8e46-c46e-429c-b533-b6ee73936de0 already deleted. [ 1319.092398] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-23fa8e46-c46e-429c-b533-b6ee73936de0" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1319.406062] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1319.406062] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1319.406062] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1319.406330] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1319.425981] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1319.426236] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1319.426448] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1319.426448] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1319.426641] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1319.426730] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1319.426824] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 00f20236-2b69-46dc-a00f-0c4d6b93c17a is going to be updated. [ 1319.450350] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1319.450525] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1319.450525] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1319.450721] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1319.450864] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1319.458016] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 00f20236-2b69-46dc-a00f-0c4d6b93c17a in Status: IN_PROGRESS for 2s [ 1320.226567] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c27e63f9-6090-4aea-a9d5-e84fb1046cb3 in Status: SUCCESS [ 1320.226906] env[69980]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c27e63f9-6090-4aea-a9d5-e84fb1046cb3 deletion is rescheduled due to dependency. [ 1320.226906] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c27e63f9-6090-4aea-a9d5-e84fb1046cb3" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1321.468286] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 00f20236-2b69-46dc-a00f-0c4d6b93c17a in Status: SUCCESS [ 1321.468709] env[69980]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 00f20236-2b69-46dc-a00f-0c4d6b93c17a deletion is rescheduled due to dependency. [ 1321.468709] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-00f20236-2b69-46dc-a00f-0c4d6b93c17a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1323.903702] env[69980]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1323.903702] env[69980]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1324.083419] env[69980]: INFO networking_nsxv3.common.synchronization [req-c31e3295-625c-4f63-b89f-eddb845130b3 req-8aac8988-bad9-472d-b761-835a69d667f4 tempest-ServerActionsTestOtherA-1240783872 tempest-ServerActionsTestOtherA-1240783872-project-member] Enqueued Resource ID: 9057c45b-1d82-49a9-8ffb-aaf0cddf5801 with Priority: HIGHEST for action security_group_members [ 1324.084047] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9057c45b-1d82-49a9-8ffb-aaf0cddf5801 with Priority: HIGHEST for action security_group_members [ 1324.084254] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-9057c45b-1d82-49a9-8ffb-aaf0cddf5801 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1324.084350] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9057c45b-1d82-49a9-8ffb-aaf0cddf5801" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1324.084388] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9057c45b-1d82-49a9-8ffb-aaf0cddf5801" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1324.084605] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9057c45b-1d82-49a9-8ffb-aaf0cddf5801" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1324.084817] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1324.084920] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1324.084965] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1324.085220] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1324.085335] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1324.085452] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9057c45b-1d82-49a9-8ffb-aaf0cddf5801',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1324.345611] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock network-714 taken with stack trace [, , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1324.345846] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "network-714" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1324.345977] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "network-714" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1324.346258] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "network-714" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1324.346513] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1324.347213] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1324.347213] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1324.347213] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1324.347527] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1324.347683] env[69980]: DEBUG dogpile.cache.region [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] No value present for key: 'zone-id' {{(pid=69980) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1324.347892] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] NeedRegenerationException {{(pid=69980) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1324.348054] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] no value, waiting for create lock {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1324.348201] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] value creation lock acquired {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1324.348330] env[69980]: DEBUG dogpile.cache.region [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] No value present for key: 'zone-id' {{(pid=69980) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1324.348549] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Calling creation function for not-yet-present value {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1324.348971] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1324.368232] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1324.368453] env[69980]: DEBUG dogpile.cache.region [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=69980) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1324.368591] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Released creation lock {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1324.368807] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "network-714" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1324.369143] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock port-75babed0-d83b-446d-b434-f0d7f9c2962a taken with stack trace [, , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1324.369341] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "port-75babed0-d83b-446d-b434-f0d7f9c2962a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1324.369432] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "port-75babed0-d83b-446d-b434-f0d7f9c2962a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1324.370031] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "port-75babed0-d83b-446d-b434-f0d7f9c2962a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1324.370031] env[69980]: DEBUG networking_nsxv3.api.rpc [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('75babed0-d83b-446d-b434-f0d7f9c2962a',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1324.589221] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9057c45b-1d82-49a9-8ffb-aaf0cddf5801',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1324.874373] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1324.874373] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1324.874373] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1324.874373] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1324.874373] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1324.874373] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Segment Port 75babed0-d83b-446d-b434-f0d7f9c2962a not found, creating... [ 1324.874373] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1324.874373] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1324.874373] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1324.874796] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1324.874796] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1324.875149] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1324.875366] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1324.875554] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1324.875896] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1324.876062] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1324.876252] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Resource: SegmentPort with ID: 75babed0-d83b-446d-b434-f0d7f9c2962a is going to be created. [ 1324.895361] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1324.895600] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1324.896542] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1324.896542] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1324.896542] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1324.897806] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "port-75babed0-d83b-446d-b434-f0d7f9c2962a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1325.091339] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9057c45b-1d82-49a9-8ffb-aaf0cddf5801',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1325.582034] env[69980]: INFO networking_nsxv3.common.synchronization [req-c31e3295-625c-4f63-b89f-eddb845130b3 req-e4a0e4e0-c644-4b22-bff5-fb3a11da52b4 service nova] Enqueued Resource ID: 9057c45b-1d82-49a9-8ffb-aaf0cddf5801 with Priority: HIGHEST for action security_group_rules [ 1325.582034] env[69980]: INFO networking_nsxv3.common.synchronization [req-c31e3295-625c-4f63-b89f-eddb845130b3 req-e4a0e4e0-c644-4b22-bff5-fb3a11da52b4 service nova] Enqueued Resource ID: 9057c45b-1d82-49a9-8ffb-aaf0cddf5801 with Priority: HIGHEST for action security_group_members [ 1325.582034] env[69980]: INFO networking_nsxv3.common.synchronization [req-c31e3295-625c-4f63-b89f-eddb845130b3 req-e4a0e4e0-c644-4b22-bff5-fb3a11da52b4 service nova] Enqueued Resource ID: 75babed0-d83b-446d-b434-f0d7f9c2962a with Priority: HIGHEST for action port [ 1325.582269] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9057c45b-1d82-49a9-8ffb-aaf0cddf5801 with Priority: HIGHEST for action security_group_rules [ 1325.582317] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9057c45b-1d82-49a9-8ffb-aaf0cddf5801 with Priority: HIGHEST for action security_group_members [ 1325.582419] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 75babed0-d83b-446d-b434-f0d7f9c2962a with Priority: HIGHEST for action port [ 1325.583021] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9057c45b-1d82-49a9-8ffb-aaf0cddf5801 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1325.583276] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9057c45b-1d82-49a9-8ffb-aaf0cddf5801" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1325.583426] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9057c45b-1d82-49a9-8ffb-aaf0cddf5801" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1325.583699] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9057c45b-1d82-49a9-8ffb-aaf0cddf5801" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1325.583875] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9057c45b-1d82-49a9-8ffb-aaf0cddf5801',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1325.586292] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-9057c45b-1d82-49a9-8ffb-aaf0cddf5801 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1325.586429] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9057c45b-1d82-49a9-8ffb-aaf0cddf5801" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1325.586707] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock port-75babed0-d83b-446d-b434-f0d7f9c2962a taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1325.586857] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-75babed0-d83b-446d-b434-f0d7f9c2962a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1325.587088] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-75babed0-d83b-446d-b434-f0d7f9c2962a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1325.587315] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-75babed0-d83b-446d-b434-f0d7f9c2962a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1325.588731] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('75babed0-d83b-446d-b434-f0d7f9c2962a',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1325.593665] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1325.593776] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1325.593835] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1325.594036] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1325.594179] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1325.594210] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9057c45b-1d82-49a9-8ffb-aaf0cddf5801 is going to be updated. [ 1325.620441] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1325.620638] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1325.620796] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1325.621059] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1325.621244] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1325.628840] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9057c45b-1d82-49a9-8ffb-aaf0cddf5801 in Status: IN_PROGRESS for 2s [ 1326.092106] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-9057c45b-1d82-49a9-8ffb-aaf0cddf5801 taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1326.092485] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9057c45b-1d82-49a9-8ffb-aaf0cddf5801" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1326.092485] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 75babed0-d83b-446d-b434-f0d7f9c2962a with status ACTIVE [ 1326.092766] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1326.092766] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1326.092917] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1326.092990] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1326.093076] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1326.093258] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1326.093362] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1326.093445] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1326.093602] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1326.093680] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1326.093859] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1326.093952] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1326.094033] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1326.094166] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1326.094236] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1326.094321] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 75babed0-d83b-446d-b434-f0d7f9c2962a is going to be updated. [ 1326.113118] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1326.113272] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1326.113272] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1326.113464] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1326.113598] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1326.113758] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-75babed0-d83b-446d-b434-f0d7f9c2962a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1326.188309] env[69980]: INFO networking_nsxv3.common.synchronization [req-a915dd0e-b4c1-45f4-b11c-a37b3d1d6419 req-752d2fe0-2ac3-4fc6-a394-aefa660fd6e4 tempest-AttachVolumeShelveTestJSON-1941643989 tempest-AttachVolumeShelveTestJSON-1941643989-project-member] Enqueued Resource ID: 23fa8e46-c46e-429c-b533-b6ee73936de0 with Priority: HIGHEST for action security_group_members [ 1326.188880] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 23fa8e46-c46e-429c-b533-b6ee73936de0 with Priority: HIGHEST for action security_group_members [ 1326.189191] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-23fa8e46-c46e-429c-b533-b6ee73936de0 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1326.189312] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-23fa8e46-c46e-429c-b533-b6ee73936de0" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1326.189382] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-23fa8e46-c46e-429c-b533-b6ee73936de0" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1326.189634] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-23fa8e46-c46e-429c-b533-b6ee73936de0" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1326.189781] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1326.189879] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1326.189939] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1326.190100] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1326.190184] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1326.190275] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('23fa8e46-c46e-429c-b533-b6ee73936de0',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1326.494224] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock network-472 taken with stack trace [, , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1326.494435] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "network-472" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1326.494567] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "network-472" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1326.494841] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "network-472" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1326.495119] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1326.495280] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1326.495399] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1326.495616] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1326.495765] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1326.495975] env[69980]: DEBUG dogpile.cache.region [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] No value present for key: 'zone-id' {{(pid=69980) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1326.496101] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] NeedRegenerationException {{(pid=69980) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1326.496212] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] no value, waiting for create lock {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1326.496322] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] value creation lock acquired {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1326.496463] env[69980]: DEBUG dogpile.cache.region [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] No value present for key: 'zone-id' {{(pid=69980) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1326.496576] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Calling creation function for not-yet-present value {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1326.496712] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1326.516013] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1326.516199] env[69980]: DEBUG dogpile.cache.region [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=69980) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1326.516358] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Released creation lock {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1326.516613] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "network-472" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1326.516964] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock port-4771828a-e218-4937-b79e-0841c57da8c7 taken with stack trace [, , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1326.517169] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "port-4771828a-e218-4937-b79e-0841c57da8c7" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1326.517358] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "port-4771828a-e218-4937-b79e-0841c57da8c7" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1326.517727] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "port-4771828a-e218-4937-b79e-0841c57da8c7" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1326.517910] env[69980]: DEBUG networking_nsxv3.api.rpc [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4771828a-e218-4937-b79e-0841c57da8c7',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1326.692621] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1326.692780] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1326.692840] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1326.693063] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1326.693166] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1326.693364] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1326.693466] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1326.693527] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1326.693679] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1326.693757] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1326.693843] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 23fa8e46-c46e-429c-b533-b6ee73936de0 already deleted. [ 1326.693925] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-23fa8e46-c46e-429c-b533-b6ee73936de0" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1327.020191] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1327.020432] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1327.020562] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1327.020930] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1327.021121] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1327.021283] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Segment Port 4771828a-e218-4937-b79e-0841c57da8c7 not found, creating... [ 1327.021549] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1327.021710] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1327.021830] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1327.022074] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1327.022220] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1327.022502] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1327.022686] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1327.022815] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1327.023037] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1327.023180] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1327.023323] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Resource: SegmentPort with ID: 4771828a-e218-4937-b79e-0841c57da8c7 is going to be created. [ 1327.043666] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1327.043860] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1327.043986] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1327.044265] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1327.044486] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1327.044742] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "port-4771828a-e218-4937-b79e-0841c57da8c7" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1327.637265] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9057c45b-1d82-49a9-8ffb-aaf0cddf5801 in Status: IN_PROGRESS for 4s [ 1327.745412] env[69980]: INFO networking_nsxv3.common.synchronization [req-a915dd0e-b4c1-45f4-b11c-a37b3d1d6419 req-792b1255-ecc9-4245-ace0-400125f74366 service nova] Enqueued Resource ID: 23fa8e46-c46e-429c-b533-b6ee73936de0 with Priority: HIGHEST for action security_group_rules [ 1327.745587] env[69980]: INFO networking_nsxv3.common.synchronization [req-a915dd0e-b4c1-45f4-b11c-a37b3d1d6419 req-792b1255-ecc9-4245-ace0-400125f74366 service nova] Enqueued Resource ID: 23fa8e46-c46e-429c-b533-b6ee73936de0 with Priority: HIGHEST for action security_group_members [ 1327.745697] env[69980]: INFO networking_nsxv3.common.synchronization [req-a915dd0e-b4c1-45f4-b11c-a37b3d1d6419 req-792b1255-ecc9-4245-ace0-400125f74366 service nova] Enqueued Resource ID: 4771828a-e218-4937-b79e-0841c57da8c7 with Priority: HIGHEST for action port [ 1327.746021] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 23fa8e46-c46e-429c-b533-b6ee73936de0 with Priority: HIGHEST for action security_group_rules [ 1327.746158] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 23fa8e46-c46e-429c-b533-b6ee73936de0 with Priority: HIGHEST for action security_group_members [ 1327.746256] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4771828a-e218-4937-b79e-0841c57da8c7 with Priority: HIGHEST for action port [ 1327.746822] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock rules-23fa8e46-c46e-429c-b533-b6ee73936de0 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1327.746951] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-23fa8e46-c46e-429c-b533-b6ee73936de0" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1327.747230] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-23fa8e46-c46e-429c-b533-b6ee73936de0" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1327.747492] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-23fa8e46-c46e-429c-b533-b6ee73936de0" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1327.747626] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('23fa8e46-c46e-429c-b533-b6ee73936de0',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1327.749130] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-23fa8e46-c46e-429c-b533-b6ee73936de0 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1327.749255] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-23fa8e46-c46e-429c-b533-b6ee73936de0" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1327.749345] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-23fa8e46-c46e-429c-b533-b6ee73936de0" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1327.749554] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-23fa8e46-c46e-429c-b533-b6ee73936de0" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1327.750065] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1327.750232] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1327.750285] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1327.750471] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1327.750564] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1327.750654] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('23fa8e46-c46e-429c-b533-b6ee73936de0',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1327.751476] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock port-4771828a-e218-4937-b79e-0841c57da8c7 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1327.751589] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4771828a-e218-4937-b79e-0841c57da8c7" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1327.751671] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4771828a-e218-4937-b79e-0841c57da8c7" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1327.751828] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4771828a-e218-4937-b79e-0841c57da8c7" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1327.751904] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4771828a-e218-4937-b79e-0841c57da8c7',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1328.257022] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-23fa8e46-c46e-429c-b533-b6ee73936de0 taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1328.257022] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-23fa8e46-c46e-429c-b533-b6ee73936de0" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1328.257022] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('23fa8e46-c46e-429c-b533-b6ee73936de0',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1328.257022] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 4771828a-e218-4937-b79e-0841c57da8c7 with status ACTIVE [ 1328.257022] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1328.257022] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1328.257022] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1328.257022] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1328.257022] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1328.257022] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1328.257022] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1328.257022] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1328.257022] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1328.257022] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1328.257555] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1328.257555] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1328.257555] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1328.257555] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1328.257555] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1328.257555] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 4771828a-e218-4937-b79e-0841c57da8c7 is going to be updated. [ 1328.278074] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1328.278303] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1328.278428] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1328.278813] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1328.278934] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1328.279144] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4771828a-e218-4937-b79e-0841c57da8c7" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1328.759448] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('23fa8e46-c46e-429c-b533-b6ee73936de0',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1329.221227] env[69980]: INFO networking_nsxv3.common.synchronization [req-f7b5316b-68d6-44fb-87cd-4f5b619a08c6 req-4f598451-c7c8-47bc-9bfe-597be7b384e5 tempest-ServerRescueNegativeTestJSON-1270382253 tempest-ServerRescueNegativeTestJSON-1270382253-project-member] Enqueued Resource ID: f0f521c8-595e-4f1b-a139-3ce8948484da with Priority: HIGHEST for action security_group_members [ 1329.221227] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f0f521c8-595e-4f1b-a139-3ce8948484da with Priority: HIGHEST for action security_group_members [ 1329.221328] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-f0f521c8-595e-4f1b-a139-3ce8948484da taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1329.221519] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f0f521c8-595e-4f1b-a139-3ce8948484da" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1329.221614] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f0f521c8-595e-4f1b-a139-3ce8948484da" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1329.222524] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f0f521c8-595e-4f1b-a139-3ce8948484da" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1329.222524] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1329.222524] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1329.222524] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1329.222524] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1329.222524] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1329.222524] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f0f521c8-595e-4f1b-a139-3ce8948484da',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1329.261951] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1329.262207] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1329.262207] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1329.262432] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1329.262522] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1329.262619] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 23fa8e46-c46e-429c-b533-b6ee73936de0 is going to be created. [ 1329.283851] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1329.283995] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1329.284079] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1329.284288] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1329.284445] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1329.293050] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 23fa8e46-c46e-429c-b533-b6ee73936de0 in Status: UNINITIALIZED for 2s [ 1329.516276] env[69980]: INFO networking_nsxv3.common.synchronization [req-51d65917-cb84-45e5-b7b1-58b45e89000b req-cb4d612d-3d76-488f-84c8-af4fef34deb1 tempest-ServerActionsTestJSON-1479580870 tempest-ServerActionsTestJSON-1479580870-project-member] Enqueued Resource ID: 00f20236-2b69-46dc-a00f-0c4d6b93c17a with Priority: HIGHEST for action security_group_members [ 1329.516276] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 00f20236-2b69-46dc-a00f-0c4d6b93c17a with Priority: HIGHEST for action security_group_members [ 1329.516564] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-00f20236-2b69-46dc-a00f-0c4d6b93c17a taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1329.516666] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-00f20236-2b69-46dc-a00f-0c4d6b93c17a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1329.516724] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-00f20236-2b69-46dc-a00f-0c4d6b93c17a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1329.516972] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-00f20236-2b69-46dc-a00f-0c4d6b93c17a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1329.517153] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1329.517259] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1329.517325] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1329.518029] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1329.518029] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1329.518029] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('00f20236-2b69-46dc-a00f-0c4d6b93c17a',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1329.648105] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9057c45b-1d82-49a9-8ffb-aaf0cddf5801 in Status: SUCCESS [ 1329.648105] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9057c45b-1d82-49a9-8ffb-aaf0cddf5801" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1329.649108] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9057c45b-1d82-49a9-8ffb-aaf0cddf5801" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1329.649371] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9057c45b-1d82-49a9-8ffb-aaf0cddf5801" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1329.649612] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1329.649727] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1329.649793] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1329.649968] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1329.650188] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1329.650188] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9057c45b-1d82-49a9-8ffb-aaf0cddf5801',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1329.724153] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f0f521c8-595e-4f1b-a139-3ce8948484da',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1329.752025] env[69980]: INFO networking_nsxv3.common.synchronization [req-1b54cf2b-3010-4e1c-802c-67748f17530f req-14da452c-b240-472f-bd62-45cce9134e64 tempest-AttachVolumeTestJSON-92929017 tempest-AttachVolumeTestJSON-92929017-project-member] Enqueued Resource ID: bb697495-b311-499b-98c5-fa0133350846 with Priority: HIGHEST for action security_group_members [ 1329.752620] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bb697495-b311-499b-98c5-fa0133350846 with Priority: HIGHEST for action security_group_members [ 1329.752930] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-bb697495-b311-499b-98c5-fa0133350846 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1329.753065] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bb697495-b311-499b-98c5-fa0133350846" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1329.753134] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bb697495-b311-499b-98c5-fa0133350846" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1329.753336] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bb697495-b311-499b-98c5-fa0133350846" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1329.753492] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1329.753592] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1329.753694] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1329.753799] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1329.753901] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1329.754267] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bb697495-b311-499b-98c5-fa0133350846',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1329.876860] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock network-637 taken with stack trace [, , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1329.876860] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "network-637" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1329.876860] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "network-637" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1329.876860] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "network-637" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1329.877188] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1329.877188] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1329.877316] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1329.877553] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1329.877633] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1329.877849] env[69980]: DEBUG dogpile.cache.region [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] No value present for key: 'zone-id' {{(pid=69980) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1329.877969] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] NeedRegenerationException {{(pid=69980) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1329.878091] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] no value, waiting for create lock {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1329.878202] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] value creation lock acquired {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1329.878314] env[69980]: DEBUG dogpile.cache.region [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] No value present for key: 'zone-id' {{(pid=69980) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1329.878423] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Calling creation function for not-yet-present value {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1329.878579] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1329.897767] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1329.897927] env[69980]: DEBUG dogpile.cache.region [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=69980) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1329.898078] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Released creation lock {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1329.898282] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "network-637" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1329.898611] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock port-dabcfbad-8657-4057-83ed-f2a9c886cdd1 taken with stack trace [, , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1329.898787] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "port-dabcfbad-8657-4057-83ed-f2a9c886cdd1" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1329.898923] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "port-dabcfbad-8657-4057-83ed-f2a9c886cdd1" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1329.899257] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "port-dabcfbad-8657-4057-83ed-f2a9c886cdd1" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1329.899400] env[69980]: DEBUG networking_nsxv3.api.rpc [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('dabcfbad-8657-4057-83ed-f2a9c886cdd1',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1330.024237] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1330.024397] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1330.024471] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1330.024775] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1330.024882] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1330.025170] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1330.025235] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1330.025272] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1330.025426] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1330.025502] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1330.025590] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 00f20236-2b69-46dc-a00f-0c4d6b93c17a is going to be updated. [ 1330.048086] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1330.048233] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1330.048299] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1330.048539] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1330.048782] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1330.056416] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 00f20236-2b69-46dc-a00f-0c4d6b93c17a in Status: IN_PROGRESS for 2s [ 1330.152197] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9057c45b-1d82-49a9-8ffb-aaf0cddf5801',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1330.226890] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f0f521c8-595e-4f1b-a139-3ce8948484da',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1330.256443] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1330.257591] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1330.257591] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1330.257591] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1330.257591] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1330.257591] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1330.257591] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1330.257591] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1330.257591] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1330.257591] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1330.258057] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bb697495-b311-499b-98c5-fa0133350846 is going to be updated. [ 1330.284183] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1330.284318] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1330.285020] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1330.285020] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1330.285020] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1330.291758] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bb697495-b311-499b-98c5-fa0133350846 in Status: IN_PROGRESS for 2s [ 1330.402381] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1330.402657] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1330.402806] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1330.403132] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1330.403294] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1330.403467] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Segment Port dabcfbad-8657-4057-83ed-f2a9c886cdd1 not found, creating... [ 1330.403749] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1330.403929] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1330.404063] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1330.404315] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1330.404479] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1330.404786] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1330.404961] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1330.405109] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1330.405346] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1330.405501] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1330.405654] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Resource: SegmentPort with ID: dabcfbad-8657-4057-83ed-f2a9c886cdd1 is going to be created. [ 1330.424645] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1330.424848] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1330.424969] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1330.425223] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1330.425480] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1330.425746] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "port-dabcfbad-8657-4057-83ed-f2a9c886cdd1" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1330.654198] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9057c45b-1d82-49a9-8ffb-aaf0cddf5801',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1330.729623] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1330.729816] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1330.729874] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1330.730116] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1330.730213] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1330.730312] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f0f521c8-595e-4f1b-a139-3ce8948484da is going to be updated. [ 1330.757799] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1330.757926] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1330.757999] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1330.758236] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1330.758375] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1330.767859] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f0f521c8-595e-4f1b-a139-3ce8948484da in Status: IN_PROGRESS for 2s [ 1331.096247] env[69980]: INFO networking_nsxv3.common.synchronization [req-51d65917-cb84-45e5-b7b1-58b45e89000b req-4d660e14-7840-4300-b882-4e4e540e5c81 service nova] Enqueued Resource ID: 00f20236-2b69-46dc-a00f-0c4d6b93c17a with Priority: HIGHEST for action security_group_rules [ 1331.096493] env[69980]: INFO networking_nsxv3.common.synchronization [req-51d65917-cb84-45e5-b7b1-58b45e89000b req-4d660e14-7840-4300-b882-4e4e540e5c81 service nova] Enqueued Resource ID: 00f20236-2b69-46dc-a00f-0c4d6b93c17a with Priority: HIGHEST for action security_group_members [ 1331.096561] env[69980]: INFO networking_nsxv3.common.synchronization [req-51d65917-cb84-45e5-b7b1-58b45e89000b req-4d660e14-7840-4300-b882-4e4e540e5c81 service nova] Enqueued Resource ID: dabcfbad-8657-4057-83ed-f2a9c886cdd1 with Priority: HIGHEST for action port [ 1331.096786] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 00f20236-2b69-46dc-a00f-0c4d6b93c17a with Priority: HIGHEST for action security_group_rules [ 1331.096936] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 00f20236-2b69-46dc-a00f-0c4d6b93c17a with Priority: HIGHEST for action security_group_members [ 1331.097013] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dabcfbad-8657-4057-83ed-f2a9c886cdd1 with Priority: HIGHEST for action port [ 1331.097570] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock rules-00f20236-2b69-46dc-a00f-0c4d6b93c17a taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1331.097715] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-00f20236-2b69-46dc-a00f-0c4d6b93c17a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1331.097804] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-00f20236-2b69-46dc-a00f-0c4d6b93c17a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1331.098062] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-00f20236-2b69-46dc-a00f-0c4d6b93c17a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1331.098136] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('00f20236-2b69-46dc-a00f-0c4d6b93c17a',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1331.098927] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-00f20236-2b69-46dc-a00f-0c4d6b93c17a taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1331.099050] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-00f20236-2b69-46dc-a00f-0c4d6b93c17a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1331.099256] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock port-dabcfbad-8657-4057-83ed-f2a9c886cdd1 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1331.099370] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-dabcfbad-8657-4057-83ed-f2a9c886cdd1" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1331.099439] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-dabcfbad-8657-4057-83ed-f2a9c886cdd1" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1331.099635] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-dabcfbad-8657-4057-83ed-f2a9c886cdd1" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1331.099705] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('dabcfbad-8657-4057-83ed-f2a9c886cdd1',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1331.159045] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1331.159205] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1331.159325] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1331.159511] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1331.159657] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1331.159776] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9057c45b-1d82-49a9-8ffb-aaf0cddf5801 is going to be updated. [ 1331.203015] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1331.203164] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1331.203239] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1331.203472] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1331.203619] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1331.214244] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9057c45b-1d82-49a9-8ffb-aaf0cddf5801 in Status: IN_PROGRESS for 2s [ 1331.301889] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 23fa8e46-c46e-429c-b533-b6ee73936de0 in Status: SUCCESS [ 1331.302100] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-23fa8e46-c46e-429c-b533-b6ee73936de0" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1331.302308] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-23fa8e46-c46e-429c-b533-b6ee73936de0" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1331.302484] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-23fa8e46-c46e-429c-b533-b6ee73936de0" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1331.302709] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1331.302834] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1331.302907] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1331.303427] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1331.303427] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1331.303427] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-23fa8e46-c46e-429c-b533-b6ee73936de0" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1331.303427] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('23fa8e46-c46e-429c-b533-b6ee73936de0',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1331.601819] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-00f20236-2b69-46dc-a00f-0c4d6b93c17a taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1331.601819] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-00f20236-2b69-46dc-a00f-0c4d6b93c17a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1331.604031] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port dabcfbad-8657-4057-83ed-f2a9c886cdd1 with status ACTIVE [ 1331.604364] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1331.604364] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1331.604364] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1331.604614] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1331.604675] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1331.604861] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1331.605030] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1331.605030] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1331.605238] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1331.605505] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1331.605505] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1331.605968] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1331.605968] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1331.605968] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1331.605968] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1331.605968] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: dabcfbad-8657-4057-83ed-f2a9c886cdd1 is going to be updated. [ 1331.628974] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1331.629137] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1331.629208] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1331.629426] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1331.629584] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1331.629754] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-dabcfbad-8657-4057-83ed-f2a9c886cdd1" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1331.808207] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('23fa8e46-c46e-429c-b533-b6ee73936de0',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1332.065061] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 00f20236-2b69-46dc-a00f-0c4d6b93c17a in Status: SUCCESS [ 1332.065319] env[69980]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 00f20236-2b69-46dc-a00f-0c4d6b93c17a deletion is rescheduled due to dependency. [ 1332.065364] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-00f20236-2b69-46dc-a00f-0c4d6b93c17a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1332.065509] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-00f20236-2b69-46dc-a00f-0c4d6b93c17a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1332.065739] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-00f20236-2b69-46dc-a00f-0c4d6b93c17a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1332.065950] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1332.066300] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1332.066367] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1332.066597] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1332.066688] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1332.066782] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('00f20236-2b69-46dc-a00f-0c4d6b93c17a',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1332.300964] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bb697495-b311-499b-98c5-fa0133350846 in Status: SUCCESS [ 1332.301273] env[69980]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bb697495-b311-499b-98c5-fa0133350846 deletion is rescheduled due to dependency. [ 1332.301310] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bb697495-b311-499b-98c5-fa0133350846" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1332.310702] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 23fa8e46-c46e-429c-b533-b6ee73936de0: rpc.has_security_group_logging(os_id): False [ 1332.327256] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1332.327416] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1332.327482] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1332.327683] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1332.327808] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1332.327996] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1332.328110] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1332.328177] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1332.328320] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1332.328397] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1332.328481] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 23fa8e46-c46e-429c-b533-b6ee73936de0 is going to be created. [ 1332.395438] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1332.395911] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1332.396043] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1332.396353] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1332.396520] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1332.406115] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 23fa8e46-c46e-429c-b533-b6ee73936de0 in Status: IN_PROGRESS for 2s [ 1332.569741] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('00f20236-2b69-46dc-a00f-0c4d6b93c17a',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1332.777561] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f0f521c8-595e-4f1b-a139-3ce8948484da in Status: SUCCESS [ 1332.777955] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f0f521c8-595e-4f1b-a139-3ce8948484da" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1333.072677] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('00f20236-2b69-46dc-a00f-0c4d6b93c17a',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1333.222962] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9057c45b-1d82-49a9-8ffb-aaf0cddf5801 in Status: SUCCESS [ 1333.223218] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9057c45b-1d82-49a9-8ffb-aaf0cddf5801" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1333.223383] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9057c45b-1d82-49a9-8ffb-aaf0cddf5801" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1333.223605] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9057c45b-1d82-49a9-8ffb-aaf0cddf5801" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1333.223805] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1333.223922] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1333.223989] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1333.224163] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1333.224247] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1333.224331] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9057c45b-1d82-49a9-8ffb-aaf0cddf5801" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1333.224424] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9057c45b-1d82-49a9-8ffb-aaf0cddf5801',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1333.575597] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1333.575874] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1333.575874] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1333.576115] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1333.576115] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1333.576115] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 00f20236-2b69-46dc-a00f-0c4d6b93c17a is going to be updated. [ 1333.602816] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1333.602972] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1333.603023] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1333.603231] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1333.603372] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1333.610671] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 00f20236-2b69-46dc-a00f-0c4d6b93c17a in Status: IN_PROGRESS for 2s [ 1333.726230] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9057c45b-1d82-49a9-8ffb-aaf0cddf5801',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1334.228503] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9057c45b-1d82-49a9-8ffb-aaf0cddf5801: rpc.has_security_group_logging(os_id): False [ 1334.319149] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1334.319336] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1334.319476] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1334.319646] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1334.319763] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1334.320052] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1334.320157] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1334.320225] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1334.320394] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1334.320487] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1334.320559] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9057c45b-1d82-49a9-8ffb-aaf0cddf5801 is going to be updated. [ 1334.384918] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1334.385110] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1334.385182] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1334.385532] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1334.385532] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1334.398467] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9057c45b-1d82-49a9-8ffb-aaf0cddf5801 in Status: IN_PROGRESS for 2s [ 1334.419940] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 23fa8e46-c46e-429c-b533-b6ee73936de0 in Status: SUCCESS [ 1334.420348] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-23fa8e46-c46e-429c-b533-b6ee73936de0" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1334.635501] env[69980]: INFO networking_nsxv3.common.synchronization [None req-4de5794c-a542-455d-b4fb-36be01aa73d6 tempest-AttachVolumeTestJSON-92929017 tempest-AttachVolumeTestJSON-92929017-project-member] Enqueued Resource ID: 832bb529-72a6-428e-bdd7-50f804872365 with Priority: HIGHEST for action security_group_rules [ 1334.635501] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 832bb529-72a6-428e-bdd7-50f804872365 with Priority: HIGHEST for action security_group_rules [ 1334.635501] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock rules-832bb529-72a6-428e-bdd7-50f804872365 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1334.635501] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-832bb529-72a6-428e-bdd7-50f804872365" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1334.636107] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-832bb529-72a6-428e-bdd7-50f804872365" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1334.636480] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-832bb529-72a6-428e-bdd7-50f804872365" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1334.636622] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('832bb529-72a6-428e-bdd7-50f804872365',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1334.709457] env[69980]: INFO networking_nsxv3.common.synchronization [None req-4666e54e-0eb8-40fc-8729-06b227da7473 tempest-AttachVolumeTestJSON-92929017 tempest-AttachVolumeTestJSON-92929017-project-member] Enqueued Resource ID: 832bb529-72a6-428e-bdd7-50f804872365 with Priority: HIGHEST for action security_group_rules [ 1334.709457] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 832bb529-72a6-428e-bdd7-50f804872365 with Priority: HIGHEST for action security_group_rules [ 1334.709457] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock rules-832bb529-72a6-428e-bdd7-50f804872365 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1334.710019] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-832bb529-72a6-428e-bdd7-50f804872365" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1335.155372] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1335.155531] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1335.155604] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1335.155822] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1335.155932] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1335.156042] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 832bb529-72a6-428e-bdd7-50f804872365 already deleted. [ 1335.156143] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-832bb529-72a6-428e-bdd7-50f804872365" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1335.156293] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-832bb529-72a6-428e-bdd7-50f804872365" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1335.156483] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-832bb529-72a6-428e-bdd7-50f804872365" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1335.156640] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('832bb529-72a6-428e-bdd7-50f804872365',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1335.620863] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 00f20236-2b69-46dc-a00f-0c4d6b93c17a in Status: SUCCESS [ 1335.621117] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-00f20236-2b69-46dc-a00f-0c4d6b93c17a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1335.621292] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-00f20236-2b69-46dc-a00f-0c4d6b93c17a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1335.621542] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-00f20236-2b69-46dc-a00f-0c4d6b93c17a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1335.621740] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1335.621864] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1335.621935] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1335.622098] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1335.622306] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1335.622306] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-00f20236-2b69-46dc-a00f-0c4d6b93c17a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1335.622429] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('00f20236-2b69-46dc-a00f-0c4d6b93c17a',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1335.676151] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1335.676151] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1335.676151] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1335.676151] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1335.676151] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1335.676151] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 832bb529-72a6-428e-bdd7-50f804872365 already deleted. [ 1335.676151] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-832bb529-72a6-428e-bdd7-50f804872365" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1335.787396] env[69980]: INFO networking_nsxv3.common.synchronization [req-8dd63f87-b120-4f75-ab8f-19973635fc75 req-99da1ba4-3db0-4d1e-ac60-6749c2701077 tempest-ServerRescueNegativeTestJSON-1270382253 tempest-ServerRescueNegativeTestJSON-1270382253-project-member] Enqueued Resource ID: f0f521c8-595e-4f1b-a139-3ce8948484da with Priority: HIGHEST for action security_group_members [ 1335.787396] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f0f521c8-595e-4f1b-a139-3ce8948484da with Priority: HIGHEST for action security_group_members [ 1335.794612] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-f0f521c8-595e-4f1b-a139-3ce8948484da taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1335.794612] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f0f521c8-595e-4f1b-a139-3ce8948484da" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1335.794612] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f0f521c8-595e-4f1b-a139-3ce8948484da" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1335.794612] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f0f521c8-595e-4f1b-a139-3ce8948484da" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1335.794612] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1335.794612] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1335.794612] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1335.794612] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1335.794612] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1335.794612] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f0f521c8-595e-4f1b-a139-3ce8948484da',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1336.124507] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('00f20236-2b69-46dc-a00f-0c4d6b93c17a',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1336.296122] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1336.296263] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1336.296345] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1336.296573] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1336.319328] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1336.319328] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1336.319328] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1336.319328] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1336.319328] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1336.319328] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1336.319328] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f0f521c8-595e-4f1b-a139-3ce8948484da is going to be updated. [ 1336.345523] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1336.345679] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1336.345765] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1336.345936] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1336.346206] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1336.353777] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f0f521c8-595e-4f1b-a139-3ce8948484da in Status: IN_PROGRESS for 2s [ 1336.431324] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9057c45b-1d82-49a9-8ffb-aaf0cddf5801 in Status: SUCCESS [ 1336.431541] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9057c45b-1d82-49a9-8ffb-aaf0cddf5801" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1336.627347] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 00f20236-2b69-46dc-a00f-0c4d6b93c17a: rpc.has_security_group_logging(os_id): False [ 1336.647379] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1336.647561] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1336.647632] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1336.647852] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1336.647941] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1336.648208] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1336.648309] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1336.648375] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1336.648527] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1336.648686] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1336.648756] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 00f20236-2b69-46dc-a00f-0c4d6b93c17a is going to be updated. [ 1336.723877] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1336.724189] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1336.724189] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1336.724308] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1336.724437] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1336.735598] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 00f20236-2b69-46dc-a00f-0c4d6b93c17a in Status: IN_PROGRESS for 2s [ 1338.363295] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f0f521c8-595e-4f1b-a139-3ce8948484da in Status: SUCCESS [ 1338.363570] env[69980]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f0f521c8-595e-4f1b-a139-3ce8948484da deletion is rescheduled due to dependency. [ 1338.363608] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f0f521c8-595e-4f1b-a139-3ce8948484da" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1338.747678] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 00f20236-2b69-46dc-a00f-0c4d6b93c17a in Status: SUCCESS [ 1338.747897] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-00f20236-2b69-46dc-a00f-0c4d6b93c17a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1340.788461] env[69980]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1340.788803] env[69980]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1342.573591] env[69980]: INFO networking_nsxv3.common.synchronization [req-2b6a1d72-5508-4b84-a9a5-81433c7ea3e5 req-4180d698-08bb-48aa-b711-a5db9f0e6ce0 tempest-AttachVolumeTestJSON-92929017 tempest-AttachVolumeTestJSON-92929017-project-member] Enqueued Resource ID: 832bb529-72a6-428e-bdd7-50f804872365 with Priority: HIGHEST for action security_group_members [ 1342.574149] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 832bb529-72a6-428e-bdd7-50f804872365 with Priority: HIGHEST for action security_group_members [ 1342.574449] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-832bb529-72a6-428e-bdd7-50f804872365 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1342.574571] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-832bb529-72a6-428e-bdd7-50f804872365" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1342.574641] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-832bb529-72a6-428e-bdd7-50f804872365" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1342.575340] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-832bb529-72a6-428e-bdd7-50f804872365" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1342.575527] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1342.575634] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1342.575700] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1342.575862] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1342.575946] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1342.576048] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('832bb529-72a6-428e-bdd7-50f804872365',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1342.828337] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock network-488 taken with stack trace [, , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1342.828544] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "network-488" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1342.828726] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "network-488" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1342.829017] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "network-488" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1342.829287] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1342.829450] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1342.829568] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1342.829810] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1342.829959] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1342.830185] env[69980]: DEBUG dogpile.cache.region [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] No value present for key: 'zone-id' {{(pid=69980) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1342.830299] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] NeedRegenerationException {{(pid=69980) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1342.830410] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] no value, waiting for create lock {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1342.830518] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] value creation lock acquired {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1342.830628] env[69980]: DEBUG dogpile.cache.region [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] No value present for key: 'zone-id' {{(pid=69980) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1342.830736] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Calling creation function for not-yet-present value {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1342.830869] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1342.849339] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1342.849505] env[69980]: DEBUG dogpile.cache.region [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=69980) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1342.849652] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Released creation lock {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1342.849838] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "network-488" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1342.850146] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock port-f591ffb9-5472-4407-ba3c-80735a3db02b taken with stack trace [, , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1342.850315] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "port-f591ffb9-5472-4407-ba3c-80735a3db02b" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1342.850436] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "port-f591ffb9-5472-4407-ba3c-80735a3db02b" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1342.850741] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "port-f591ffb9-5472-4407-ba3c-80735a3db02b" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1342.850879] env[69980]: DEBUG networking_nsxv3.api.rpc [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f591ffb9-5472-4407-ba3c-80735a3db02b',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1343.078874] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1343.078874] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1343.078874] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1343.079171] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1343.079171] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1343.079288] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1343.079401] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1343.079462] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1343.079608] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1343.079708] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1343.079857] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 832bb529-72a6-428e-bdd7-50f804872365 already deleted. [ 1343.079898] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-832bb529-72a6-428e-bdd7-50f804872365" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1343.352930] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1343.353211] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1343.353345] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1343.353618] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1343.353770] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1343.353924] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Segment Port f591ffb9-5472-4407-ba3c-80735a3db02b not found, creating... [ 1343.354196] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1343.354358] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1343.354476] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1343.354688] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1343.354827] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1343.355118] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1343.355278] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1343.355398] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1343.355618] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1343.355760] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1343.355903] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Resource: SegmentPort with ID: f591ffb9-5472-4407-ba3c-80735a3db02b is going to be created. [ 1343.374197] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1343.374458] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1343.374571] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1343.374740] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1343.375077] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1343.375486] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "port-f591ffb9-5472-4407-ba3c-80735a3db02b" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1344.099733] env[69980]: INFO networking_nsxv3.common.synchronization [req-2b6a1d72-5508-4b84-a9a5-81433c7ea3e5 req-65a342d6-490e-4172-af5b-a6a2faa36f05 service nova] Enqueued Resource ID: 832bb529-72a6-428e-bdd7-50f804872365 with Priority: HIGHEST for action security_group_rules [ 1344.100050] env[69980]: INFO networking_nsxv3.common.synchronization [req-2b6a1d72-5508-4b84-a9a5-81433c7ea3e5 req-65a342d6-490e-4172-af5b-a6a2faa36f05 service nova] Enqueued Resource ID: 832bb529-72a6-428e-bdd7-50f804872365 with Priority: HIGHEST for action security_group_members [ 1344.100050] env[69980]: INFO networking_nsxv3.common.synchronization [req-2b6a1d72-5508-4b84-a9a5-81433c7ea3e5 req-65a342d6-490e-4172-af5b-a6a2faa36f05 service nova] Enqueued Resource ID: f591ffb9-5472-4407-ba3c-80735a3db02b with Priority: HIGHEST for action port [ 1344.100353] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 832bb529-72a6-428e-bdd7-50f804872365 with Priority: HIGHEST for action security_group_rules [ 1344.100410] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 832bb529-72a6-428e-bdd7-50f804872365 with Priority: HIGHEST for action security_group_members [ 1344.100556] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f591ffb9-5472-4407-ba3c-80735a3db02b with Priority: HIGHEST for action port [ 1344.101128] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock rules-832bb529-72a6-428e-bdd7-50f804872365 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1344.101268] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-832bb529-72a6-428e-bdd7-50f804872365" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1344.101336] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-832bb529-72a6-428e-bdd7-50f804872365" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1344.101579] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-832bb529-72a6-428e-bdd7-50f804872365" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1344.101612] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('832bb529-72a6-428e-bdd7-50f804872365',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1344.102524] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-832bb529-72a6-428e-bdd7-50f804872365 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1344.102524] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-832bb529-72a6-428e-bdd7-50f804872365" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1344.102625] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-832bb529-72a6-428e-bdd7-50f804872365" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1344.102723] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-832bb529-72a6-428e-bdd7-50f804872365" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1344.102841] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1344.102936] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1344.102999] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1344.103208] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1344.103208] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1344.103323] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('832bb529-72a6-428e-bdd7-50f804872365',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1344.104250] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock port-f591ffb9-5472-4407-ba3c-80735a3db02b taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1344.104361] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f591ffb9-5472-4407-ba3c-80735a3db02b" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1344.104436] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f591ffb9-5472-4407-ba3c-80735a3db02b" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1344.108174] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f591ffb9-5472-4407-ba3c-80735a3db02b" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1344.108254] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f591ffb9-5472-4407-ba3c-80735a3db02b',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1344.610120] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-832bb529-72a6-428e-bdd7-50f804872365 taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1344.610309] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-832bb529-72a6-428e-bdd7-50f804872365" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1344.610501] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('832bb529-72a6-428e-bdd7-50f804872365',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1344.611439] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f591ffb9-5472-4407-ba3c-80735a3db02b with status ACTIVE [ 1344.611698] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1344.611850] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1344.611905] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1344.612288] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1344.613370] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1344.613370] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1344.613370] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1344.613370] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1344.613370] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1344.613370] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1344.613370] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1344.613666] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1344.613666] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1344.613875] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1344.613933] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1344.614033] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f591ffb9-5472-4407-ba3c-80735a3db02b is going to be updated. [ 1344.633840] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1344.634081] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1344.634159] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1344.634378] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1344.634679] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1344.634679] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f591ffb9-5472-4407-ba3c-80735a3db02b" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1345.116337] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('832bb529-72a6-428e-bdd7-50f804872365',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1345.619346] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1345.619500] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1345.620041] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1345.620041] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1345.620041] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1345.620234] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 832bb529-72a6-428e-bdd7-50f804872365 is going to be created. [ 1345.641708] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1345.641894] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1345.641971] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1345.642200] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1345.642371] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1345.652104] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 832bb529-72a6-428e-bdd7-50f804872365 in Status: UNINITIALIZED for 2s [ 1347.661955] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 832bb529-72a6-428e-bdd7-50f804872365 in Status: SUCCESS [ 1347.662233] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-832bb529-72a6-428e-bdd7-50f804872365" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1347.662356] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-832bb529-72a6-428e-bdd7-50f804872365" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1347.662576] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-832bb529-72a6-428e-bdd7-50f804872365" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1347.662773] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1347.662895] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1347.662959] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1347.663134] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1347.663217] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1347.663302] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-832bb529-72a6-428e-bdd7-50f804872365" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1347.663390] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('832bb529-72a6-428e-bdd7-50f804872365',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1348.167682] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('832bb529-72a6-428e-bdd7-50f804872365',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1348.670223] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 832bb529-72a6-428e-bdd7-50f804872365: rpc.has_security_group_logging(os_id): False [ 1348.687219] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1348.687411] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1348.687411] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1348.687638] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1348.687731] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1348.687997] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1348.688121] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1348.688186] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1348.688337] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1348.688413] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1348.688499] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 832bb529-72a6-428e-bdd7-50f804872365 is going to be created. [ 1348.745231] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1348.745447] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1348.745447] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1348.745633] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1348.745813] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1348.755446] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 832bb529-72a6-428e-bdd7-50f804872365 in Status: IN_PROGRESS for 2s [ 1349.101133] env[69980]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1349.101265] env[69980]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1350.769217] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 832bb529-72a6-428e-bdd7-50f804872365 in Status: SUCCESS [ 1350.769549] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-832bb529-72a6-428e-bdd7-50f804872365" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1354.102281] env[69980]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1354.102281] env[69980]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1359.102924] env[69980]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1359.103259] env[69980]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1364.104164] env[69980]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1364.104580] env[69980]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1369.104884] env[69980]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1369.105134] env[69980]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1374.108353] env[69980]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1374.108678] env[69980]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1379.109257] env[69980]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1379.109633] env[69980]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1379.137368] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock network-29 taken with stack trace [, , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1379.137599] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "network-29" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1379.137732] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "network-29" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1379.138038] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "network-29" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1379.138323] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1379.138500] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1379.138648] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1379.138870] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1379.139026] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1379.139281] env[69980]: DEBUG dogpile.cache.region [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] No value present for key: 'zone-id' {{(pid=69980) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1379.139405] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] NeedRegenerationException {{(pid=69980) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1379.139518] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] no value, waiting for create lock {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1379.139627] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] value creation lock acquired {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1379.139738] env[69980]: DEBUG dogpile.cache.region [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] No value present for key: 'zone-id' {{(pid=69980) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1379.139846] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Calling creation function for not-yet-present value {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1379.139980] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1379.161029] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1379.161029] env[69980]: DEBUG dogpile.cache.region [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=69980) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1379.161029] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Released creation lock {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1379.161165] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "network-29" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1379.161699] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock port-ddf3c49c-2d22-47b7-935b-0c412d6949fd taken with stack trace [, , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1379.161699] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "port-ddf3c49c-2d22-47b7-935b-0c412d6949fd" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1379.161699] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "port-ddf3c49c-2d22-47b7-935b-0c412d6949fd" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1379.161917] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "port-ddf3c49c-2d22-47b7-935b-0c412d6949fd" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1379.162066] env[69980]: DEBUG networking_nsxv3.api.rpc [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ddf3c49c-2d22-47b7-935b-0c412d6949fd',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1379.663908] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1379.664158] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1379.664285] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1379.664524] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1379.664680] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1379.664971] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1379.665148] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1379.665268] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1379.665487] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1379.665625] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1379.665906] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1379.666077] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1379.666222] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1379.666436] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1379.666574] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1379.666718] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Resource: SegmentPort with ID: ddf3c49c-2d22-47b7-935b-0c412d6949fd is going to be updated. [ 1379.690292] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1379.690552] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1379.690622] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1379.691122] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1379.691122] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1379.691329] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "port-ddf3c49c-2d22-47b7-935b-0c412d6949fd" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1380.373241] env[69980]: INFO networking_nsxv3.common.synchronization [req-d66a686d-a998-4520-9ed1-ff67367c5242 req-709c9757-794b-4058-a3bd-2932de410635 service nova] Enqueued Resource ID: 72f0fad5-906a-4ed9-a922-fdb13010a34d with Priority: HIGHEST for action security_group_rules [ 1380.373241] env[69980]: INFO networking_nsxv3.common.synchronization [req-d66a686d-a998-4520-9ed1-ff67367c5242 req-709c9757-794b-4058-a3bd-2932de410635 service nova] Enqueued Resource ID: 72f0fad5-906a-4ed9-a922-fdb13010a34d with Priority: HIGHEST for action security_group_members [ 1380.373241] env[69980]: INFO networking_nsxv3.common.synchronization [req-d66a686d-a998-4520-9ed1-ff67367c5242 req-709c9757-794b-4058-a3bd-2932de410635 service nova] Enqueued Resource ID: ddf3c49c-2d22-47b7-935b-0c412d6949fd with Priority: HIGHEST for action port [ 1380.373241] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 72f0fad5-906a-4ed9-a922-fdb13010a34d with Priority: HIGHEST for action security_group_rules [ 1380.374108] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 72f0fad5-906a-4ed9-a922-fdb13010a34d with Priority: HIGHEST for action security_group_members [ 1380.374412] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ddf3c49c-2d22-47b7-935b-0c412d6949fd with Priority: HIGHEST for action port [ 1380.374905] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock rules-72f0fad5-906a-4ed9-a922-fdb13010a34d taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1380.375165] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-72f0fad5-906a-4ed9-a922-fdb13010a34d" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1380.375340] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-72f0fad5-906a-4ed9-a922-fdb13010a34d" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1380.375625] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-72f0fad5-906a-4ed9-a922-fdb13010a34d" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1380.376293] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('72f0fad5-906a-4ed9-a922-fdb13010a34d',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1380.377254] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-72f0fad5-906a-4ed9-a922-fdb13010a34d taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1380.377513] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-72f0fad5-906a-4ed9-a922-fdb13010a34d" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1380.377685] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-72f0fad5-906a-4ed9-a922-fdb13010a34d" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1380.378083] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-72f0fad5-906a-4ed9-a922-fdb13010a34d" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1380.378357] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1380.379017] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1380.379017] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1380.380410] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1380.380410] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1380.380410] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('72f0fad5-906a-4ed9-a922-fdb13010a34d',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1380.380410] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock port-ddf3c49c-2d22-47b7-935b-0c412d6949fd taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1380.380574] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ddf3c49c-2d22-47b7-935b-0c412d6949fd" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1380.380574] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ddf3c49c-2d22-47b7-935b-0c412d6949fd" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1380.381220] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ddf3c49c-2d22-47b7-935b-0c412d6949fd" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1380.381220] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ddf3c49c-2d22-47b7-935b-0c412d6949fd',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1380.883735] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('72f0fad5-906a-4ed9-a922-fdb13010a34d',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1380.884974] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-72f0fad5-906a-4ed9-a922-fdb13010a34d taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1380.885134] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-72f0fad5-906a-4ed9-a922-fdb13010a34d" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1380.885336] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port ddf3c49c-2d22-47b7-935b-0c412d6949fd with status ACTIVE [ 1380.885512] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1380.885627] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1380.885713] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1380.885909] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1380.886088] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1380.888094] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1380.888094] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1380.888094] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1380.888094] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1380.888094] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1380.888094] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1380.888094] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1380.888094] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1380.888094] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1380.888094] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1380.888094] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: ddf3c49c-2d22-47b7-935b-0c412d6949fd is going to be updated. [ 1380.907534] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1380.907768] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1380.907768] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1380.908190] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1380.908190] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1380.908353] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ddf3c49c-2d22-47b7-935b-0c412d6949fd" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1381.390110] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('72f0fad5-906a-4ed9-a922-fdb13010a34d',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1381.893068] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1381.893068] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1381.893068] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1381.893423] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1381.893423] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1381.893541] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 72f0fad5-906a-4ed9-a922-fdb13010a34d is going to be updated. [ 1381.919756] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1381.919999] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1381.919999] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1381.920286] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1381.920466] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1381.928576] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 72f0fad5-906a-4ed9-a922-fdb13010a34d in Status: IN_PROGRESS for 2s [ 1383.938783] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 72f0fad5-906a-4ed9-a922-fdb13010a34d in Status: SUCCESS [ 1383.938783] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-72f0fad5-906a-4ed9-a922-fdb13010a34d" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1383.939185] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-72f0fad5-906a-4ed9-a922-fdb13010a34d" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1383.939227] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-72f0fad5-906a-4ed9-a922-fdb13010a34d" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1383.939438] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1383.939553] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1383.939609] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1383.939778] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1383.939854] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1383.939947] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-72f0fad5-906a-4ed9-a922-fdb13010a34d" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1383.940059] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('72f0fad5-906a-4ed9-a922-fdb13010a34d',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1384.445529] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('72f0fad5-906a-4ed9-a922-fdb13010a34d',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1384.949153] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 72f0fad5-906a-4ed9-a922-fdb13010a34d: rpc.has_security_group_logging(os_id): False [ 1384.966108] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1384.966108] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1384.966108] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1384.966108] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1384.966108] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1384.966108] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1384.966108] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1384.966549] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1384.966549] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1384.966549] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1384.966662] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 72f0fad5-906a-4ed9-a922-fdb13010a34d is going to be updated. [ 1385.024785] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1385.025035] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1385.025084] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1385.025269] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1385.025460] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1385.048791] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 72f0fad5-906a-4ed9-a922-fdb13010a34d in Status: IN_PROGRESS for 2s [ 1385.375405] env[69980]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1385.375621] env[69980]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1387.065878] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 72f0fad5-906a-4ed9-a922-fdb13010a34d in Status: SUCCESS [ 1387.066337] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-72f0fad5-906a-4ed9-a922-fdb13010a34d" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1389.466469] env[69980]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-977287c2-69f8-47e1-8dff-764e9cba9a38 None None] NSXv3 Agent Agent loop - iteration:2 completed [ 1389.466840] env[69980]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-977287c2-69f8-47e1-8dff-764e9cba9a38 None None] NSXv3 Agent Agent loop - iteration:3 started [ 1390.376832] env[69980]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1390.377043] env[69980]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1393.278894] env[69980]: INFO networking_nsxv3.common.synchronization [req-c7de8901-0fc4-4d15-bd2f-94117b607c04 req-0a6f117f-16a5-4de6-9572-f5c6c86370e5 tempest-ServerActionsTestOtherA-1240783872 tempest-ServerActionsTestOtherA-1240783872-project-member] Enqueued Resource ID: 9057c45b-1d82-49a9-8ffb-aaf0cddf5801 with Priority: HIGHEST for action security_group_members [ 1393.279385] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9057c45b-1d82-49a9-8ffb-aaf0cddf5801 with Priority: HIGHEST for action security_group_members [ 1393.279704] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-9057c45b-1d82-49a9-8ffb-aaf0cddf5801 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1393.279824] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9057c45b-1d82-49a9-8ffb-aaf0cddf5801" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1393.279881] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9057c45b-1d82-49a9-8ffb-aaf0cddf5801" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1393.280483] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9057c45b-1d82-49a9-8ffb-aaf0cddf5801" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1393.280483] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1393.280483] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1393.280483] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1393.280701] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1393.280701] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1393.280774] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9057c45b-1d82-49a9-8ffb-aaf0cddf5801',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1393.782997] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9057c45b-1d82-49a9-8ffb-aaf0cddf5801',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1394.285522] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9057c45b-1d82-49a9-8ffb-aaf0cddf5801',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1394.788637] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1394.789010] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1394.789123] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1394.789467] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1394.789576] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1394.789670] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9057c45b-1d82-49a9-8ffb-aaf0cddf5801 is going to be updated. [ 1394.816326] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1394.816520] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1394.816616] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1394.816793] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1394.816942] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1394.824521] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9057c45b-1d82-49a9-8ffb-aaf0cddf5801 in Status: IN_PROGRESS for 2s [ 1396.599978] env[69980]: INFO networking_nsxv3.common.synchronization [req-f0a2b7ab-7128-4451-a2e1-6b4da4da4aa7 req-6c9f09b1-48bb-4ee2-b84f-f67296f31c01 tempest-ServerActionsTestOtherB-1413576659 tempest-ServerActionsTestOtherB-1413576659-project-member] Enqueued Resource ID: 72f0fad5-906a-4ed9-a922-fdb13010a34d with Priority: HIGHEST for action security_group_members [ 1396.600563] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 72f0fad5-906a-4ed9-a922-fdb13010a34d with Priority: HIGHEST for action security_group_members [ 1396.601303] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-72f0fad5-906a-4ed9-a922-fdb13010a34d taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1396.601303] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-72f0fad5-906a-4ed9-a922-fdb13010a34d" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1396.601303] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-72f0fad5-906a-4ed9-a922-fdb13010a34d" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1396.601303] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-72f0fad5-906a-4ed9-a922-fdb13010a34d" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1396.601753] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1396.601753] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1396.601753] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1396.601753] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1396.601753] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1396.602098] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('72f0fad5-906a-4ed9-a922-fdb13010a34d',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1396.837862] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9057c45b-1d82-49a9-8ffb-aaf0cddf5801 in Status: SUCCESS [ 1396.837862] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9057c45b-1d82-49a9-8ffb-aaf0cddf5801" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1397.105280] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1397.105493] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1397.105493] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1397.105677] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1397.105734] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1397.105936] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1397.106044] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1397.106138] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1397.106260] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1397.106338] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1397.106426] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 72f0fad5-906a-4ed9-a922-fdb13010a34d is going to be updated. [ 1397.132960] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1397.133190] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1397.133190] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1397.133433] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1397.133639] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1397.142098] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 72f0fad5-906a-4ed9-a922-fdb13010a34d in Status: IN_PROGRESS for 2s [ 1399.152540] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 72f0fad5-906a-4ed9-a922-fdb13010a34d in Status: SUCCESS [ 1399.152963] env[69980]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 72f0fad5-906a-4ed9-a922-fdb13010a34d deletion is rescheduled due to dependency. [ 1399.152963] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-72f0fad5-906a-4ed9-a922-fdb13010a34d" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1401.601781] env[69980]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1401.601781] env[69980]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1406.602787] env[69980]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1406.603080] env[69980]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1407.822276] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock network-472 taken with stack trace [, , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1407.822590] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "network-472" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1407.822590] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "network-472" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1407.822910] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "network-472" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1407.823231] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1407.823375] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1407.823498] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1407.823723] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1407.823866] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1407.824245] env[69980]: DEBUG dogpile.cache.region [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] No value present for key: 'zone-id' {{(pid=69980) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1407.824387] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] NeedRegenerationException {{(pid=69980) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1407.824506] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] no value, waiting for create lock {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1407.824617] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] value creation lock acquired {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1407.824732] env[69980]: DEBUG dogpile.cache.region [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] No value present for key: 'zone-id' {{(pid=69980) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1407.824842] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Calling creation function for not-yet-present value {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1407.824977] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1407.844865] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1407.846755] env[69980]: DEBUG dogpile.cache.region [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=69980) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1407.846755] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Released creation lock {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1407.846755] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "network-472" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1407.846755] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock port-4771828a-e218-4937-b79e-0841c57da8c7 taken with stack trace [, , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1407.846755] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "port-4771828a-e218-4937-b79e-0841c57da8c7" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1407.846755] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "port-4771828a-e218-4937-b79e-0841c57da8c7" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1407.846755] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "port-4771828a-e218-4937-b79e-0841c57da8c7" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1407.846755] env[69980]: DEBUG networking_nsxv3.api.rpc [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4771828a-e218-4937-b79e-0841c57da8c7',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1408.348769] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1408.348969] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1408.349100] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1408.349446] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1408.349616] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1408.349920] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1408.350102] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1408.350224] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1408.350626] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1408.350626] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1408.350862] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1408.351030] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1408.351154] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1408.351361] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1408.351499] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1408.351730] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Resource: SegmentPort with ID: 4771828a-e218-4937-b79e-0841c57da8c7 is going to be updated. [ 1408.372097] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1408.372410] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1408.373170] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1408.373573] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1408.373928] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1408.374173] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "port-4771828a-e218-4937-b79e-0841c57da8c7" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1408.422873] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1408.423303] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1408.423661] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1408.425818] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1408.425818] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1408.927404] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1408.994213] env[69980]: INFO networking_nsxv3.common.synchronization [None req-fd8709ca-bddc-490f-b85a-27e9923267a9 None None] Enqueued Resource ID: 8da5a86d-5fcd-4123-9912-c6ecf87912cb with Priority: HIGHEST for action port [ 1408.994213] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8da5a86d-5fcd-4123-9912-c6ecf87912cb with Priority: HIGHEST for action port [ 1408.994213] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock port-8da5a86d-5fcd-4123-9912-c6ecf87912cb taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1408.994213] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8da5a86d-5fcd-4123-9912-c6ecf87912cb" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1408.994213] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8da5a86d-5fcd-4123-9912-c6ecf87912cb" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1408.994213] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8da5a86d-5fcd-4123-9912-c6ecf87912cb" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1408.994213] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8da5a86d-5fcd-4123-9912-c6ecf87912cb',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1409.187432] env[69980]: INFO networking_nsxv3.common.synchronization [req-53a5ffc6-b02f-440f-94e6-f304dad2d9ab req-9bad1655-3c57-4723-9754-160173b56890 service nova] Enqueued Resource ID: 23fa8e46-c46e-429c-b533-b6ee73936de0 with Priority: HIGHEST for action security_group_rules [ 1409.187610] env[69980]: INFO networking_nsxv3.common.synchronization [req-53a5ffc6-b02f-440f-94e6-f304dad2d9ab req-9bad1655-3c57-4723-9754-160173b56890 service nova] Enqueued Resource ID: 23fa8e46-c46e-429c-b533-b6ee73936de0 with Priority: HIGHEST for action security_group_members [ 1409.187745] env[69980]: INFO networking_nsxv3.common.synchronization [req-53a5ffc6-b02f-440f-94e6-f304dad2d9ab req-9bad1655-3c57-4723-9754-160173b56890 service nova] Enqueued Resource ID: 4771828a-e218-4937-b79e-0841c57da8c7 with Priority: HIGHEST for action port [ 1409.187970] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 23fa8e46-c46e-429c-b533-b6ee73936de0 with Priority: HIGHEST for action security_group_rules [ 1409.188103] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 23fa8e46-c46e-429c-b533-b6ee73936de0 with Priority: HIGHEST for action security_group_members [ 1409.188195] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4771828a-e218-4937-b79e-0841c57da8c7 with Priority: HIGHEST for action port [ 1409.188813] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock rules-23fa8e46-c46e-429c-b533-b6ee73936de0 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1409.188920] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-23fa8e46-c46e-429c-b533-b6ee73936de0" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1409.188920] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-23fa8e46-c46e-429c-b533-b6ee73936de0" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1409.189130] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-23fa8e46-c46e-429c-b533-b6ee73936de0" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1409.189476] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('23fa8e46-c46e-429c-b533-b6ee73936de0',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1409.190037] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-23fa8e46-c46e-429c-b533-b6ee73936de0 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1409.190161] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-23fa8e46-c46e-429c-b533-b6ee73936de0" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1409.190428] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-23fa8e46-c46e-429c-b533-b6ee73936de0" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1409.193021] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-23fa8e46-c46e-429c-b533-b6ee73936de0" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1409.193191] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1409.193296] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1409.193364] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1409.193519] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1409.193610] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1409.194052] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('23fa8e46-c46e-429c-b533-b6ee73936de0',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1409.194458] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock port-4771828a-e218-4937-b79e-0841c57da8c7 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1409.194581] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4771828a-e218-4937-b79e-0841c57da8c7" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1409.194649] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4771828a-e218-4937-b79e-0841c57da8c7" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1409.194785] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4771828a-e218-4937-b79e-0841c57da8c7" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1409.194856] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4771828a-e218-4937-b79e-0841c57da8c7',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1409.429270] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1409.498515] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 8da5a86d-5fcd-4123-9912-c6ecf87912cb [ 1409.498515] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1409.498515] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1409.498515] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1409.498515] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1409.498515] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1409.498515] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:8da5a86d-5fcd-4123-9912-c6ecf87912cb already deleted. [ 1409.498515] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8da5a86d-5fcd-4123-9912-c6ecf87912cb" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1409.696341] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('23fa8e46-c46e-429c-b533-b6ee73936de0',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1409.697876] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-23fa8e46-c46e-429c-b533-b6ee73936de0 taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1409.698432] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-23fa8e46-c46e-429c-b533-b6ee73936de0" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1409.698432] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 4771828a-e218-4937-b79e-0841c57da8c7 with status ACTIVE [ 1409.698432] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1409.698432] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1409.698786] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1409.698786] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1409.698786] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1409.698921] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1409.699071] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1409.699071] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1409.699164] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1409.699212] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1409.699418] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1409.699544] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1409.699649] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1409.699746] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1409.699818] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1409.699900] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 4771828a-e218-4937-b79e-0841c57da8c7 is going to be updated. [ 1409.719871] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1409.720073] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1409.720073] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1409.720278] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1409.720418] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1409.720581] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4771828a-e218-4937-b79e-0841c57da8c7" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1409.935823] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 1409.935823] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 1410.202896] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('23fa8e46-c46e-429c-b533-b6ee73936de0',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1410.674863] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1410.675093] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1410.675203] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1410.675493] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1410.696158] env[69980]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 1410.697549] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1410.699010] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 1410.708196] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1410.708382] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1410.708490] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1410.708761] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1410.708887] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1410.709039] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 23fa8e46-c46e-429c-b533-b6ee73936de0 is going to be updated. [ 1410.742151] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1410.742322] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1410.742370] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1410.742550] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1410.753595] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1410.754349] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 1410.754425] env[69980]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=69980) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1410.754514] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 1410.756487] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1410.756626] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1410.756674] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1410.756848] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1410.757194] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1410.771726] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 23fa8e46-c46e-429c-b533-b6ee73936de0 in Status: IN_PROGRESS for 2s [ 1410.806523] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1410.806668] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1410.806739] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1410.806966] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1410.808290] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1410.808988] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 1410.976982] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1410.977329] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1410.977329] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1410.977536] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1410.977860] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1410.978158] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 1411.044464] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1411.044744] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1411.044868] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1411.045126] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1411.045495] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1411.045801] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:40. [ 1411.045893] env[69980]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:{'724b248c-fcba-4659-94d6-7aefe563ad89', 'd0e04be7-8718-489c-8ceb-fe661da4855a', '1c48b9d6-06bd-4429-a87d-c56109170df7', '190dbbe3-e412-4523-ae5a-c437b3c11354', '1f8e99ba-e1d1-4cdc-98f5-ccb8c37ca66e', '9057c45b-1d82-49a9-8ffb-aaf0cddf5801', '0dbf2bcd-0572-43ef-b18d-cc3cca7fcfd5', '8f760c98-a5b2-4500-9310-d081ef00461d', '3909a119-b9ca-4e95-b2b4-3541d0886a49', '72f0fad5-906a-4ed9-a922-fdb13010a34d', 'c27e63f9-6090-4aea-a9d5-e84fb1046cb3', '80e3ea48-91a5-4863-b1c2-f3e887204e39', '69e79787-6675-42a5-b381-7ffa87e43ee6', 'cdebe06d-8b9c-47c7-bf4d-f0246381eb14', '30a735ee-d68e-4b01-87b7-59775ace11cc', '23fa8e46-c46e-429c-b533-b6ee73936de0', '4191fccf-dc75-4be2-9ec5-2d6447dbdbd8', '0b52672e-87ad-43b6-b078-903b8601b014', '7f2e833b-9263-48ef-ba09-f0afee0fa4af', 'c64c611c-a81f-411b-a88c-f87f4d86a64a', '07d8236a-b9f2-429a-9942-e7cb46920213', '00f20236-2b69-46dc-a00f-0c4d6b93c17a', 'f0f521c8-595e-4f1b-a139-3ce8948484da', 'f2b778ac-011d-472f-9220-d8d50a881380', '162065c3-9db0-41c8-9437-c51716e30968', 'b472d7ce-a3a7-4859-8fa3-f222ee058e66', '2961e549-f7d2-46b0-a1f4-9365d96bb58a', 'bb697495-b311-499b-98c5-fa0133350846', '48dd2a84-68ac-43c8-a7e2-4cb28bb82546', '825b0052-8bd1-4107-8258-075804cbc484', '6719a83d-3363-4339-a277-6e1ec27ec7bc', '832bb529-72a6-428e-bdd7-50f804872365', '4eb0fe0d-cd04-4189-9b26-953ab87885bd', '400b642e-7f7e-4993-9916-a3e96af018da', '462431af-62e3-426c-a50e-a61604f20358', '700dc02a-f3c2-4363-9a0e-d7cdcb13a5b8', '194841ae-0965-407f-a2bf-6d1f7693c801', '241bcad9-5919-4c26-b0b9-beb6a98733bd', 'd696a1d3-1fa9-4790-b673-19d262f97699', 'e63cb46c-ccab-4856-bf25-2380514e2780'} {{(pid=69980) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1411.046067] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 1411.069165] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1411.069331] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1411.069383] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1411.072230] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1411.072230] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1411.072230] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 1411.072230] env[69980]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=69980) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1411.072230] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 1411.150137] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1411.150564] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1411.150783] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1411.151196] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1411.152519] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1411.152939] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 1411.153554] env[69980]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=69980) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1411.153554] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 1411.153554] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 1411.153554] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 20/40 resources of Type:Security Group Rules [ 1411.153554] env[69980]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 724b248c-fcba-4659-94d6-7aefe563ad89 with Priority: HIGH for action security_group_rules [ 1411.153554] env[69980]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: d0e04be7-8718-489c-8ceb-fe661da4855a with Priority: HIGH for action security_group_rules [ 1411.153554] env[69980]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 1c48b9d6-06bd-4429-a87d-c56109170df7 with Priority: HIGH for action security_group_rules [ 1411.153809] env[69980]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 190dbbe3-e412-4523-ae5a-c437b3c11354 with Priority: HIGH for action security_group_rules [ 1411.153844] env[69980]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 1f8e99ba-e1d1-4cdc-98f5-ccb8c37ca66e with Priority: HIGH for action security_group_rules [ 1411.154034] env[69980]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 9057c45b-1d82-49a9-8ffb-aaf0cddf5801 with Priority: HIGH for action security_group_rules [ 1411.154092] env[69980]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 0dbf2bcd-0572-43ef-b18d-cc3cca7fcfd5 with Priority: HIGH for action security_group_rules [ 1411.154226] env[69980]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 8f760c98-a5b2-4500-9310-d081ef00461d with Priority: HIGH for action security_group_rules [ 1411.154226] env[69980]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 3909a119-b9ca-4e95-b2b4-3541d0886a49 with Priority: HIGH for action security_group_rules [ 1411.154347] env[69980]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 72f0fad5-906a-4ed9-a922-fdb13010a34d with Priority: HIGH for action security_group_rules [ 1411.154464] env[69980]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: c27e63f9-6090-4aea-a9d5-e84fb1046cb3 with Priority: HIGH for action security_group_rules [ 1411.154562] env[69980]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 80e3ea48-91a5-4863-b1c2-f3e887204e39 with Priority: HIGH for action security_group_rules [ 1411.154703] env[69980]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 69e79787-6675-42a5-b381-7ffa87e43ee6 with Priority: HIGH for action security_group_rules [ 1411.154811] env[69980]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: cdebe06d-8b9c-47c7-bf4d-f0246381eb14 with Priority: HIGH for action security_group_rules [ 1411.154909] env[69980]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 30a735ee-d68e-4b01-87b7-59775ace11cc with Priority: HIGH for action security_group_rules [ 1411.154909] env[69980]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 23fa8e46-c46e-429c-b533-b6ee73936de0 with Priority: HIGH for action security_group_rules [ 1411.154968] env[69980]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 4191fccf-dc75-4be2-9ec5-2d6447dbdbd8 with Priority: HIGH for action security_group_rules [ 1411.156111] env[69980]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 0b52672e-87ad-43b6-b078-903b8601b014 with Priority: HIGH for action security_group_rules [ 1411.156111] env[69980]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 7f2e833b-9263-48ef-ba09-f0afee0fa4af with Priority: HIGH for action security_group_rules [ 1411.156111] env[69980]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: c64c611c-a81f-411b-a88c-f87f4d86a64a with Priority: HIGH for action security_group_rules [ 1411.156111] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1412.781974] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 23fa8e46-c46e-429c-b533-b6ee73936de0 in Status: SUCCESS [ 1412.782372] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-23fa8e46-c46e-429c-b533-b6ee73936de0" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1412.782372] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-23fa8e46-c46e-429c-b533-b6ee73936de0" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1412.782604] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-23fa8e46-c46e-429c-b533-b6ee73936de0" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1412.782797] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1412.782923] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1412.782987] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1412.783167] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1412.783248] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1412.783344] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-23fa8e46-c46e-429c-b533-b6ee73936de0" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1412.783434] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('23fa8e46-c46e-429c-b533-b6ee73936de0',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1413.286300] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('23fa8e46-c46e-429c-b533-b6ee73936de0',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1413.788500] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 23fa8e46-c46e-429c-b533-b6ee73936de0: rpc.has_security_group_logging(os_id): False [ 1413.818083] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1413.818335] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1413.818384] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1413.818695] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1413.838793] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1413.839187] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1413.839350] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1413.839478] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1413.839717] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1413.839836] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1413.839948] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 23fa8e46-c46e-429c-b533-b6ee73936de0 is going to be updated. [ 1413.904704] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1413.904893] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1413.904940] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1413.905173] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1413.905318] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1413.917884] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 23fa8e46-c46e-429c-b533-b6ee73936de0 in Status: IN_PROGRESS for 2s [ 1414.189056] env[69980]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1414.189243] env[69980]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=20], Jobs=1 [ 1414.189384] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 724b248c-fcba-4659-94d6-7aefe563ad89 with Priority: HIGH for action security_group_rules [ 1414.189584] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1c48b9d6-06bd-4429-a87d-c56109170df7 with Priority: HIGH for action security_group_rules [ 1414.189698] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0dbf2bcd-0572-43ef-b18d-cc3cca7fcfd5 with Priority: HIGH for action security_group_rules [ 1414.189831] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 30a735ee-d68e-4b01-87b7-59775ace11cc with Priority: HIGH for action security_group_rules [ 1414.189937] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c64c611c-a81f-411b-a88c-f87f4d86a64a with Priority: HIGH for action security_group_rules [ 1414.190066] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7f2e833b-9263-48ef-ba09-f0afee0fa4af with Priority: HIGH for action security_group_rules [ 1414.190204] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0b52672e-87ad-43b6-b078-903b8601b014 with Priority: HIGH for action security_group_rules [ 1414.190298] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4191fccf-dc75-4be2-9ec5-2d6447dbdbd8 with Priority: HIGH for action security_group_rules [ 1414.190400] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cdebe06d-8b9c-47c7-bf4d-f0246381eb14 with Priority: HIGH for action security_group_rules [ 1414.190576] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 23fa8e46-c46e-429c-b533-b6ee73936de0 with Priority: HIGH for action security_group_rules [ 1414.190664] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 69e79787-6675-42a5-b381-7ffa87e43ee6 with Priority: HIGH for action security_group_rules [ 1414.190726] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 80e3ea48-91a5-4863-b1c2-f3e887204e39 with Priority: HIGH for action security_group_rules [ 1414.190805] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c27e63f9-6090-4aea-a9d5-e84fb1046cb3 with Priority: HIGH for action security_group_rules [ 1414.190952] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 72f0fad5-906a-4ed9-a922-fdb13010a34d with Priority: HIGH for action security_group_rules [ 1414.191145] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3909a119-b9ca-4e95-b2b4-3541d0886a49 with Priority: HIGH for action security_group_rules [ 1414.191306] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9057c45b-1d82-49a9-8ffb-aaf0cddf5801 with Priority: HIGH for action security_group_rules [ 1414.191404] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8f760c98-a5b2-4500-9310-d081ef00461d with Priority: HIGH for action security_group_rules [ 1414.191500] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1f8e99ba-e1d1-4cdc-98f5-ccb8c37ca66e with Priority: HIGH for action security_group_rules [ 1414.191590] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d0e04be7-8718-489c-8ceb-fe661da4855a with Priority: HIGH for action security_group_rules [ 1414.191677] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 190dbbe3-e412-4523-ae5a-c437b3c11354 with Priority: HIGH for action security_group_rules [ 1414.192156] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock rules-724b248c-fcba-4659-94d6-7aefe563ad89 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1414.192295] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-724b248c-fcba-4659-94d6-7aefe563ad89" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1414.192358] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-724b248c-fcba-4659-94d6-7aefe563ad89" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1414.192648] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-724b248c-fcba-4659-94d6-7aefe563ad89" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1414.192780] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('724b248c-fcba-4659-94d6-7aefe563ad89',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1414.194496] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1c48b9d6-06bd-4429-a87d-c56109170df7 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1414.194496] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1c48b9d6-06bd-4429-a87d-c56109170df7" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1414.194496] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1c48b9d6-06bd-4429-a87d-c56109170df7" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1414.194739] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1c48b9d6-06bd-4429-a87d-c56109170df7" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1414.194739] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1c48b9d6-06bd-4429-a87d-c56109170df7',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1414.195583] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0dbf2bcd-0572-43ef-b18d-cc3cca7fcfd5 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1414.195701] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0dbf2bcd-0572-43ef-b18d-cc3cca7fcfd5" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1414.195701] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0dbf2bcd-0572-43ef-b18d-cc3cca7fcfd5" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1414.195883] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0dbf2bcd-0572-43ef-b18d-cc3cca7fcfd5" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1414.195969] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0dbf2bcd-0572-43ef-b18d-cc3cca7fcfd5',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1414.196909] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock rules-30a735ee-d68e-4b01-87b7-59775ace11cc taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1414.196909] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-30a735ee-d68e-4b01-87b7-59775ace11cc" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1414.196909] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-30a735ee-d68e-4b01-87b7-59775ace11cc" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1414.197228] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-30a735ee-d68e-4b01-87b7-59775ace11cc" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1414.197228] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('30a735ee-d68e-4b01-87b7-59775ace11cc',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1414.197886] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c64c611c-a81f-411b-a88c-f87f4d86a64a taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1414.197994] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c64c611c-a81f-411b-a88c-f87f4d86a64a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1414.198088] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c64c611c-a81f-411b-a88c-f87f4d86a64a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1414.198272] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c64c611c-a81f-411b-a88c-f87f4d86a64a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1414.198326] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c64c611c-a81f-411b-a88c-f87f4d86a64a',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1414.199023] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7f2e833b-9263-48ef-ba09-f0afee0fa4af taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1414.199129] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7f2e833b-9263-48ef-ba09-f0afee0fa4af" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1414.199543] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7f2e833b-9263-48ef-ba09-f0afee0fa4af" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1414.199543] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7f2e833b-9263-48ef-ba09-f0afee0fa4af" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1414.199543] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7f2e833b-9263-48ef-ba09-f0afee0fa4af',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1414.202206] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0b52672e-87ad-43b6-b078-903b8601b014 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1414.202319] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0b52672e-87ad-43b6-b078-903b8601b014" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1414.202407] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0b52672e-87ad-43b6-b078-903b8601b014" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1414.202535] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0b52672e-87ad-43b6-b078-903b8601b014" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1414.202634] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0b52672e-87ad-43b6-b078-903b8601b014',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1414.203553] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4191fccf-dc75-4be2-9ec5-2d6447dbdbd8 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1414.203698] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4191fccf-dc75-4be2-9ec5-2d6447dbdbd8" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1414.203793] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4191fccf-dc75-4be2-9ec5-2d6447dbdbd8" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1414.203973] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4191fccf-dc75-4be2-9ec5-2d6447dbdbd8" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1414.204063] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4191fccf-dc75-4be2-9ec5-2d6447dbdbd8',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1414.204935] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cdebe06d-8b9c-47c7-bf4d-f0246381eb14 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1414.205140] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cdebe06d-8b9c-47c7-bf4d-f0246381eb14" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1414.205268] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cdebe06d-8b9c-47c7-bf4d-f0246381eb14" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1414.205445] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cdebe06d-8b9c-47c7-bf4d-f0246381eb14" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1414.205525] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cdebe06d-8b9c-47c7-bf4d-f0246381eb14',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1414.206308] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock rules-23fa8e46-c46e-429c-b533-b6ee73936de0 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1414.206431] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-23fa8e46-c46e-429c-b533-b6ee73936de0" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1414.206659] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock rules-69e79787-6675-42a5-b381-7ffa87e43ee6 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1414.206789] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-69e79787-6675-42a5-b381-7ffa87e43ee6" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1414.206860] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-69e79787-6675-42a5-b381-7ffa87e43ee6" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1414.207220] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-69e79787-6675-42a5-b381-7ffa87e43ee6" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1414.207286] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('69e79787-6675-42a5-b381-7ffa87e43ee6',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1414.208838] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock rules-80e3ea48-91a5-4863-b1c2-f3e887204e39 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1414.208838] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-80e3ea48-91a5-4863-b1c2-f3e887204e39" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1414.208838] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-80e3ea48-91a5-4863-b1c2-f3e887204e39" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1414.208838] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-80e3ea48-91a5-4863-b1c2-f3e887204e39" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1414.208838] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('80e3ea48-91a5-4863-b1c2-f3e887204e39',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1414.209564] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c27e63f9-6090-4aea-a9d5-e84fb1046cb3 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1414.209756] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c27e63f9-6090-4aea-a9d5-e84fb1046cb3" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1414.209868] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c27e63f9-6090-4aea-a9d5-e84fb1046cb3" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1414.210088] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c27e63f9-6090-4aea-a9d5-e84fb1046cb3" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1414.210174] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c27e63f9-6090-4aea-a9d5-e84fb1046cb3',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1414.210955] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock rules-72f0fad5-906a-4ed9-a922-fdb13010a34d taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1414.211100] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-72f0fad5-906a-4ed9-a922-fdb13010a34d" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1414.211200] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-72f0fad5-906a-4ed9-a922-fdb13010a34d" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1414.211378] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-72f0fad5-906a-4ed9-a922-fdb13010a34d" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1414.211505] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('72f0fad5-906a-4ed9-a922-fdb13010a34d',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1414.212338] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3909a119-b9ca-4e95-b2b4-3541d0886a49 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1414.212441] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3909a119-b9ca-4e95-b2b4-3541d0886a49" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1414.212504] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3909a119-b9ca-4e95-b2b4-3541d0886a49" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1414.212670] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3909a119-b9ca-4e95-b2b4-3541d0886a49" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1414.212753] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3909a119-b9ca-4e95-b2b4-3541d0886a49',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1414.213725] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9057c45b-1d82-49a9-8ffb-aaf0cddf5801 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1414.213843] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9057c45b-1d82-49a9-8ffb-aaf0cddf5801" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1414.213843] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9057c45b-1d82-49a9-8ffb-aaf0cddf5801" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1414.213969] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9057c45b-1d82-49a9-8ffb-aaf0cddf5801" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1414.214022] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9057c45b-1d82-49a9-8ffb-aaf0cddf5801',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1414.214769] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8f760c98-a5b2-4500-9310-d081ef00461d taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1414.214940] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8f760c98-a5b2-4500-9310-d081ef00461d" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1414.214989] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8f760c98-a5b2-4500-9310-d081ef00461d" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1414.215153] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8f760c98-a5b2-4500-9310-d081ef00461d" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1414.215223] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8f760c98-a5b2-4500-9310-d081ef00461d',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1414.215900] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1f8e99ba-e1d1-4cdc-98f5-ccb8c37ca66e taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1414.216095] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1f8e99ba-e1d1-4cdc-98f5-ccb8c37ca66e" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1414.216184] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1f8e99ba-e1d1-4cdc-98f5-ccb8c37ca66e" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1414.216370] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1f8e99ba-e1d1-4cdc-98f5-ccb8c37ca66e" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1414.216474] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1f8e99ba-e1d1-4cdc-98f5-ccb8c37ca66e',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1414.217206] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d0e04be7-8718-489c-8ceb-fe661da4855a taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1414.217429] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d0e04be7-8718-489c-8ceb-fe661da4855a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1414.217534] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d0e04be7-8718-489c-8ceb-fe661da4855a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1414.217715] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d0e04be7-8718-489c-8ceb-fe661da4855a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1414.217791] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d0e04be7-8718-489c-8ceb-fe661da4855a',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1414.218554] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock rules-190dbbe3-e412-4523-ae5a-c437b3c11354 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1414.218684] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-190dbbe3-e412-4523-ae5a-c437b3c11354" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1414.218752] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-190dbbe3-e412-4523-ae5a-c437b3c11354" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1414.218901] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-190dbbe3-e412-4523-ae5a-c437b3c11354" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1414.218980] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('190dbbe3-e412-4523-ae5a-c437b3c11354',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1414.268037] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1414.268266] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1414.268266] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1414.268445] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1414.270819] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1414.270961] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1414.271602] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1414.271697] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1414.272400] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1414.272509] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1414.273195] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1414.273281] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1414.276800] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1414.276896] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1414.277392] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1414.277497] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1414.290496] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1414.290635] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0dbf2bcd-0572-43ef-b18d-cc3cca7fcfd5 is going to be deleted. [ 1414.291507] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1414.291716] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1414.311397] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1414.311397] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 69e79787-6675-42a5-b381-7ffa87e43ee6 is going to be deleted. [ 1414.312860] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1414.313145] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1414.336140] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1414.336442] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c27e63f9-6090-4aea-a9d5-e84fb1046cb3 is going to be deleted. [ 1414.337762] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1414.338145] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1414.340793] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1414.340951] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1414.366870] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1414.367058] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1414.375048] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1414.375048] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c64c611c-a81f-411b-a88c-f87f4d86a64a is going to be deleted. [ 1414.375651] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1414.375958] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1414.411881] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1414.412064] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7f2e833b-9263-48ef-ba09-f0afee0fa4af is going to be deleted. [ 1414.413167] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1414.413435] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1414.416771] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1414.416909] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1414.439407] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1414.439605] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 30a735ee-d68e-4b01-87b7-59775ace11cc is going to be deleted. [ 1414.440573] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1414.440789] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1414.466071] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1414.466211] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1414.548058] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1414.548058] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4191fccf-dc75-4be2-9ec5-2d6447dbdbd8 is going to be deleted. [ 1414.548846] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1414.549076] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1414.549182] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1414.549311] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0dbf2bcd-0572-43ef-b18d-cc3cca7fcfd5" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1414.549493] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1414.549684] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1414.549778] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1414.549896] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-69e79787-6675-42a5-b381-7ffa87e43ee6" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1414.550470] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1414.550735] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1414.550825] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1414.550945] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c27e63f9-6090-4aea-a9d5-e84fb1046cb3" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1414.551703] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1414.551827] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1414.551900] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1414.552133] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1414.552220] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1414.552329] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7f2e833b-9263-48ef-ba09-f0afee0fa4af" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1414.552473] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1414.552621] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1414.552710] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1414.552819] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c64c611c-a81f-411b-a88c-f87f4d86a64a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1414.589955] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1414.590170] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1414.590170] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1414.590361] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1414.590468] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1414.590587] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-30a735ee-d68e-4b01-87b7-59775ace11cc" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1414.645317] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1414.645514] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1414.645617] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1414.645833] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1414.645939] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1414.646087] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4191fccf-dc75-4be2-9ec5-2d6447dbdbd8" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1414.723125] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-9057c45b-1d82-49a9-8ffb-aaf0cddf5801 taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1414.723283] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9057c45b-1d82-49a9-8ffb-aaf0cddf5801" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1414.723357] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9057c45b-1d82-49a9-8ffb-aaf0cddf5801" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1414.724361] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9057c45b-1d82-49a9-8ffb-aaf0cddf5801" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1414.724361] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1414.724361] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1414.724361] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1414.724361] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1414.724361] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1414.724361] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9057c45b-1d82-49a9-8ffb-aaf0cddf5801" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1414.724361] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9057c45b-1d82-49a9-8ffb-aaf0cddf5801',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1414.773418] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1414.773585] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1414.773643] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1414.773819] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1414.775515] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1414.775614] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1414.804822] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1414.805229] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1414.805791] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1414.805886] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1414.806975] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1414.807084] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1414.807799] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1414.807884] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1414.810522] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1414.810655] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1414.814634] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1414.814634] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1414.814634] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1414.814634] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1414.818606] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1414.818606] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1414.819340] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1414.819429] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d0e04be7-8718-489c-8ceb-fe661da4855a is going to be deleted. [ 1414.820400] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1414.820656] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1414.822191] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1414.822290] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1414.863265] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1414.863407] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cdebe06d-8b9c-47c7-bf4d-f0246381eb14 is going to be deleted. [ 1414.864412] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1414.864625] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1414.870316] env[69980]: INFO networking_nsxv3.common.synchronization [req-367535cd-f32f-449b-896e-4a60005c0179 req-e0ea2083-25c5-468b-9c50-8b2f872d591f tempest-ServerActionsTestJSON-1479580870 tempest-ServerActionsTestJSON-1479580870-project-member] Enqueued Resource ID: 00f20236-2b69-46dc-a00f-0c4d6b93c17a with Priority: HIGHEST for action security_group_members [ 1414.870859] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 00f20236-2b69-46dc-a00f-0c4d6b93c17a with Priority: HIGHEST for action security_group_members [ 1414.871364] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-00f20236-2b69-46dc-a00f-0c4d6b93c17a taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1414.871484] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-00f20236-2b69-46dc-a00f-0c4d6b93c17a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1414.871546] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-00f20236-2b69-46dc-a00f-0c4d6b93c17a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1414.871724] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-00f20236-2b69-46dc-a00f-0c4d6b93c17a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1414.871861] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1414.871955] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1414.872027] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1414.872169] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1414.872251] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1414.872340] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('00f20236-2b69-46dc-a00f-0c4d6b93c17a',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1414.893794] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1414.893919] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 724b248c-fcba-4659-94d6-7aefe563ad89 is going to be deleted. [ 1414.894782] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1414.895007] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1414.917327] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1414.917483] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 80e3ea48-91a5-4863-b1c2-f3e887204e39 is going to be deleted. [ 1414.918245] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1414.918446] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1414.946320] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1414.946476] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1414.951959] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1414.952130] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3909a119-b9ca-4e95-b2b4-3541d0886a49 is going to be deleted. [ 1414.952953] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1414.953179] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1414.954542] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1414.954646] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1414.983958] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1414.983958] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8f760c98-a5b2-4500-9310-d081ef00461d is going to be deleted. [ 1414.983958] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1414.983958] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1414.984817] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1414.984919] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1415.004026] env[69980]: INFO networking_nsxv3.common.synchronization [req-1ed5c6f3-fcc3-406d-9930-588ef492560a req-844138b0-9c47-45d0-bee5-c6e649780d41 tempest-ServerActionsTestOtherA-1240783872 tempest-ServerActionsTestOtherA-1240783872-project-member] Enqueued Resource ID: 9057c45b-1d82-49a9-8ffb-aaf0cddf5801 with Priority: HIGHEST for action security_group_members [ 1415.004026] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1415.004026] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1415.004026] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9057c45b-1d82-49a9-8ffb-aaf0cddf5801 with Priority: HIGHEST for action security_group_members [ 1415.004026] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-9057c45b-1d82-49a9-8ffb-aaf0cddf5801 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1415.004026] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9057c45b-1d82-49a9-8ffb-aaf0cddf5801" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1415.004026] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9057c45b-1d82-49a9-8ffb-aaf0cddf5801" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1415.004026] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9057c45b-1d82-49a9-8ffb-aaf0cddf5801" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1415.004026] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1415.004026] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1415.004026] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1415.004026] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1415.004026] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1415.004026] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9057c45b-1d82-49a9-8ffb-aaf0cddf5801',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1415.009745] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1415.009875] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 190dbbe3-e412-4523-ae5a-c437b3c11354 is going to be deleted. [ 1415.011459] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1415.012651] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1415.027797] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1415.027995] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1415.049035] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1415.049035] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 72f0fad5-906a-4ed9-a922-fdb13010a34d is going to be deleted. [ 1415.049945] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1415.050169] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1415.117941] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1415.118089] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0b52672e-87ad-43b6-b078-903b8601b014 is going to be deleted. [ 1415.118941] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1415.119169] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1415.155958] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1415.156084] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1c48b9d6-06bd-4429-a87d-c56109170df7 is going to be deleted. [ 1415.157408] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1415.157613] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1415.159120] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1415.159225] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1415.174287] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1415.174436] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1415.182328] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1415.182481] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1415.195988] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1415.195988] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1f8e99ba-e1d1-4cdc-98f5-ccb8c37ca66e is going to be deleted. [ 1415.196798] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1415.196999] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1415.197138] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1415.197260] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d0e04be7-8718-489c-8ceb-fe661da4855a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1415.197597] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1415.197768] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1415.197852] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1415.197961] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cdebe06d-8b9c-47c7-bf4d-f0246381eb14" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1415.198477] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1415.198627] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1415.198709] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1415.198824] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-80e3ea48-91a5-4863-b1c2-f3e887204e39" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1415.198956] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1415.199117] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1415.199196] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1415.199304] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-724b248c-fcba-4659-94d6-7aefe563ad89" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1415.199894] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1415.199894] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1415.199894] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1415.199894] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3909a119-b9ca-4e95-b2b4-3541d0886a49" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1415.200107] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1415.200143] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1415.200912] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1415.200912] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8f760c98-a5b2-4500-9310-d081ef00461d" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1415.200912] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1415.200912] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1415.200912] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1415.200912] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-190dbbe3-e412-4523-ae5a-c437b3c11354" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1415.200912] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1415.201205] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1415.201205] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1415.201205] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-72f0fad5-906a-4ed9-a922-fdb13010a34d" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1415.224737] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1415.224881] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1415.224950] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1415.225162] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1415.225249] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1415.225366] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0b52672e-87ad-43b6-b078-903b8601b014" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1415.229380] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9057c45b-1d82-49a9-8ffb-aaf0cddf5801',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1415.262687] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1415.262846] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1415.262895] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1415.263107] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1415.263198] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1415.263316] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1c48b9d6-06bd-4429-a87d-c56109170df7" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1415.332276] env[69980]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1415.332847] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1415.333039] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1415.333197] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1415.333406] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1415.333569] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1415.333704] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1f8e99ba-e1d1-4cdc-98f5-ccb8c37ca66e" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1415.374276] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1415.374487] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1415.374539] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1415.374720] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1415.445138] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1415.445540] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1415.445709] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1415.445709] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1415.445931] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1415.446241] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1415.446336] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 00f20236-2b69-46dc-a00f-0c4d6b93c17a is going to be updated. [ 1415.502527] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1415.502797] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1415.502910] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1415.503328] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1415.503570] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1415.505844] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1415.506045] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1415.506156] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1415.506481] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1415.526116] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 00f20236-2b69-46dc-a00f-0c4d6b93c17a in Status: IN_PROGRESS for 2s [ 1415.556297] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1415.556297] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1415.556478] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1415.556578] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1415.556900] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1415.557061] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1415.557220] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9057c45b-1d82-49a9-8ffb-aaf0cddf5801 is going to be updated. [ 1415.585086] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1415.585256] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1415.585302] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1415.585514] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1415.585707] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1415.596021] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9057c45b-1d82-49a9-8ffb-aaf0cddf5801 in Status: IN_PROGRESS for 2s [ 1415.731682] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9057c45b-1d82-49a9-8ffb-aaf0cddf5801: rpc.has_security_group_logging(os_id): False [ 1415.755470] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1415.755678] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1415.755753] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1415.755969] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1415.756090] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1415.756422] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1415.756594] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1415.756668] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1415.756839] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1415.756918] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1415.757019] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9057c45b-1d82-49a9-8ffb-aaf0cddf5801 is going to be updated. [ 1415.815798] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1415.815798] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1415.816232] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1415.816232] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1415.816305] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1415.835018] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9057c45b-1d82-49a9-8ffb-aaf0cddf5801 in Status: IN_PROGRESS for 2s [ 1415.934726] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 23fa8e46-c46e-429c-b533-b6ee73936de0 in Status: SUCCESS [ 1415.934946] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-23fa8e46-c46e-429c-b533-b6ee73936de0" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1415.935120] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-23fa8e46-c46e-429c-b533-b6ee73936de0" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1415.935375] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-23fa8e46-c46e-429c-b533-b6ee73936de0" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1415.935468] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('23fa8e46-c46e-429c-b533-b6ee73936de0',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1416.437769] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-23fa8e46-c46e-429c-b533-b6ee73936de0 taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1416.437936] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-23fa8e46-c46e-429c-b533-b6ee73936de0" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1416.438080] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-23fa8e46-c46e-429c-b533-b6ee73936de0" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1416.438346] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-23fa8e46-c46e-429c-b533-b6ee73936de0" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1416.438525] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1416.438630] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1416.438702] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1416.438903] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1416.439010] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1416.439133] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-23fa8e46-c46e-429c-b533-b6ee73936de0" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1416.439354] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('23fa8e46-c46e-429c-b533-b6ee73936de0',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1416.941554] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('23fa8e46-c46e-429c-b533-b6ee73936de0',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1417.443908] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 23fa8e46-c46e-429c-b533-b6ee73936de0: rpc.has_security_group_logging(os_id): False [ 1417.460699] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1417.460876] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1417.460993] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1417.461206] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1417.461263] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1417.461516] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1417.461617] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1417.461673] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1417.461844] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1417.461930] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1417.462467] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 23fa8e46-c46e-429c-b533-b6ee73936de0 is going to be updated. [ 1417.521318] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1417.521456] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1417.521543] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1417.521746] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1417.521916] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1417.533187] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 00f20236-2b69-46dc-a00f-0c4d6b93c17a in Status: SUCCESS [ 1417.533343] env[69980]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 00f20236-2b69-46dc-a00f-0c4d6b93c17a deletion is rescheduled due to dependency. [ 1417.533442] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-00f20236-2b69-46dc-a00f-0c4d6b93c17a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1417.535117] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 23fa8e46-c46e-429c-b533-b6ee73936de0 in Status: IN_PROGRESS for 2s [ 1417.609669] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9057c45b-1d82-49a9-8ffb-aaf0cddf5801 in Status: SUCCESS [ 1417.609881] env[69980]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9057c45b-1d82-49a9-8ffb-aaf0cddf5801 deletion is rescheduled due to dependency. [ 1417.609987] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9057c45b-1d82-49a9-8ffb-aaf0cddf5801" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1417.848235] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9057c45b-1d82-49a9-8ffb-aaf0cddf5801 in Status: SUCCESS [ 1417.848454] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9057c45b-1d82-49a9-8ffb-aaf0cddf5801" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1419.549769] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 23fa8e46-c46e-429c-b533-b6ee73936de0 in Status: SUCCESS [ 1419.550074] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-23fa8e46-c46e-429c-b533-b6ee73936de0" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1420.003044] env[69980]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1420.003208] env[69980]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1421.363263] env[69980]: INFO networking_nsxv3.common.synchronization [req-1f04bff9-57e5-41d3-b97e-5887d05b1595 req-4449214c-fa84-4a21-9684-2ae7d471230a tempest-AttachVolumeTestJSON-92929017 tempest-AttachVolumeTestJSON-92929017-project-member] Enqueued Resource ID: 832bb529-72a6-428e-bdd7-50f804872365 with Priority: HIGHEST for action security_group_members [ 1421.363758] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 832bb529-72a6-428e-bdd7-50f804872365 with Priority: HIGHEST for action security_group_members [ 1421.364127] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-832bb529-72a6-428e-bdd7-50f804872365 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1421.364987] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-832bb529-72a6-428e-bdd7-50f804872365" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1421.365138] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-832bb529-72a6-428e-bdd7-50f804872365" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1421.365381] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-832bb529-72a6-428e-bdd7-50f804872365" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1421.369020] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1421.369020] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1421.369020] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1421.369020] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1421.369020] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1421.369020] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('832bb529-72a6-428e-bdd7-50f804872365',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1421.868895] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1421.868895] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1421.868895] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1421.869801] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1421.891863] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1421.892142] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1421.892252] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1421.892322] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1421.892514] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1421.892595] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1421.892687] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 832bb529-72a6-428e-bdd7-50f804872365 is going to be updated. [ 1421.913832] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1421.914014] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1421.914101] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1421.914320] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1421.914486] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1421.921842] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 832bb529-72a6-428e-bdd7-50f804872365 in Status: IN_PROGRESS for 2s [ 1421.939195] env[69980]: INFO networking_nsxv3.common.synchronization [req-47557416-39a1-45b5-badc-1a958f9a37d5 req-32c571d3-2c10-4cd6-a44b-53f32f44abfa tempest-ServerActionsTestJSON-1479580870 tempest-ServerActionsTestJSON-1479580870-project-member] Enqueued Resource ID: 00f20236-2b69-46dc-a00f-0c4d6b93c17a with Priority: HIGHEST for action security_group_members [ 1421.939788] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 00f20236-2b69-46dc-a00f-0c4d6b93c17a with Priority: HIGHEST for action security_group_members [ 1421.940132] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-00f20236-2b69-46dc-a00f-0c4d6b93c17a taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1421.940281] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-00f20236-2b69-46dc-a00f-0c4d6b93c17a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1421.940351] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-00f20236-2b69-46dc-a00f-0c4d6b93c17a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1421.940648] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-00f20236-2b69-46dc-a00f-0c4d6b93c17a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1421.941080] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1421.941080] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1421.941080] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1421.941271] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1421.941271] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1421.941359] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('00f20236-2b69-46dc-a00f-0c4d6b93c17a',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1422.192180] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock network-637 taken with stack trace [, , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1422.192556] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "network-637" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1422.192556] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "network-637" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1422.192935] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "network-637" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1422.193248] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1422.193418] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1422.193539] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1422.193769] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1422.193959] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1422.194299] env[69980]: DEBUG dogpile.cache.region [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] No value present for key: 'zone-id' {{(pid=69980) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1422.194426] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] NeedRegenerationException {{(pid=69980) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1422.194540] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] no value, waiting for create lock {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1422.194656] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] value creation lock acquired {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1422.194982] env[69980]: DEBUG dogpile.cache.region [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] No value present for key: 'zone-id' {{(pid=69980) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1422.195220] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Calling creation function for not-yet-present value {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1422.195440] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1422.212822] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1422.212994] env[69980]: DEBUG dogpile.cache.region [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=69980) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1422.213137] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Released creation lock {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1422.213315] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "network-637" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1422.213623] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock port-d385a483-5c7f-4dae-b5bc-034914b966ec taken with stack trace [, , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1422.213797] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "port-d385a483-5c7f-4dae-b5bc-034914b966ec" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1422.213933] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "port-d385a483-5c7f-4dae-b5bc-034914b966ec" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1422.214279] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "port-d385a483-5c7f-4dae-b5bc-034914b966ec" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1422.214426] env[69980]: DEBUG networking_nsxv3.api.rpc [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d385a483-5c7f-4dae-b5bc-034914b966ec',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1422.443743] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1422.444218] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1422.444218] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1422.444454] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1422.444533] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1422.444706] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1422.444819] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1422.444910] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1422.445144] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1422.445260] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1422.445365] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 00f20236-2b69-46dc-a00f-0c4d6b93c17a is going to be updated. [ 1422.469492] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1422.469737] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1422.469884] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1422.469994] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1422.470152] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1422.478994] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 00f20236-2b69-46dc-a00f-0c4d6b93c17a in Status: IN_PROGRESS for 2s [ 1422.717111] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1422.717388] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1422.717488] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1422.717944] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1422.718136] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1422.718303] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Segment Port d385a483-5c7f-4dae-b5bc-034914b966ec not found, creating... [ 1422.718579] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1422.718750] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1422.718872] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1422.719135] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1422.719312] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1422.719666] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1422.719836] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1422.719957] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1422.721140] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1422.721292] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1422.721477] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Resource: SegmentPort with ID: d385a483-5c7f-4dae-b5bc-034914b966ec is going to be created. [ 1422.745920] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1422.746146] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1422.746837] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1422.746837] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1422.746837] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1422.746980] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "port-d385a483-5c7f-4dae-b5bc-034914b966ec" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1423.158726] env[69980]: INFO networking_nsxv3.common.synchronization [None req-7079e2a9-4427-4615-aa1f-c7082c560d86 None None] Enqueued Resource ID: abbe4053-9e00-46da-9f66-1239d1d49fdb with Priority: HIGHEST for action port [ 1423.159497] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: abbe4053-9e00-46da-9f66-1239d1d49fdb with Priority: HIGHEST for action port [ 1423.159962] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock port-abbe4053-9e00-46da-9f66-1239d1d49fdb taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1423.160241] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-abbe4053-9e00-46da-9f66-1239d1d49fdb" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1423.160321] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-abbe4053-9e00-46da-9f66-1239d1d49fdb" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1423.160671] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-abbe4053-9e00-46da-9f66-1239d1d49fdb" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1423.160817] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('abbe4053-9e00-46da-9f66-1239d1d49fdb',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1423.493057] env[69980]: INFO networking_nsxv3.common.synchronization [req-47557416-39a1-45b5-badc-1a958f9a37d5 req-0ccf5494-2a5f-4d7c-8696-91a103f52c61 service nova] Enqueued Resource ID: 00f20236-2b69-46dc-a00f-0c4d6b93c17a with Priority: HIGHEST for action security_group_rules [ 1423.493297] env[69980]: INFO networking_nsxv3.common.synchronization [req-47557416-39a1-45b5-badc-1a958f9a37d5 req-0ccf5494-2a5f-4d7c-8696-91a103f52c61 service nova] Enqueued Resource ID: 00f20236-2b69-46dc-a00f-0c4d6b93c17a with Priority: HIGHEST for action security_group_members [ 1423.493391] env[69980]: INFO networking_nsxv3.common.synchronization [req-47557416-39a1-45b5-badc-1a958f9a37d5 req-0ccf5494-2a5f-4d7c-8696-91a103f52c61 service nova] Enqueued Resource ID: d385a483-5c7f-4dae-b5bc-034914b966ec with Priority: HIGHEST for action port [ 1423.493618] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 00f20236-2b69-46dc-a00f-0c4d6b93c17a with Priority: HIGHEST for action security_group_rules [ 1423.493749] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 00f20236-2b69-46dc-a00f-0c4d6b93c17a with Priority: HIGHEST for action security_group_members [ 1423.493847] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d385a483-5c7f-4dae-b5bc-034914b966ec with Priority: HIGHEST for action port [ 1423.494405] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock rules-00f20236-2b69-46dc-a00f-0c4d6b93c17a taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1423.494517] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-00f20236-2b69-46dc-a00f-0c4d6b93c17a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1423.494588] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-00f20236-2b69-46dc-a00f-0c4d6b93c17a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1423.494825] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-00f20236-2b69-46dc-a00f-0c4d6b93c17a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1423.494927] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('00f20236-2b69-46dc-a00f-0c4d6b93c17a',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1423.495800] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-00f20236-2b69-46dc-a00f-0c4d6b93c17a taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1423.495902] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-00f20236-2b69-46dc-a00f-0c4d6b93c17a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1423.496099] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock port-d385a483-5c7f-4dae-b5bc-034914b966ec taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1423.496210] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d385a483-5c7f-4dae-b5bc-034914b966ec" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1423.496255] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d385a483-5c7f-4dae-b5bc-034914b966ec" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1423.496427] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d385a483-5c7f-4dae-b5bc-034914b966ec" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1423.496499] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d385a483-5c7f-4dae-b5bc-034914b966ec',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1423.663333] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port abbe4053-9e00-46da-9f66-1239d1d49fdb [ 1423.663545] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1423.663681] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1423.663752] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1423.663957] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1423.664059] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1423.664152] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:abbe4053-9e00-46da-9f66-1239d1d49fdb already deleted. [ 1423.664240] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-abbe4053-9e00-46da-9f66-1239d1d49fdb" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1423.931816] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 832bb529-72a6-428e-bdd7-50f804872365 in Status: SUCCESS [ 1423.932074] env[69980]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 832bb529-72a6-428e-bdd7-50f804872365 deletion is rescheduled due to dependency. [ 1423.932190] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-832bb529-72a6-428e-bdd7-50f804872365" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1423.997909] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-00f20236-2b69-46dc-a00f-0c4d6b93c17a taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1423.997909] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-00f20236-2b69-46dc-a00f-0c4d6b93c17a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1423.998782] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d385a483-5c7f-4dae-b5bc-034914b966ec with status ACTIVE [ 1423.998782] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1423.998782] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1423.998782] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1423.998782] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1423.999059] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1423.999156] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1423.999207] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1423.999277] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1423.999447] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1423.999561] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1423.999778] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1423.999876] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1423.999926] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1424.000208] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1424.000208] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1424.000800] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d385a483-5c7f-4dae-b5bc-034914b966ec is going to be updated. [ 1424.019627] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1424.019627] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1424.019627] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1424.019856] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1424.019896] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1424.020071] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d385a483-5c7f-4dae-b5bc-034914b966ec" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1424.489110] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 00f20236-2b69-46dc-a00f-0c4d6b93c17a in Status: SUCCESS [ 1424.489110] env[69980]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 00f20236-2b69-46dc-a00f-0c4d6b93c17a deletion is rescheduled due to dependency. [ 1424.489110] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-00f20236-2b69-46dc-a00f-0c4d6b93c17a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1424.489290] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-00f20236-2b69-46dc-a00f-0c4d6b93c17a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1424.489488] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-00f20236-2b69-46dc-a00f-0c4d6b93c17a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1424.489740] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1424.489907] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1424.489949] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1424.490204] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1424.490204] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1424.490319] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('00f20236-2b69-46dc-a00f-0c4d6b93c17a',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1424.995286] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('00f20236-2b69-46dc-a00f-0c4d6b93c17a',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1425.268660] env[69980]: INFO networking_nsxv3.common.synchronization [None req-4f0824d9-ed48-4517-8dd7-2a737558a2af None None] Enqueued Resource ID: df579a7e-1e45-44e6-b64d-a9c930fa7418 with Priority: HIGHEST for action port [ 1425.268937] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: df579a7e-1e45-44e6-b64d-a9c930fa7418 with Priority: HIGHEST for action port [ 1425.269506] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock port-df579a7e-1e45-44e6-b64d-a9c930fa7418 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1425.269652] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-df579a7e-1e45-44e6-b64d-a9c930fa7418" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1425.269821] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-df579a7e-1e45-44e6-b64d-a9c930fa7418" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1425.270038] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-df579a7e-1e45-44e6-b64d-a9c930fa7418" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1425.270111] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('df579a7e-1e45-44e6-b64d-a9c930fa7418',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1425.497748] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('00f20236-2b69-46dc-a00f-0c4d6b93c17a',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1425.771671] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port df579a7e-1e45-44e6-b64d-a9c930fa7418 [ 1425.772269] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1425.772269] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1425.772269] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1425.773737] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1425.773737] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1425.773737] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:df579a7e-1e45-44e6-b64d-a9c930fa7418 already deleted. [ 1425.773737] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-df579a7e-1e45-44e6-b64d-a9c930fa7418" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1426.000649] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1426.001101] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1426.001101] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1426.001215] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1426.001215] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1426.001297] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 00f20236-2b69-46dc-a00f-0c4d6b93c17a is going to be updated. [ 1426.025545] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1426.025740] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1426.025740] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1426.025909] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1426.026080] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1426.034295] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 00f20236-2b69-46dc-a00f-0c4d6b93c17a in Status: IN_PROGRESS for 2s [ 1428.046063] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 00f20236-2b69-46dc-a00f-0c4d6b93c17a in Status: SUCCESS [ 1428.046370] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-00f20236-2b69-46dc-a00f-0c4d6b93c17a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1428.046437] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-00f20236-2b69-46dc-a00f-0c4d6b93c17a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1428.046648] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-00f20236-2b69-46dc-a00f-0c4d6b93c17a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1428.046838] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1428.047009] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1428.047072] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1428.047191] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1428.047271] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1428.047356] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-00f20236-2b69-46dc-a00f-0c4d6b93c17a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1428.047445] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('00f20236-2b69-46dc-a00f-0c4d6b93c17a',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1428.550063] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('00f20236-2b69-46dc-a00f-0c4d6b93c17a',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1428.574597] env[69980]: INFO networking_nsxv3.common.synchronization [req-b3479705-b6c4-4c15-9255-731e04425684 req-88a25315-98cb-44b0-864b-8b492fe01949 tempest-ServersTestJSON-85857845 tempest-ServersTestJSON-85857845-project-member] Enqueued Resource ID: 33e8376b-4b98-4aa5-8325-ac1f9953095a with Priority: HIGHEST for action security_group_members [ 1428.575153] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 33e8376b-4b98-4aa5-8325-ac1f9953095a with Priority: HIGHEST for action security_group_members [ 1428.575547] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-33e8376b-4b98-4aa5-8325-ac1f9953095a taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1428.575685] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-33e8376b-4b98-4aa5-8325-ac1f9953095a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1428.575755] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-33e8376b-4b98-4aa5-8325-ac1f9953095a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1428.576139] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-33e8376b-4b98-4aa5-8325-ac1f9953095a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1428.576330] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1428.576460] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1428.576537] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1428.576731] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1428.576831] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1428.577017] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('33e8376b-4b98-4aa5-8325-ac1f9953095a',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1428.837952] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock network-14 taken with stack trace [, , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1428.838174] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "network-14" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1428.838301] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "network-14" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1428.838639] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "network-14" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1428.838907] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1428.839272] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1428.839423] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1428.839688] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1428.839850] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1428.840080] env[69980]: DEBUG dogpile.cache.region [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] No value present for key: 'zone-id' {{(pid=69980) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1428.840200] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] NeedRegenerationException {{(pid=69980) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1428.840312] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] no value, waiting for create lock {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1428.840424] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] value creation lock acquired {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1428.840538] env[69980]: DEBUG dogpile.cache.region [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] No value present for key: 'zone-id' {{(pid=69980) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1428.840672] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Calling creation function for not-yet-present value {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1428.840825] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1428.860360] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1428.860636] env[69980]: DEBUG dogpile.cache.region [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=69980) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1428.860727] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Released creation lock {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1428.860908] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "network-14" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1428.861265] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock port-e9a598e6-8fc9-4157-9a68-4227eff4d301 taken with stack trace [, , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1428.861443] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "port-e9a598e6-8fc9-4157-9a68-4227eff4d301" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1428.861567] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "port-e9a598e6-8fc9-4157-9a68-4227eff4d301" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1428.861913] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "port-e9a598e6-8fc9-4157-9a68-4227eff4d301" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1428.862154] env[69980]: DEBUG networking_nsxv3.api.rpc [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e9a598e6-8fc9-4157-9a68-4227eff4d301',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1429.052461] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 00f20236-2b69-46dc-a00f-0c4d6b93c17a: rpc.has_security_group_logging(os_id): False [ 1429.069912] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1429.070081] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1429.070131] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1429.070322] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1429.070413] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1429.070716] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1429.070819] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1429.070879] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1429.071042] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1429.071125] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1429.071210] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 00f20236-2b69-46dc-a00f-0c4d6b93c17a is going to be updated. [ 1429.078698] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1429.078801] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1429.078867] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1429.079015] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1429.079102] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1429.079274] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1429.079368] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1429.079422] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1429.079562] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1429.079763] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1429.079886] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 33e8376b-4b98-4aa5-8325-ac1f9953095a already deleted. [ 1429.079986] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-33e8376b-4b98-4aa5-8325-ac1f9953095a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1429.133264] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1429.133453] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1429.133453] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1429.133640] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1429.133786] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1429.145930] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 00f20236-2b69-46dc-a00f-0c4d6b93c17a in Status: IN_PROGRESS for 2s [ 1429.365272] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1429.365498] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1429.365638] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1429.365912] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1429.366075] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1429.366236] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Segment Port e9a598e6-8fc9-4157-9a68-4227eff4d301 not found, creating... [ 1429.366502] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1429.366683] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1429.366813] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1429.367049] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1429.367192] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1429.367478] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1429.367713] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1429.367849] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1429.368087] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1429.368232] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1429.368374] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Resource: SegmentPort with ID: e9a598e6-8fc9-4157-9a68-4227eff4d301 is going to be created. [ 1429.387301] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1429.387489] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1429.387489] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1429.388208] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1429.388208] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1429.388344] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "port-e9a598e6-8fc9-4157-9a68-4227eff4d301" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1430.063789] env[69980]: INFO networking_nsxv3.common.synchronization [req-b3479705-b6c4-4c15-9255-731e04425684 req-10a0686c-d999-44df-998b-38109e2a15f3 service nova] Enqueued Resource ID: 33e8376b-4b98-4aa5-8325-ac1f9953095a with Priority: HIGHEST for action security_group_rules [ 1430.064058] env[69980]: INFO networking_nsxv3.common.synchronization [req-b3479705-b6c4-4c15-9255-731e04425684 req-10a0686c-d999-44df-998b-38109e2a15f3 service nova] Enqueued Resource ID: 33e8376b-4b98-4aa5-8325-ac1f9953095a with Priority: HIGHEST for action security_group_members [ 1430.064137] env[69980]: INFO networking_nsxv3.common.synchronization [req-b3479705-b6c4-4c15-9255-731e04425684 req-10a0686c-d999-44df-998b-38109e2a15f3 service nova] Enqueued Resource ID: e9a598e6-8fc9-4157-9a68-4227eff4d301 with Priority: HIGHEST for action port [ 1430.064592] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 33e8376b-4b98-4aa5-8325-ac1f9953095a with Priority: HIGHEST for action security_group_rules [ 1430.064726] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 33e8376b-4b98-4aa5-8325-ac1f9953095a with Priority: HIGHEST for action security_group_members [ 1430.064845] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e9a598e6-8fc9-4157-9a68-4227eff4d301 with Priority: HIGHEST for action port [ 1430.066162] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock rules-33e8376b-4b98-4aa5-8325-ac1f9953095a taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1430.066296] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-33e8376b-4b98-4aa5-8325-ac1f9953095a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1430.066355] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-33e8376b-4b98-4aa5-8325-ac1f9953095a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1430.066609] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-33e8376b-4b98-4aa5-8325-ac1f9953095a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1430.066700] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('33e8376b-4b98-4aa5-8325-ac1f9953095a',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1430.067778] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-33e8376b-4b98-4aa5-8325-ac1f9953095a taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1430.067922] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-33e8376b-4b98-4aa5-8325-ac1f9953095a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1430.069075] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-33e8376b-4b98-4aa5-8325-ac1f9953095a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1430.069286] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-33e8376b-4b98-4aa5-8325-ac1f9953095a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1430.069453] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1430.069550] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1430.069621] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1430.069803] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1430.069959] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1430.070027] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('33e8376b-4b98-4aa5-8325-ac1f9953095a',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1430.070813] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock port-e9a598e6-8fc9-4157-9a68-4227eff4d301 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1430.070922] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e9a598e6-8fc9-4157-9a68-4227eff4d301" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1430.070989] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e9a598e6-8fc9-4157-9a68-4227eff4d301" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1430.071155] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e9a598e6-8fc9-4157-9a68-4227eff4d301" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1430.071225] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e9a598e6-8fc9-4157-9a68-4227eff4d301',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1430.574076] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('33e8376b-4b98-4aa5-8325-ac1f9953095a',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1430.574551] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-33e8376b-4b98-4aa5-8325-ac1f9953095a taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1430.574659] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-33e8376b-4b98-4aa5-8325-ac1f9953095a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1430.575715] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e9a598e6-8fc9-4157-9a68-4227eff4d301 with status ACTIVE [ 1430.575947] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1430.576079] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1430.576079] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1430.576246] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1430.576335] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1430.576504] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1430.576601] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1430.576658] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1430.576803] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1430.576882] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1430.577084] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1430.577339] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1430.577339] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1430.577411] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1430.577443] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1430.577586] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e9a598e6-8fc9-4157-9a68-4227eff4d301 is going to be updated. [ 1430.596969] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1430.597147] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1430.597193] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1430.597385] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1430.597537] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1430.597900] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e9a598e6-8fc9-4157-9a68-4227eff4d301" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1431.076718] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('33e8376b-4b98-4aa5-8325-ac1f9953095a',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1431.159159] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 00f20236-2b69-46dc-a00f-0c4d6b93c17a in Status: SUCCESS [ 1431.159338] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-00f20236-2b69-46dc-a00f-0c4d6b93c17a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1431.579119] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1431.579282] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1431.579344] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1431.579568] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1431.579719] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1431.579805] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 33e8376b-4b98-4aa5-8325-ac1f9953095a is going to be created. [ 1431.603212] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1431.603398] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1431.603398] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1431.603589] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1431.603746] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1431.614151] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 33e8376b-4b98-4aa5-8325-ac1f9953095a in Status: UNINITIALIZED for 2s [ 1433.623853] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 33e8376b-4b98-4aa5-8325-ac1f9953095a in Status: SUCCESS [ 1433.624122] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-33e8376b-4b98-4aa5-8325-ac1f9953095a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1433.624232] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-33e8376b-4b98-4aa5-8325-ac1f9953095a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1433.624438] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-33e8376b-4b98-4aa5-8325-ac1f9953095a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1433.624626] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1433.624739] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1433.624805] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1433.624957] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1433.625225] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1433.625325] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-33e8376b-4b98-4aa5-8325-ac1f9953095a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1433.625415] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('33e8376b-4b98-4aa5-8325-ac1f9953095a',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1434.131871] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-33e8376b-4b98-4aa5-8325-ac1f9953095a taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1434.131871] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-33e8376b-4b98-4aa5-8325-ac1f9953095a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1434.131871] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-33e8376b-4b98-4aa5-8325-ac1f9953095a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1434.131871] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-33e8376b-4b98-4aa5-8325-ac1f9953095a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1434.132222] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1434.132222] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1434.132330] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1434.132421] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1434.132606] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1434.132706] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-33e8376b-4b98-4aa5-8325-ac1f9953095a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1434.132862] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-33e8376b-4b98-4aa5-8325-ac1f9953095a taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1434.132959] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-33e8376b-4b98-4aa5-8325-ac1f9953095a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1434.133049] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-33e8376b-4b98-4aa5-8325-ac1f9953095a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1434.133294] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-33e8376b-4b98-4aa5-8325-ac1f9953095a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1434.133592] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1434.133592] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1434.133592] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1434.133786] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1434.133877] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1434.133931] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-33e8376b-4b98-4aa5-8325-ac1f9953095a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1434.134028] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('33e8376b-4b98-4aa5-8325-ac1f9953095a',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1434.636194] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 33e8376b-4b98-4aa5-8325-ac1f9953095a: rpc.has_security_group_logging(os_id): False [ 1434.665837] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1434.666018] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1434.666018] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1434.666218] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1434.666310] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1434.666504] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1434.666605] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1434.666667] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1434.666821] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1434.666894] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1434.667098] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1434.667195] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1434.667257] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1434.667394] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1434.667545] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1434.667683] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1434.667781] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1434.667841] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1434.667978] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1434.668064] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1434.668151] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 33e8376b-4b98-4aa5-8325-ac1f9953095a is going to be created. [ 1434.736077] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1434.736260] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1434.736316] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1434.736516] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1434.736696] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1434.746157] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 33e8376b-4b98-4aa5-8325-ac1f9953095a in Status: IN_PROGRESS for 2s [ 1435.065302] env[69980]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1435.065412] env[69980]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1436.758939] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 33e8376b-4b98-4aa5-8325-ac1f9953095a in Status: SUCCESS [ 1436.759344] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-33e8376b-4b98-4aa5-8325-ac1f9953095a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1440.066685] env[69980]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1440.067053] env[69980]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1442.694455] env[69980]: INFO networking_nsxv3.common.synchronization [req-ef309ad6-5a75-4567-aa50-ef1d3c270043 req-a09eede1-767a-413a-ae50-261bc0491906 tempest-ServersTestJSON-85857845 tempest-ServersTestJSON-85857845-project-member] Enqueued Resource ID: 33e8376b-4b98-4aa5-8325-ac1f9953095a with Priority: HIGHEST for action security_group_members [ 1442.694653] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 33e8376b-4b98-4aa5-8325-ac1f9953095a with Priority: HIGHEST for action security_group_members [ 1442.694800] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-33e8376b-4b98-4aa5-8325-ac1f9953095a taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1442.694951] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-33e8376b-4b98-4aa5-8325-ac1f9953095a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1442.695026] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-33e8376b-4b98-4aa5-8325-ac1f9953095a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1442.695200] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-33e8376b-4b98-4aa5-8325-ac1f9953095a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1442.695359] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1442.695454] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1442.695510] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1442.695657] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1442.695742] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1442.695832] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('33e8376b-4b98-4aa5-8325-ac1f9953095a',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1442.956080] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock network-14 taken with stack trace [, , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1442.956310] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "network-14" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1442.956440] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "network-14" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1442.956717] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "network-14" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1442.956993] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1442.957160] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1442.957281] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1442.957495] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1442.957641] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1442.957843] env[69980]: DEBUG dogpile.cache.region [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] No value present for key: 'zone-id' {{(pid=69980) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1442.957958] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] NeedRegenerationException {{(pid=69980) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1442.958075] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] no value, waiting for create lock {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1442.958184] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] value creation lock acquired {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1442.958295] env[69980]: DEBUG dogpile.cache.region [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] No value present for key: 'zone-id' {{(pid=69980) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1442.958402] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Calling creation function for not-yet-present value {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1442.958531] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1442.978252] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1442.978423] env[69980]: DEBUG dogpile.cache.region [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=69980) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1442.978552] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Released creation lock {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1442.978723] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "network-14" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1442.979022] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock port-b1f899f5-6268-4b68-83ab-8061f1c8abe3 taken with stack trace [, , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1442.979191] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "port-b1f899f5-6268-4b68-83ab-8061f1c8abe3" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1442.979315] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "port-b1f899f5-6268-4b68-83ab-8061f1c8abe3" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1442.979610] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "port-b1f899f5-6268-4b68-83ab-8061f1c8abe3" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1442.979777] env[69980]: DEBUG networking_nsxv3.api.rpc [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b1f899f5-6268-4b68-83ab-8061f1c8abe3',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1443.197971] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('33e8376b-4b98-4aa5-8325-ac1f9953095a',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1443.481749] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1443.482052] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1443.482052] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1443.482319] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1443.482473] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1443.482705] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Segment Port b1f899f5-6268-4b68-83ab-8061f1c8abe3 not found, creating... [ 1443.483022] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1443.483191] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1443.483315] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1443.483550] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1443.483692] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1443.483979] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1443.484151] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1443.484271] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1443.484481] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1443.484618] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1443.484761] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Resource: SegmentPort with ID: b1f899f5-6268-4b68-83ab-8061f1c8abe3 is going to be created. [ 1443.503956] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1443.504199] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1443.504347] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1443.504691] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1443.504933] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1443.505181] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "port-b1f899f5-6268-4b68-83ab-8061f1c8abe3" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1443.700486] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('33e8376b-4b98-4aa5-8325-ac1f9953095a',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1444.167294] env[69980]: INFO networking_nsxv3.common.synchronization [req-ef309ad6-5a75-4567-aa50-ef1d3c270043 req-13f5fcb0-9afd-4d9e-bdf9-582266435942 service nova] Enqueued Resource ID: 33e8376b-4b98-4aa5-8325-ac1f9953095a with Priority: HIGHEST for action security_group_rules [ 1444.167552] env[69980]: INFO networking_nsxv3.common.synchronization [req-ef309ad6-5a75-4567-aa50-ef1d3c270043 req-13f5fcb0-9afd-4d9e-bdf9-582266435942 service nova] Enqueued Resource ID: 33e8376b-4b98-4aa5-8325-ac1f9953095a with Priority: HIGHEST for action security_group_members [ 1444.167805] env[69980]: INFO networking_nsxv3.common.synchronization [req-ef309ad6-5a75-4567-aa50-ef1d3c270043 req-13f5fcb0-9afd-4d9e-bdf9-582266435942 service nova] Enqueued Resource ID: b1f899f5-6268-4b68-83ab-8061f1c8abe3 with Priority: HIGHEST for action port [ 1444.168404] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 33e8376b-4b98-4aa5-8325-ac1f9953095a with Priority: HIGHEST for action security_group_rules [ 1444.168604] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 33e8376b-4b98-4aa5-8325-ac1f9953095a with Priority: HIGHEST for action security_group_members [ 1444.168763] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b1f899f5-6268-4b68-83ab-8061f1c8abe3 with Priority: HIGHEST for action port [ 1444.169107] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock rules-33e8376b-4b98-4aa5-8325-ac1f9953095a taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1444.169279] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-33e8376b-4b98-4aa5-8325-ac1f9953095a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1444.169393] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-33e8376b-4b98-4aa5-8325-ac1f9953095a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1444.169717] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-33e8376b-4b98-4aa5-8325-ac1f9953095a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1444.169808] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('33e8376b-4b98-4aa5-8325-ac1f9953095a',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1444.171496] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-33e8376b-4b98-4aa5-8325-ac1f9953095a taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1444.171623] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-33e8376b-4b98-4aa5-8325-ac1f9953095a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1444.171837] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock port-b1f899f5-6268-4b68-83ab-8061f1c8abe3 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1444.171969] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b1f899f5-6268-4b68-83ab-8061f1c8abe3" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1444.172072] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b1f899f5-6268-4b68-83ab-8061f1c8abe3" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1444.172190] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b1f899f5-6268-4b68-83ab-8061f1c8abe3" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1444.172263] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b1f899f5-6268-4b68-83ab-8061f1c8abe3',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1444.203088] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1444.203347] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1444.203347] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1444.203489] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1444.203581] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1444.203675] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 33e8376b-4b98-4aa5-8325-ac1f9953095a is going to be updated. [ 1444.235330] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1444.235571] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1444.235646] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1444.235878] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1444.236043] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1444.244141] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 33e8376b-4b98-4aa5-8325-ac1f9953095a in Status: IN_PROGRESS for 2s [ 1444.673868] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-33e8376b-4b98-4aa5-8325-ac1f9953095a taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1444.673959] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-33e8376b-4b98-4aa5-8325-ac1f9953095a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1444.674187] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b1f899f5-6268-4b68-83ab-8061f1c8abe3 with status ACTIVE [ 1444.674295] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1444.674403] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1444.674471] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1444.674681] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1444.674786] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1444.674933] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1444.675041] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1444.675105] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1444.675256] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1444.675335] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1444.675515] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1444.675603] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1444.675661] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1444.675799] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1444.675876] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1444.675959] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b1f899f5-6268-4b68-83ab-8061f1c8abe3 is going to be updated. [ 1444.700484] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1444.700638] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1444.700892] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1444.700892] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1444.700992] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1444.701179] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b1f899f5-6268-4b68-83ab-8061f1c8abe3" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1446.252836] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 33e8376b-4b98-4aa5-8325-ac1f9953095a in Status: SUCCESS [ 1446.253242] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-33e8376b-4b98-4aa5-8325-ac1f9953095a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1446.253242] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-33e8376b-4b98-4aa5-8325-ac1f9953095a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1446.253412] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-33e8376b-4b98-4aa5-8325-ac1f9953095a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1446.253597] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1446.253707] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1446.253771] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1446.253930] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1446.254026] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1446.254119] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('33e8376b-4b98-4aa5-8325-ac1f9953095a',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1446.756069] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('33e8376b-4b98-4aa5-8325-ac1f9953095a',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1447.258794] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('33e8376b-4b98-4aa5-8325-ac1f9953095a',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1447.761466] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1447.761638] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1447.761713] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1447.761929] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1447.762037] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1447.762138] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 33e8376b-4b98-4aa5-8325-ac1f9953095a is going to be updated. [ 1447.791210] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1447.791346] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1447.791400] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1447.791598] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1447.791738] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1447.800138] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 33e8376b-4b98-4aa5-8325-ac1f9953095a in Status: IN_PROGRESS for 2s [ 1449.169371] env[69980]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1449.169748] env[69980]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=2 [ 1449.812659] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 33e8376b-4b98-4aa5-8325-ac1f9953095a in Status: SUCCESS [ 1449.812866] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-33e8376b-4b98-4aa5-8325-ac1f9953095a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1449.813052] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-33e8376b-4b98-4aa5-8325-ac1f9953095a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1449.813261] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-33e8376b-4b98-4aa5-8325-ac1f9953095a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1449.813444] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1449.813557] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1449.813617] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1449.813767] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1449.813862] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1449.813965] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-33e8376b-4b98-4aa5-8325-ac1f9953095a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1449.814071] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('33e8376b-4b98-4aa5-8325-ac1f9953095a',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1450.316259] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-33e8376b-4b98-4aa5-8325-ac1f9953095a taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1450.316720] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-33e8376b-4b98-4aa5-8325-ac1f9953095a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1450.316720] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-33e8376b-4b98-4aa5-8325-ac1f9953095a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1450.316720] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-33e8376b-4b98-4aa5-8325-ac1f9953095a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1450.316846] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1450.316955] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1450.317021] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1450.317185] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1450.317285] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1450.317374] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-33e8376b-4b98-4aa5-8325-ac1f9953095a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1450.317525] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-33e8376b-4b98-4aa5-8325-ac1f9953095a taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1450.317643] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-33e8376b-4b98-4aa5-8325-ac1f9953095a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1450.317740] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-33e8376b-4b98-4aa5-8325-ac1f9953095a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1450.317926] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-33e8376b-4b98-4aa5-8325-ac1f9953095a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1450.318097] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1450.318190] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1450.318245] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1450.318400] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1450.318473] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1450.318572] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-33e8376b-4b98-4aa5-8325-ac1f9953095a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1450.318661] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('33e8376b-4b98-4aa5-8325-ac1f9953095a',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1450.821017] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 33e8376b-4b98-4aa5-8325-ac1f9953095a: rpc.has_security_group_logging(os_id): False [ 1450.840686] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1450.840869] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1450.840948] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1450.841137] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1450.841231] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1450.841421] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1450.841521] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1450.841580] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1450.841731] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1450.841807] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1450.842016] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1450.842119] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1450.842202] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1450.842353] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1450.842430] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1450.842611] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1450.842705] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1450.842766] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1450.842900] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1450.842977] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1450.843074] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 33e8376b-4b98-4aa5-8325-ac1f9953095a is going to be updated. [ 1450.911030] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1450.911224] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1450.911298] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1450.911448] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1450.911589] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1450.931811] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 33e8376b-4b98-4aa5-8325-ac1f9953095a in Status: IN_PROGRESS for 2s [ 1452.945329] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 33e8376b-4b98-4aa5-8325-ac1f9953095a in Status: SUCCESS [ 1452.945727] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-33e8376b-4b98-4aa5-8325-ac1f9953095a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1453.833678] env[69980]: INFO networking_nsxv3.common.synchronization [req-e0768e61-3f81-4695-b0ed-d597c9448f87 req-853f41ae-5884-4d62-ad3f-2c259fae09ce tempest-ServersTestJSON-85857845 tempest-ServersTestJSON-85857845-project-member] Enqueued Resource ID: 33e8376b-4b98-4aa5-8325-ac1f9953095a with Priority: HIGHEST for action security_group_members [ 1453.834186] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 33e8376b-4b98-4aa5-8325-ac1f9953095a with Priority: HIGHEST for action security_group_members [ 1453.834497] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-33e8376b-4b98-4aa5-8325-ac1f9953095a taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1453.834617] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-33e8376b-4b98-4aa5-8325-ac1f9953095a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1453.834684] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-33e8376b-4b98-4aa5-8325-ac1f9953095a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1453.834883] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-33e8376b-4b98-4aa5-8325-ac1f9953095a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1453.835164] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1453.835164] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1453.835255] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1453.835344] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1453.835481] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1453.835550] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('33e8376b-4b98-4aa5-8325-ac1f9953095a',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1454.337898] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('33e8376b-4b98-4aa5-8325-ac1f9953095a',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1454.840380] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('33e8376b-4b98-4aa5-8325-ac1f9953095a',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1455.342551] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1455.342825] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1455.342825] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1455.343015] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1455.343135] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1455.343278] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 33e8376b-4b98-4aa5-8325-ac1f9953095a is going to be updated. [ 1455.372645] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1455.372777] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1455.372847] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1455.373059] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1455.373205] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1455.381097] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 33e8376b-4b98-4aa5-8325-ac1f9953095a in Status: IN_PROGRESS for 2s [ 1457.391582] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 33e8376b-4b98-4aa5-8325-ac1f9953095a in Status: SUCCESS [ 1457.391864] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-33e8376b-4b98-4aa5-8325-ac1f9953095a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1458.835570] env[69980]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1458.835882] env[69980]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1461.076419] env[69980]: INFO networking_nsxv3.common.synchronization [req-2c585d89-2bbb-4fcc-9576-3d19975ac237 req-2a81a4d2-4eab-4096-9216-26fcdadd02e4 tempest-AttachVolumeShelveTestJSON-1941643989 tempest-AttachVolumeShelveTestJSON-1941643989-project-member] Enqueued Resource ID: 23fa8e46-c46e-429c-b533-b6ee73936de0 with Priority: HIGHEST for action security_group_members [ 1461.076976] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 23fa8e46-c46e-429c-b533-b6ee73936de0 with Priority: HIGHEST for action security_group_members [ 1461.077590] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-23fa8e46-c46e-429c-b533-b6ee73936de0 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1461.077590] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-23fa8e46-c46e-429c-b533-b6ee73936de0" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1461.077590] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-23fa8e46-c46e-429c-b533-b6ee73936de0" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1461.077762] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-23fa8e46-c46e-429c-b533-b6ee73936de0" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1461.078258] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1461.078258] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1461.078258] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1461.078258] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1461.078258] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1461.078554] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('23fa8e46-c46e-429c-b533-b6ee73936de0',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1461.580889] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1461.581085] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1461.581165] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1461.581506] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1461.581506] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1461.581688] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1461.581782] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1461.581843] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1461.582010] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1461.582134] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1461.582180] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 23fa8e46-c46e-429c-b533-b6ee73936de0 is going to be updated. [ 1461.624939] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1461.625110] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1461.625186] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1461.625376] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1461.625512] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1461.634605] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 23fa8e46-c46e-429c-b533-b6ee73936de0 in Status: IN_PROGRESS for 2s [ 1462.918320] env[69980]: INFO networking_nsxv3.common.synchronization [req-28acf168-8609-4b2c-9b7b-76056f2a14e7 req-01ab8d8d-7a9f-449f-b4f6-4d1ebb4aef57 tempest-ServersTestJSON-85857845 tempest-ServersTestJSON-85857845-project-member] Enqueued Resource ID: 33e8376b-4b98-4aa5-8325-ac1f9953095a with Priority: HIGHEST for action security_group_members [ 1462.918859] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 33e8376b-4b98-4aa5-8325-ac1f9953095a with Priority: HIGHEST for action security_group_members [ 1462.919188] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-33e8376b-4b98-4aa5-8325-ac1f9953095a taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1462.919310] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-33e8376b-4b98-4aa5-8325-ac1f9953095a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1462.919374] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-33e8376b-4b98-4aa5-8325-ac1f9953095a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1462.919575] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-33e8376b-4b98-4aa5-8325-ac1f9953095a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1462.919728] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1462.919824] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1462.919884] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1462.920122] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1462.920211] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1462.920305] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('33e8376b-4b98-4aa5-8325-ac1f9953095a',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1463.193472] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock network-14 taken with stack trace [, , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1463.193677] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "network-14" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1463.193804] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "network-14" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1463.194090] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "network-14" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1463.194360] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1463.194521] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1463.194640] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1463.194857] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1463.195010] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1463.195231] env[69980]: DEBUG dogpile.cache.region [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] No value present for key: 'zone-id' {{(pid=69980) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1463.195407] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] NeedRegenerationException {{(pid=69980) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1463.195535] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] no value, waiting for create lock {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1463.195649] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] value creation lock acquired {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1463.195778] env[69980]: DEBUG dogpile.cache.region [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] No value present for key: 'zone-id' {{(pid=69980) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1463.195887] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Calling creation function for not-yet-present value {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1463.196031] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1463.214612] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1463.214753] env[69980]: DEBUG dogpile.cache.region [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=69980) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1463.214889] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Released creation lock {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1463.215101] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "network-14" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1463.215339] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock port-d27f4b7b-5c5d-4af4-83e9-57b6ee4e7f50 taken with stack trace [, , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1463.215543] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "port-d27f4b7b-5c5d-4af4-83e9-57b6ee4e7f50" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1463.215609] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "port-d27f4b7b-5c5d-4af4-83e9-57b6ee4e7f50" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1463.215890] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "port-d27f4b7b-5c5d-4af4-83e9-57b6ee4e7f50" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1463.216040] env[69980]: DEBUG networking_nsxv3.api.rpc [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d27f4b7b-5c5d-4af4-83e9-57b6ee4e7f50',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1463.422879] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('33e8376b-4b98-4aa5-8325-ac1f9953095a',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1463.643973] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 23fa8e46-c46e-429c-b533-b6ee73936de0 in Status: IN_PROGRESS for 4s [ 1463.718696] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1463.718969] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1463.719136] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1463.719428] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1463.719583] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1463.719742] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Segment Port d27f4b7b-5c5d-4af4-83e9-57b6ee4e7f50 not found, creating... [ 1463.720042] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1463.720221] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1463.720349] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1463.720572] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1463.720712] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1463.721017] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1463.721197] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1463.721319] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1463.721526] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1463.721665] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1463.721805] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Resource: SegmentPort with ID: d27f4b7b-5c5d-4af4-83e9-57b6ee4e7f50 is going to be created. [ 1463.740124] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1463.740393] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1463.740542] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1463.740775] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1463.741008] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1463.741237] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "port-d27f4b7b-5c5d-4af4-83e9-57b6ee4e7f50" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1463.925297] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('33e8376b-4b98-4aa5-8325-ac1f9953095a',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1464.400362] env[69980]: INFO networking_nsxv3.common.synchronization [req-28acf168-8609-4b2c-9b7b-76056f2a14e7 req-c4a1b2da-a457-4ed3-b055-f337f46fd98c service nova] Enqueued Resource ID: 33e8376b-4b98-4aa5-8325-ac1f9953095a with Priority: HIGHEST for action security_group_rules [ 1464.400646] env[69980]: INFO networking_nsxv3.common.synchronization [req-28acf168-8609-4b2c-9b7b-76056f2a14e7 req-c4a1b2da-a457-4ed3-b055-f337f46fd98c service nova] Enqueued Resource ID: 33e8376b-4b98-4aa5-8325-ac1f9953095a with Priority: HIGHEST for action security_group_members [ 1464.400791] env[69980]: INFO networking_nsxv3.common.synchronization [req-28acf168-8609-4b2c-9b7b-76056f2a14e7 req-c4a1b2da-a457-4ed3-b055-f337f46fd98c service nova] Enqueued Resource ID: d27f4b7b-5c5d-4af4-83e9-57b6ee4e7f50 with Priority: HIGHEST for action port [ 1464.400901] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 33e8376b-4b98-4aa5-8325-ac1f9953095a with Priority: HIGHEST for action security_group_rules [ 1464.401236] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 33e8376b-4b98-4aa5-8325-ac1f9953095a with Priority: HIGHEST for action security_group_members [ 1464.401236] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d27f4b7b-5c5d-4af4-83e9-57b6ee4e7f50 with Priority: HIGHEST for action port [ 1464.401702] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock rules-33e8376b-4b98-4aa5-8325-ac1f9953095a taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1464.401928] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-33e8376b-4b98-4aa5-8325-ac1f9953095a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1464.401928] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-33e8376b-4b98-4aa5-8325-ac1f9953095a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1464.402114] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-33e8376b-4b98-4aa5-8325-ac1f9953095a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1464.402262] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('33e8376b-4b98-4aa5-8325-ac1f9953095a',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1464.403049] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-33e8376b-4b98-4aa5-8325-ac1f9953095a taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1464.403134] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-33e8376b-4b98-4aa5-8325-ac1f9953095a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1464.403335] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock port-d27f4b7b-5c5d-4af4-83e9-57b6ee4e7f50 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1464.403427] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d27f4b7b-5c5d-4af4-83e9-57b6ee4e7f50" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1464.403474] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d27f4b7b-5c5d-4af4-83e9-57b6ee4e7f50" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1464.403649] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d27f4b7b-5c5d-4af4-83e9-57b6ee4e7f50" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1464.403780] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d27f4b7b-5c5d-4af4-83e9-57b6ee4e7f50',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1464.427532] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1464.427709] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1464.427709] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1464.427921] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1464.428031] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1464.428132] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 33e8376b-4b98-4aa5-8325-ac1f9953095a is going to be updated. [ 1464.455822] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1464.455993] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1464.456058] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1464.456204] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1464.456342] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1464.465476] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 33e8376b-4b98-4aa5-8325-ac1f9953095a in Status: IN_PROGRESS for 2s [ 1464.905584] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-33e8376b-4b98-4aa5-8325-ac1f9953095a taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1464.905730] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-33e8376b-4b98-4aa5-8325-ac1f9953095a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1464.905931] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d27f4b7b-5c5d-4af4-83e9-57b6ee4e7f50 with status ACTIVE [ 1464.906127] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1464.906239] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1464.906305] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1464.906521] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1464.906605] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1464.906771] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1464.906885] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1464.907053] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1464.907145] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1464.907227] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1464.907409] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1464.907500] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1464.907557] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1464.907698] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1464.907772] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1464.907855] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d27f4b7b-5c5d-4af4-83e9-57b6ee4e7f50 is going to be updated. [ 1464.927336] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1464.927672] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1464.927672] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1464.927672] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1464.927829] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1464.927947] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d27f4b7b-5c5d-4af4-83e9-57b6ee4e7f50" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1465.652669] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 23fa8e46-c46e-429c-b533-b6ee73936de0 in Status: SUCCESS [ 1465.652850] env[69980]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 23fa8e46-c46e-429c-b533-b6ee73936de0 deletion is rescheduled due to dependency. [ 1465.652972] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-23fa8e46-c46e-429c-b533-b6ee73936de0" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1466.482622] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 33e8376b-4b98-4aa5-8325-ac1f9953095a in Status: SUCCESS [ 1466.483106] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-33e8376b-4b98-4aa5-8325-ac1f9953095a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1466.483106] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-33e8376b-4b98-4aa5-8325-ac1f9953095a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1466.483206] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-33e8376b-4b98-4aa5-8325-ac1f9953095a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1466.483348] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1466.483463] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1466.483530] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1466.483689] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1466.483771] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1466.483865] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('33e8376b-4b98-4aa5-8325-ac1f9953095a',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1466.986465] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('33e8376b-4b98-4aa5-8325-ac1f9953095a',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1467.488822] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('33e8376b-4b98-4aa5-8325-ac1f9953095a',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1467.991340] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1467.991513] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1467.991513] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1467.991742] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1467.991837] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1467.991941] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 33e8376b-4b98-4aa5-8325-ac1f9953095a is going to be updated. [ 1468.017329] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1468.017477] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1468.017542] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1468.017745] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1468.017893] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1468.025585] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 33e8376b-4b98-4aa5-8325-ac1f9953095a in Status: IN_PROGRESS for 2s [ 1469.403686] env[69980]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1469.404078] env[69980]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=2 [ 1470.034911] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 33e8376b-4b98-4aa5-8325-ac1f9953095a in Status: SUCCESS [ 1470.035148] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-33e8376b-4b98-4aa5-8325-ac1f9953095a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1470.035314] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-33e8376b-4b98-4aa5-8325-ac1f9953095a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1470.035520] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-33e8376b-4b98-4aa5-8325-ac1f9953095a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1470.035706] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1470.035831] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1470.035896] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1470.036055] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1470.036164] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1470.036221] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-33e8376b-4b98-4aa5-8325-ac1f9953095a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1470.036311] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('33e8376b-4b98-4aa5-8325-ac1f9953095a',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1470.538747] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-33e8376b-4b98-4aa5-8325-ac1f9953095a taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1470.539132] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-33e8376b-4b98-4aa5-8325-ac1f9953095a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1470.539132] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-33e8376b-4b98-4aa5-8325-ac1f9953095a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1470.539234] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-33e8376b-4b98-4aa5-8325-ac1f9953095a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1470.539412] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1470.539520] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1470.539587] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1470.539740] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1470.539827] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1470.539915] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-33e8376b-4b98-4aa5-8325-ac1f9953095a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1470.540112] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-33e8376b-4b98-4aa5-8325-ac1f9953095a taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1470.540213] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-33e8376b-4b98-4aa5-8325-ac1f9953095a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1470.540266] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-33e8376b-4b98-4aa5-8325-ac1f9953095a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1470.540410] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-33e8376b-4b98-4aa5-8325-ac1f9953095a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1470.540546] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1470.540634] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1470.540693] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1470.540828] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1470.540905] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1470.540986] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-33e8376b-4b98-4aa5-8325-ac1f9953095a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1470.541119] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('33e8376b-4b98-4aa5-8325-ac1f9953095a',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1471.044030] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 33e8376b-4b98-4aa5-8325-ac1f9953095a: rpc.has_security_group_logging(os_id): False [ 1471.061462] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1471.061462] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1471.061462] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1471.061462] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1471.061781] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1471.061781] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1471.061869] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1471.061904] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1471.062076] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1471.062144] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1471.062333] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1471.062525] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1471.062525] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1471.062639] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1471.062690] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1471.062853] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1471.062942] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1471.062996] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1471.063188] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1471.063263] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1471.063345] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 33e8376b-4b98-4aa5-8325-ac1f9953095a is going to be updated. [ 1471.115770] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1471.115967] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1471.115967] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1471.116202] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1471.116350] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1471.127502] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 33e8376b-4b98-4aa5-8325-ac1f9953095a in Status: IN_PROGRESS for 2s [ 1473.141554] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 33e8376b-4b98-4aa5-8325-ac1f9953095a in Status: SUCCESS [ 1473.142019] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-33e8376b-4b98-4aa5-8325-ac1f9953095a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1473.776523] env[69980]: INFO networking_nsxv3.common.synchronization [None req-434ec930-afa6-4063-87c4-bf151a4a00c9 None None] Enqueued Resource ID: 6cc10a7e-355a-4760-98cf-bc46d07a7ee4 with Priority: HIGHEST for action port [ 1473.776926] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6cc10a7e-355a-4760-98cf-bc46d07a7ee4 with Priority: HIGHEST for action port [ 1473.777388] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock port-6cc10a7e-355a-4760-98cf-bc46d07a7ee4 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1473.777525] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6cc10a7e-355a-4760-98cf-bc46d07a7ee4" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1473.777607] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6cc10a7e-355a-4760-98cf-bc46d07a7ee4" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1473.777849] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6cc10a7e-355a-4760-98cf-bc46d07a7ee4" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1473.777931] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6cc10a7e-355a-4760-98cf-bc46d07a7ee4',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1474.113129] env[69980]: INFO networking_nsxv3.common.synchronization [None req-68bf3c1e-e55d-442b-93a0-45f3c1d66e09 tempest-AttachVolumeNegativeTest-1885261294 tempest-AttachVolumeNegativeTest-1885261294-project-member] Enqueued Resource ID: 1629967c-76d1-4b7e-a365-0305af6dc147 with Priority: HIGHEST for action security_group_rules [ 1474.113712] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1629967c-76d1-4b7e-a365-0305af6dc147 with Priority: HIGHEST for action security_group_rules [ 1474.113955] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1629967c-76d1-4b7e-a365-0305af6dc147 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1474.114093] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1629967c-76d1-4b7e-a365-0305af6dc147" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1474.114155] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1629967c-76d1-4b7e-a365-0305af6dc147" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1474.114410] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1629967c-76d1-4b7e-a365-0305af6dc147" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1474.114492] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1629967c-76d1-4b7e-a365-0305af6dc147',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1474.117152] env[69980]: INFO networking_nsxv3.common.synchronization [req-cb17d1b1-e9be-4123-9987-89d727bc8d84 req-34818dd4-9773-413a-b995-528c7946b8c5 tempest-ServersTestJSON-85857845 tempest-ServersTestJSON-85857845-project-member] Enqueued Resource ID: 33e8376b-4b98-4aa5-8325-ac1f9953095a with Priority: HIGHEST for action security_group_members [ 1474.117362] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 33e8376b-4b98-4aa5-8325-ac1f9953095a with Priority: HIGHEST for action security_group_members [ 1474.118688] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-33e8376b-4b98-4aa5-8325-ac1f9953095a taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1474.118688] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-33e8376b-4b98-4aa5-8325-ac1f9953095a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1474.118688] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-33e8376b-4b98-4aa5-8325-ac1f9953095a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1474.118688] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-33e8376b-4b98-4aa5-8325-ac1f9953095a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1474.118688] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1474.118688] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1474.118688] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1474.118688] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1474.118688] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1474.118688] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('33e8376b-4b98-4aa5-8325-ac1f9953095a',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1474.217523] env[69980]: INFO networking_nsxv3.common.synchronization [None req-a65547e2-2cbe-457e-b3c4-fbda760fac09 tempest-AttachVolumeNegativeTest-1885261294 tempest-AttachVolumeNegativeTest-1885261294-project-member] Enqueued Resource ID: 1629967c-76d1-4b7e-a365-0305af6dc147 with Priority: HIGHEST for action security_group_rules [ 1474.217899] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1629967c-76d1-4b7e-a365-0305af6dc147 with Priority: HIGHEST for action security_group_rules [ 1474.218321] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1629967c-76d1-4b7e-a365-0305af6dc147 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1474.218430] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1629967c-76d1-4b7e-a365-0305af6dc147" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1474.281380] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 6cc10a7e-355a-4760-98cf-bc46d07a7ee4 [ 1474.281380] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1474.281380] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1474.281380] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1474.281380] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1474.281380] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1474.281380] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:6cc10a7e-355a-4760-98cf-bc46d07a7ee4 already deleted. [ 1474.281380] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6cc10a7e-355a-4760-98cf-bc46d07a7ee4" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1474.624025] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('33e8376b-4b98-4aa5-8325-ac1f9953095a',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1474.634572] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1474.634572] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1474.634572] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1474.634572] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1474.634572] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1474.634572] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1629967c-76d1-4b7e-a365-0305af6dc147 already deleted. [ 1474.635209] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1629967c-76d1-4b7e-a365-0305af6dc147" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1474.635753] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1629967c-76d1-4b7e-a365-0305af6dc147" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1474.636077] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1629967c-76d1-4b7e-a365-0305af6dc147" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1474.636297] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1629967c-76d1-4b7e-a365-0305af6dc147',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1475.125938] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('33e8376b-4b98-4aa5-8325-ac1f9953095a',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1475.155793] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1475.156877] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1475.156877] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1475.156877] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1475.156877] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1475.157130] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1629967c-76d1-4b7e-a365-0305af6dc147 already deleted. [ 1475.157130] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1629967c-76d1-4b7e-a365-0305af6dc147" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1475.629157] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1475.629157] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1475.629157] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1475.629157] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1475.629157] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1475.629157] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 33e8376b-4b98-4aa5-8325-ac1f9953095a is going to be updated. [ 1475.658326] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1475.658326] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1475.658326] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1475.658512] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1475.658600] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1475.661481] env[69980]: INFO networking_nsxv3.common.synchronization [None req-f1f150f2-c94b-4374-be11-05c0df7b1daa None None] Enqueued Resource ID: ce534175-fe81-4bb9-b4ce-3b6ec97d8e40 with Priority: HIGHEST for action port [ 1475.662422] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ce534175-fe81-4bb9-b4ce-3b6ec97d8e40 with Priority: HIGHEST for action port [ 1475.662666] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock port-ce534175-fe81-4bb9-b4ce-3b6ec97d8e40 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1475.662778] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ce534175-fe81-4bb9-b4ce-3b6ec97d8e40" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1475.662851] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ce534175-fe81-4bb9-b4ce-3b6ec97d8e40" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1475.663339] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ce534175-fe81-4bb9-b4ce-3b6ec97d8e40" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1475.663339] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ce534175-fe81-4bb9-b4ce-3b6ec97d8e40',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1475.667245] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 33e8376b-4b98-4aa5-8325-ac1f9953095a in Status: IN_PROGRESS for 2s [ 1476.164967] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ce534175-fe81-4bb9-b4ce-3b6ec97d8e40 [ 1476.165230] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1476.165453] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1476.165453] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1476.165714] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1476.165753] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1476.165855] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ce534175-fe81-4bb9-b4ce-3b6ec97d8e40 already deleted. [ 1476.165913] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ce534175-fe81-4bb9-b4ce-3b6ec97d8e40" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1477.676486] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 33e8376b-4b98-4aa5-8325-ac1f9953095a in Status: SUCCESS [ 1477.676859] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-33e8376b-4b98-4aa5-8325-ac1f9953095a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1480.222398] env[69980]: INFO networking_nsxv3.common.synchronization [req-689caa48-9b73-45ee-8f89-f185372244f3 req-fd539a1a-f80c-4a14-8dc8-e1706909dd7a tempest-AttachVolumeNegativeTest-1885261294 tempest-AttachVolumeNegativeTest-1885261294-project-member] Enqueued Resource ID: 1629967c-76d1-4b7e-a365-0305af6dc147 with Priority: HIGHEST for action security_group_members [ 1480.222868] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1629967c-76d1-4b7e-a365-0305af6dc147 with Priority: HIGHEST for action security_group_members [ 1480.223197] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-1629967c-76d1-4b7e-a365-0305af6dc147 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1480.223310] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1629967c-76d1-4b7e-a365-0305af6dc147" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1480.223380] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1629967c-76d1-4b7e-a365-0305af6dc147" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1480.223608] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1629967c-76d1-4b7e-a365-0305af6dc147" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1480.223764] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1480.223857] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1480.223918] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1480.226515] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1480.226703] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1480.227300] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1629967c-76d1-4b7e-a365-0305af6dc147',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1480.508986] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock network-820 taken with stack trace [, , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1480.509275] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "network-820" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1480.509411] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "network-820" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1480.509734] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "network-820" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1480.510014] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1480.510201] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1480.510329] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1480.510553] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1480.510699] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1480.510906] env[69980]: DEBUG dogpile.cache.region [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] No value present for key: 'zone-id' {{(pid=69980) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1480.511110] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] NeedRegenerationException {{(pid=69980) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1480.511346] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] no value, waiting for create lock {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1480.511599] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] value creation lock acquired {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1480.511760] env[69980]: DEBUG dogpile.cache.region [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] No value present for key: 'zone-id' {{(pid=69980) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1480.511899] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Calling creation function for not-yet-present value {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1480.512148] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1480.529860] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1480.530043] env[69980]: DEBUG dogpile.cache.region [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=69980) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1480.530202] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Released creation lock {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1480.530388] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "network-820" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1480.530685] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock port-c2ff2608-1080-4b52-b642-74d4c3896788 taken with stack trace [, , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1480.531626] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "port-c2ff2608-1080-4b52-b642-74d4c3896788" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1480.531626] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "port-c2ff2608-1080-4b52-b642-74d4c3896788" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1480.531626] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "port-c2ff2608-1080-4b52-b642-74d4c3896788" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1480.531626] env[69980]: DEBUG networking_nsxv3.api.rpc [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c2ff2608-1080-4b52-b642-74d4c3896788',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1480.729453] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1480.729677] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1480.729677] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1480.729853] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1480.729941] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1480.730204] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1480.730453] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1480.730571] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1480.730790] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1480.730919] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1480.731070] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1629967c-76d1-4b7e-a365-0305af6dc147 already deleted. [ 1480.731217] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1629967c-76d1-4b7e-a365-0305af6dc147" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1481.034232] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1481.034232] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1481.034232] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1481.034232] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1481.034232] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1481.034574] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Segment Port c2ff2608-1080-4b52-b642-74d4c3896788 not found, creating... [ 1481.034574] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1481.034683] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1481.034808] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1481.035053] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1481.035198] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1481.035479] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1481.035639] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1481.035758] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1481.035968] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1481.036119] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1481.036259] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Resource: SegmentPort with ID: c2ff2608-1080-4b52-b642-74d4c3896788 is going to be created. [ 1481.055466] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1481.055655] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1481.055782] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1481.056346] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1481.056675] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1481.056926] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "port-c2ff2608-1080-4b52-b642-74d4c3896788" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1481.751716] env[69980]: INFO networking_nsxv3.common.synchronization [req-689caa48-9b73-45ee-8f89-f185372244f3 req-a0ed8af9-ac00-427a-b5aa-3e890358afcd service nova] Enqueued Resource ID: 1629967c-76d1-4b7e-a365-0305af6dc147 with Priority: HIGHEST for action security_group_rules [ 1481.751995] env[69980]: INFO networking_nsxv3.common.synchronization [req-689caa48-9b73-45ee-8f89-f185372244f3 req-a0ed8af9-ac00-427a-b5aa-3e890358afcd service nova] Enqueued Resource ID: 1629967c-76d1-4b7e-a365-0305af6dc147 with Priority: HIGHEST for action security_group_members [ 1481.751995] env[69980]: INFO networking_nsxv3.common.synchronization [req-689caa48-9b73-45ee-8f89-f185372244f3 req-a0ed8af9-ac00-427a-b5aa-3e890358afcd service nova] Enqueued Resource ID: c2ff2608-1080-4b52-b642-74d4c3896788 with Priority: HIGHEST for action port [ 1481.752263] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1629967c-76d1-4b7e-a365-0305af6dc147 with Priority: HIGHEST for action security_group_rules [ 1481.752407] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1629967c-76d1-4b7e-a365-0305af6dc147 with Priority: HIGHEST for action security_group_members [ 1481.752506] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c2ff2608-1080-4b52-b642-74d4c3896788 with Priority: HIGHEST for action port [ 1481.753434] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1629967c-76d1-4b7e-a365-0305af6dc147 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1481.753627] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1629967c-76d1-4b7e-a365-0305af6dc147" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1481.753700] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1629967c-76d1-4b7e-a365-0305af6dc147" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1481.753931] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1629967c-76d1-4b7e-a365-0305af6dc147" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1481.754069] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1629967c-76d1-4b7e-a365-0305af6dc147',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1481.756040] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-1629967c-76d1-4b7e-a365-0305af6dc147 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1481.756040] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1629967c-76d1-4b7e-a365-0305af6dc147" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1481.756040] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1629967c-76d1-4b7e-a365-0305af6dc147" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1481.756316] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1629967c-76d1-4b7e-a365-0305af6dc147" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1481.756400] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1481.756574] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1481.756695] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1481.756905] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1481.757042] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1481.757178] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1629967c-76d1-4b7e-a365-0305af6dc147',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1481.758483] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock port-c2ff2608-1080-4b52-b642-74d4c3896788 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1481.759423] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c2ff2608-1080-4b52-b642-74d4c3896788" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1481.759423] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c2ff2608-1080-4b52-b642-74d4c3896788" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1481.759423] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c2ff2608-1080-4b52-b642-74d4c3896788" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1481.759423] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c2ff2608-1080-4b52-b642-74d4c3896788',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1482.260541] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1629967c-76d1-4b7e-a365-0305af6dc147',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1482.261655] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-1629967c-76d1-4b7e-a365-0305af6dc147 taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1482.261764] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1629967c-76d1-4b7e-a365-0305af6dc147" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1482.261989] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c2ff2608-1080-4b52-b642-74d4c3896788 with status ACTIVE [ 1482.262210] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1482.262332] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1482.262410] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1482.262594] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1482.262679] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1482.262848] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1482.262944] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1482.263012] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1482.263171] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1482.263247] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1482.263426] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1482.263519] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1482.263572] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1482.263706] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1482.263777] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1482.263859] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c2ff2608-1080-4b52-b642-74d4c3896788 is going to be updated. [ 1482.285578] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1482.285779] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1482.285779] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1482.286078] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1482.286268] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1482.286466] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c2ff2608-1080-4b52-b642-74d4c3896788" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1482.765626] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1629967c-76d1-4b7e-a365-0305af6dc147',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1483.163782] env[69980]: INFO networking_nsxv3.common.synchronization [req-613e72a3-d5ac-46de-8a8c-a297edba9a57 req-6d9082e7-76cc-4c69-858b-8f32a5134e15 tempest-ServersTestJSON-85857845 tempest-ServersTestJSON-85857845-project-member] Enqueued Resource ID: 33e8376b-4b98-4aa5-8325-ac1f9953095a with Priority: HIGHEST for action security_group_members [ 1483.164308] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 33e8376b-4b98-4aa5-8325-ac1f9953095a with Priority: HIGHEST for action security_group_members [ 1483.164601] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-33e8376b-4b98-4aa5-8325-ac1f9953095a taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1483.164726] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-33e8376b-4b98-4aa5-8325-ac1f9953095a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1483.164792] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-33e8376b-4b98-4aa5-8325-ac1f9953095a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1483.164979] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-33e8376b-4b98-4aa5-8325-ac1f9953095a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1483.165143] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1483.165239] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1483.165357] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1483.165436] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1483.165519] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1483.165610] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('33e8376b-4b98-4aa5-8325-ac1f9953095a',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1483.268164] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1483.268322] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1483.268418] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1483.268592] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1483.268681] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1483.268778] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1629967c-76d1-4b7e-a365-0305af6dc147 is going to be created. [ 1483.290504] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1483.290764] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1483.290764] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1483.290911] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1483.290974] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1483.299285] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1629967c-76d1-4b7e-a365-0305af6dc147 in Status: UNINITIALIZED for 2s [ 1483.430935] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock network-14 taken with stack trace [, , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1483.431263] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "network-14" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1483.431608] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "network-14" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1483.432015] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "network-14" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1483.432482] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1483.432770] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1483.432997] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1483.433389] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1483.433666] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1483.434029] env[69980]: DEBUG dogpile.cache.region [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] No value present for key: 'zone-id' {{(pid=69980) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1483.434177] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] NeedRegenerationException {{(pid=69980) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1483.434341] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] no value, waiting for create lock {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1483.434483] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] value creation lock acquired {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1483.434609] env[69980]: DEBUG dogpile.cache.region [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] No value present for key: 'zone-id' {{(pid=69980) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1483.434768] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Calling creation function for not-yet-present value {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1483.434910] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1483.452693] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1483.452852] env[69980]: DEBUG dogpile.cache.region [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=69980) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1483.453089] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Released creation lock {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1483.453303] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "network-14" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1483.453632] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock port-51c526b8-3070-4dff-807a-39425ed41482 taken with stack trace [, , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1483.453885] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "port-51c526b8-3070-4dff-807a-39425ed41482" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1483.454010] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "port-51c526b8-3070-4dff-807a-39425ed41482" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1483.454339] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "port-51c526b8-3070-4dff-807a-39425ed41482" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1483.454485] env[69980]: DEBUG networking_nsxv3.api.rpc [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('51c526b8-3070-4dff-807a-39425ed41482',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1483.668035] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('33e8376b-4b98-4aa5-8325-ac1f9953095a',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1483.956722] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1483.957055] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1483.957111] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1483.957381] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1483.957545] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1483.957701] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Segment Port 51c526b8-3070-4dff-807a-39425ed41482 not found, creating... [ 1483.957961] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1483.958138] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1483.958268] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1483.958483] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1483.958624] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1483.958904] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1483.959075] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1483.959195] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1483.959402] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1483.959539] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1483.959778] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Resource: SegmentPort with ID: 51c526b8-3070-4dff-807a-39425ed41482 is going to be created. [ 1483.979014] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1483.979308] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1483.979400] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1483.979658] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1483.980013] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1483.980113] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "port-51c526b8-3070-4dff-807a-39425ed41482" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1484.174219] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('33e8376b-4b98-4aa5-8325-ac1f9953095a',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1484.643909] env[69980]: INFO networking_nsxv3.common.synchronization [req-613e72a3-d5ac-46de-8a8c-a297edba9a57 req-b24f2f70-9d4d-4834-9267-6cde5958e56e service nova] Enqueued Resource ID: 33e8376b-4b98-4aa5-8325-ac1f9953095a with Priority: HIGHEST for action security_group_rules [ 1484.644141] env[69980]: INFO networking_nsxv3.common.synchronization [req-613e72a3-d5ac-46de-8a8c-a297edba9a57 req-b24f2f70-9d4d-4834-9267-6cde5958e56e service nova] Enqueued Resource ID: 33e8376b-4b98-4aa5-8325-ac1f9953095a with Priority: HIGHEST for action security_group_members [ 1484.644259] env[69980]: INFO networking_nsxv3.common.synchronization [req-613e72a3-d5ac-46de-8a8c-a297edba9a57 req-b24f2f70-9d4d-4834-9267-6cde5958e56e service nova] Enqueued Resource ID: 51c526b8-3070-4dff-807a-39425ed41482 with Priority: HIGHEST for action port [ 1484.644493] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 33e8376b-4b98-4aa5-8325-ac1f9953095a with Priority: HIGHEST for action security_group_rules [ 1484.644622] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 33e8376b-4b98-4aa5-8325-ac1f9953095a with Priority: HIGHEST for action security_group_members [ 1484.644729] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 51c526b8-3070-4dff-807a-39425ed41482 with Priority: HIGHEST for action port [ 1484.645300] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock rules-33e8376b-4b98-4aa5-8325-ac1f9953095a taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1484.645429] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-33e8376b-4b98-4aa5-8325-ac1f9953095a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1484.645499] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-33e8376b-4b98-4aa5-8325-ac1f9953095a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1484.645700] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-33e8376b-4b98-4aa5-8325-ac1f9953095a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1484.645804] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('33e8376b-4b98-4aa5-8325-ac1f9953095a',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1484.650019] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-33e8376b-4b98-4aa5-8325-ac1f9953095a taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1484.650019] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-33e8376b-4b98-4aa5-8325-ac1f9953095a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1484.650019] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock port-51c526b8-3070-4dff-807a-39425ed41482 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1484.650019] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-51c526b8-3070-4dff-807a-39425ed41482" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1484.650019] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-51c526b8-3070-4dff-807a-39425ed41482" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1484.650019] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-51c526b8-3070-4dff-807a-39425ed41482" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1484.650019] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('51c526b8-3070-4dff-807a-39425ed41482',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1484.676188] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1484.676364] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1484.676415] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1484.676626] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1484.676725] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1484.676820] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 33e8376b-4b98-4aa5-8325-ac1f9953095a is going to be updated. [ 1484.702795] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1484.702973] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1484.703039] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1484.703194] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1484.703340] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1484.712056] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 33e8376b-4b98-4aa5-8325-ac1f9953095a in Status: IN_PROGRESS for 2s [ 1484.816831] env[69980]: INFO networking_nsxv3.common.synchronization [req-a78e695d-3c6c-425b-8fa3-de148c54458f req-84e077c7-5795-45ef-a4b2-5a3fb59e0780 tempest-ServerActionsTestJSON-1479580870 tempest-ServerActionsTestJSON-1479580870-project-member] Enqueued Resource ID: 00f20236-2b69-46dc-a00f-0c4d6b93c17a with Priority: HIGHEST for action security_group_members [ 1484.817365] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 00f20236-2b69-46dc-a00f-0c4d6b93c17a with Priority: HIGHEST for action security_group_members [ 1484.817678] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-00f20236-2b69-46dc-a00f-0c4d6b93c17a taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1484.817803] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-00f20236-2b69-46dc-a00f-0c4d6b93c17a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1484.817872] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-00f20236-2b69-46dc-a00f-0c4d6b93c17a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1484.818096] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-00f20236-2b69-46dc-a00f-0c4d6b93c17a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1484.818257] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1484.818357] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1484.818416] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1484.818567] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1484.818655] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1484.818746] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('00f20236-2b69-46dc-a00f-0c4d6b93c17a',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1485.149540] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-33e8376b-4b98-4aa5-8325-ac1f9953095a taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1485.149869] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-33e8376b-4b98-4aa5-8325-ac1f9953095a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1485.149869] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 51c526b8-3070-4dff-807a-39425ed41482 with status ACTIVE [ 1485.149980] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1485.149980] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1485.150083] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1485.150345] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1485.150460] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1485.150627] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1485.150703] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1485.150755] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1485.150909] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1485.150984] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1485.151185] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1485.151293] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1485.151360] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1485.151498] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1485.151573] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1485.151783] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 51c526b8-3070-4dff-807a-39425ed41482 is going to be updated. [ 1485.171583] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1485.171583] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1485.171583] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1485.171583] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1485.171583] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1485.171860] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-51c526b8-3070-4dff-807a-39425ed41482" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1485.312358] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1629967c-76d1-4b7e-a365-0305af6dc147 in Status: SUCCESS [ 1485.312547] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1629967c-76d1-4b7e-a365-0305af6dc147" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1485.312697] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1629967c-76d1-4b7e-a365-0305af6dc147" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1485.312903] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1629967c-76d1-4b7e-a365-0305af6dc147" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1485.313108] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1485.313221] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1485.313285] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1485.313442] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1485.313523] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1485.313610] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1629967c-76d1-4b7e-a365-0305af6dc147" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1485.313701] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1629967c-76d1-4b7e-a365-0305af6dc147',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1485.320194] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1485.320346] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1485.320414] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1485.320574] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1485.320658] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1485.320832] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1485.320928] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1485.320990] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1485.321143] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1485.321291] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1485.321369] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 00f20236-2b69-46dc-a00f-0c4d6b93c17a is going to be updated. [ 1485.349570] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1485.349680] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1485.350359] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1485.350925] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1485.350925] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1485.358155] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 00f20236-2b69-46dc-a00f-0c4d6b93c17a in Status: IN_PROGRESS for 2s [ 1485.816097] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1629967c-76d1-4b7e-a365-0305af6dc147',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1486.318806] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1629967c-76d1-4b7e-a365-0305af6dc147: rpc.has_security_group_logging(os_id): False [ 1486.335835] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1486.335967] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1486.336068] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1486.336279] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1486.336370] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1486.336613] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1486.336713] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1486.336778] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1486.336926] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1486.337014] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1486.337107] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1629967c-76d1-4b7e-a365-0305af6dc147 is going to be created. [ 1486.394338] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1486.394499] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1486.394563] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1486.394768] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1486.394945] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1486.404750] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1629967c-76d1-4b7e-a365-0305af6dc147 in Status: IN_PROGRESS for 2s [ 1486.721137] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 33e8376b-4b98-4aa5-8325-ac1f9953095a in Status: SUCCESS [ 1486.721355] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-33e8376b-4b98-4aa5-8325-ac1f9953095a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1486.721514] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-33e8376b-4b98-4aa5-8325-ac1f9953095a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1486.721724] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-33e8376b-4b98-4aa5-8325-ac1f9953095a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1486.721905] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1486.722031] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1486.722100] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1486.722258] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1486.722342] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1486.722438] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('33e8376b-4b98-4aa5-8325-ac1f9953095a',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1487.224277] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('33e8376b-4b98-4aa5-8325-ac1f9953095a',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1487.368656] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 00f20236-2b69-46dc-a00f-0c4d6b93c17a in Status: SUCCESS [ 1487.368924] env[69980]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 00f20236-2b69-46dc-a00f-0c4d6b93c17a deletion is rescheduled due to dependency. [ 1487.368924] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-00f20236-2b69-46dc-a00f-0c4d6b93c17a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1487.726934] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('33e8376b-4b98-4aa5-8325-ac1f9953095a',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1488.229513] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1488.229724] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1488.229779] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1488.229978] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1488.230086] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1488.230192] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 33e8376b-4b98-4aa5-8325-ac1f9953095a is going to be updated. [ 1488.261806] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1488.261987] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1488.262056] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1488.262222] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1488.262361] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1488.270598] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 33e8376b-4b98-4aa5-8325-ac1f9953095a in Status: IN_PROGRESS for 2s [ 1488.416414] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1629967c-76d1-4b7e-a365-0305af6dc147 in Status: SUCCESS [ 1488.416776] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1629967c-76d1-4b7e-a365-0305af6dc147" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1489.818080] env[69980]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1489.818413] env[69980]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=2 [ 1490.281338] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 33e8376b-4b98-4aa5-8325-ac1f9953095a in Status: SUCCESS [ 1490.281567] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-33e8376b-4b98-4aa5-8325-ac1f9953095a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1490.281726] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-33e8376b-4b98-4aa5-8325-ac1f9953095a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1490.281942] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-33e8376b-4b98-4aa5-8325-ac1f9953095a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1490.282144] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1490.282260] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1490.282323] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1490.282484] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1490.282590] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1490.282701] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-33e8376b-4b98-4aa5-8325-ac1f9953095a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1490.282743] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('33e8376b-4b98-4aa5-8325-ac1f9953095a',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1490.785257] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-33e8376b-4b98-4aa5-8325-ac1f9953095a taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1490.785919] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-33e8376b-4b98-4aa5-8325-ac1f9953095a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1490.785919] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-33e8376b-4b98-4aa5-8325-ac1f9953095a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1490.785919] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-33e8376b-4b98-4aa5-8325-ac1f9953095a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1490.785919] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1490.786465] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1490.786465] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1490.786465] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1490.786465] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1490.786465] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-33e8376b-4b98-4aa5-8325-ac1f9953095a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1490.786689] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-33e8376b-4b98-4aa5-8325-ac1f9953095a taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1490.786689] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-33e8376b-4b98-4aa5-8325-ac1f9953095a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1490.786794] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-33e8376b-4b98-4aa5-8325-ac1f9953095a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1490.786838] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-33e8376b-4b98-4aa5-8325-ac1f9953095a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1490.786977] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1490.787069] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1490.787127] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1490.787274] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1490.787348] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1490.787432] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-33e8376b-4b98-4aa5-8325-ac1f9953095a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1490.787519] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('33e8376b-4b98-4aa5-8325-ac1f9953095a',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1491.290957] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 33e8376b-4b98-4aa5-8325-ac1f9953095a: rpc.has_security_group_logging(os_id): False [ 1491.308284] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1491.308446] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1491.308517] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1491.308722] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1491.308813] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1491.309015] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1491.309113] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1491.309168] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1491.309311] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1491.309387] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1491.309589] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1491.309677] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1491.309737] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1491.309880] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1491.309949] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1491.310144] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1491.310232] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1491.310328] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1491.310472] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1491.310539] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1491.310630] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 33e8376b-4b98-4aa5-8325-ac1f9953095a is going to be updated. [ 1491.365704] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1491.365704] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1491.365704] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1491.365953] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1491.366033] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1491.379371] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 33e8376b-4b98-4aa5-8325-ac1f9953095a in Status: IN_PROGRESS for 2s [ 1493.394595] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 33e8376b-4b98-4aa5-8325-ac1f9953095a in Status: SUCCESS [ 1493.394595] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-33e8376b-4b98-4aa5-8325-ac1f9953095a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1494.819695] env[69980]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1494.819695] env[69980]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1498.258290] env[69980]: INFO networking_nsxv3.common.synchronization [req-2288651e-ea4a-4808-b39f-f753bb747c92 req-e4f6daae-aa68-42ea-a7b7-132e3d9f6e1f tempest-ServersTestJSON-85857845 tempest-ServersTestJSON-85857845-project-member] Enqueued Resource ID: 33e8376b-4b98-4aa5-8325-ac1f9953095a with Priority: HIGHEST for action security_group_members [ 1498.258888] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 33e8376b-4b98-4aa5-8325-ac1f9953095a with Priority: HIGHEST for action security_group_members [ 1498.259219] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-33e8376b-4b98-4aa5-8325-ac1f9953095a taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1498.259357] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-33e8376b-4b98-4aa5-8325-ac1f9953095a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1498.259410] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-33e8376b-4b98-4aa5-8325-ac1f9953095a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1498.259592] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-33e8376b-4b98-4aa5-8325-ac1f9953095a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1498.259739] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1498.260048] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1498.260137] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1498.260270] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1498.260383] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1498.260735] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('33e8376b-4b98-4aa5-8325-ac1f9953095a',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1498.513611] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock network-14 taken with stack trace [, , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1498.513828] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "network-14" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1498.513933] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "network-14" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1498.514214] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "network-14" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1498.514477] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1498.514637] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1498.514756] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1498.514987] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1498.515145] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1498.515355] env[69980]: DEBUG dogpile.cache.region [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] No value present for key: 'zone-id' {{(pid=69980) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1498.515470] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] NeedRegenerationException {{(pid=69980) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1498.516075] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] no value, waiting for create lock {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1498.516075] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] value creation lock acquired {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1498.516075] env[69980]: DEBUG dogpile.cache.region [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] No value present for key: 'zone-id' {{(pid=69980) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1498.516075] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Calling creation function for not-yet-present value {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1498.516075] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1498.535173] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1498.535423] env[69980]: DEBUG dogpile.cache.region [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=69980) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1498.535480] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Released creation lock {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1498.535862] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "network-14" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1498.535982] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock port-debf9578-7a24-4c6e-b6ad-1b49d6eab2bc taken with stack trace [, , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1498.536153] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "port-debf9578-7a24-4c6e-b6ad-1b49d6eab2bc" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1498.536309] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "port-debf9578-7a24-4c6e-b6ad-1b49d6eab2bc" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1498.536612] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "port-debf9578-7a24-4c6e-b6ad-1b49d6eab2bc" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1498.536756] env[69980]: DEBUG networking_nsxv3.api.rpc [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('debf9578-7a24-4c6e-b6ad-1b49d6eab2bc',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1498.763312] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('33e8376b-4b98-4aa5-8325-ac1f9953095a',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1499.039048] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1499.039275] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1499.039409] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1499.039681] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1499.039840] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1499.039999] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Segment Port debf9578-7a24-4c6e-b6ad-1b49d6eab2bc not found, creating... [ 1499.040281] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1499.040495] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1499.040624] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1499.040849] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1499.040992] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1499.041297] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1499.041458] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1499.041582] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1499.041793] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1499.041931] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1499.042120] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Resource: SegmentPort with ID: debf9578-7a24-4c6e-b6ad-1b49d6eab2bc is going to be created. [ 1499.063316] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1499.063524] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1499.063647] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1499.063898] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1499.064140] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1499.064363] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "port-debf9578-7a24-4c6e-b6ad-1b49d6eab2bc" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1499.265697] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('33e8376b-4b98-4aa5-8325-ac1f9953095a',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1499.768596] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1499.768843] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1499.768977] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1499.769284] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1499.769433] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1499.769581] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 33e8376b-4b98-4aa5-8325-ac1f9953095a is going to be updated. [ 1499.794527] env[69980]: INFO networking_nsxv3.common.synchronization [req-2288651e-ea4a-4808-b39f-f753bb747c92 req-620e4e23-21eb-46a1-82fb-268f493ffe89 service nova] Enqueued Resource ID: 33e8376b-4b98-4aa5-8325-ac1f9953095a with Priority: HIGHEST for action security_group_rules [ 1499.794744] env[69980]: INFO networking_nsxv3.common.synchronization [req-2288651e-ea4a-4808-b39f-f753bb747c92 req-620e4e23-21eb-46a1-82fb-268f493ffe89 service nova] Enqueued Resource ID: 33e8376b-4b98-4aa5-8325-ac1f9953095a with Priority: HIGHEST for action security_group_members [ 1499.794920] env[69980]: INFO networking_nsxv3.common.synchronization [req-2288651e-ea4a-4808-b39f-f753bb747c92 req-620e4e23-21eb-46a1-82fb-268f493ffe89 service nova] Enqueued Resource ID: debf9578-7a24-4c6e-b6ad-1b49d6eab2bc with Priority: HIGHEST for action port [ 1499.795500] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 33e8376b-4b98-4aa5-8325-ac1f9953095a with Priority: HIGHEST for action security_group_rules [ 1499.795657] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 33e8376b-4b98-4aa5-8325-ac1f9953095a with Priority: HIGHEST for action security_group_members [ 1499.795785] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: debf9578-7a24-4c6e-b6ad-1b49d6eab2bc with Priority: HIGHEST for action port [ 1499.796113] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock rules-33e8376b-4b98-4aa5-8325-ac1f9953095a taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1499.796266] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-33e8376b-4b98-4aa5-8325-ac1f9953095a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1499.796329] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-33e8376b-4b98-4aa5-8325-ac1f9953095a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1499.796556] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-33e8376b-4b98-4aa5-8325-ac1f9953095a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1499.796671] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('33e8376b-4b98-4aa5-8325-ac1f9953095a',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1499.798083] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-33e8376b-4b98-4aa5-8325-ac1f9953095a taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1499.798206] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-33e8376b-4b98-4aa5-8325-ac1f9953095a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1499.798404] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock port-debf9578-7a24-4c6e-b6ad-1b49d6eab2bc taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1499.798516] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-debf9578-7a24-4c6e-b6ad-1b49d6eab2bc" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1499.798606] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-debf9578-7a24-4c6e-b6ad-1b49d6eab2bc" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1499.798841] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-debf9578-7a24-4c6e-b6ad-1b49d6eab2bc" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1499.798935] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('debf9578-7a24-4c6e-b6ad-1b49d6eab2bc',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1499.803075] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1499.803075] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1499.803075] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1499.803075] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1499.803075] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1499.810527] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 33e8376b-4b98-4aa5-8325-ac1f9953095a in Status: IN_PROGRESS for 2s [ 1500.303254] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-33e8376b-4b98-4aa5-8325-ac1f9953095a taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1500.303561] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-33e8376b-4b98-4aa5-8325-ac1f9953095a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1500.303561] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port debf9578-7a24-4c6e-b6ad-1b49d6eab2bc with status ACTIVE [ 1500.303729] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1500.303836] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1500.303903] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1500.304140] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1500.304232] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1500.304414] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1500.304550] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1500.304550] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1500.304703] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1500.304781] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1500.304957] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1500.305055] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1500.305120] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1500.305256] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1500.305331] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1500.305415] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: debf9578-7a24-4c6e-b6ad-1b49d6eab2bc is going to be updated. [ 1500.325582] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1500.325747] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1500.325795] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1500.325931] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1500.326069] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1500.326220] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-debf9578-7a24-4c6e-b6ad-1b49d6eab2bc" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1501.820684] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 33e8376b-4b98-4aa5-8325-ac1f9953095a in Status: SUCCESS [ 1501.821128] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-33e8376b-4b98-4aa5-8325-ac1f9953095a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1501.821128] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-33e8376b-4b98-4aa5-8325-ac1f9953095a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1501.821314] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-33e8376b-4b98-4aa5-8325-ac1f9953095a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1501.821480] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1501.821628] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1501.821671] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1501.821811] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1501.821894] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1501.821992] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('33e8376b-4b98-4aa5-8325-ac1f9953095a',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1502.324809] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('33e8376b-4b98-4aa5-8325-ac1f9953095a',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1502.827641] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('33e8376b-4b98-4aa5-8325-ac1f9953095a',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1503.330666] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1503.330940] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1503.330940] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1503.331067] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1503.331166] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1503.331267] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 33e8376b-4b98-4aa5-8325-ac1f9953095a is going to be updated. [ 1503.359510] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1503.359642] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1503.359718] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1503.359918] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1503.360073] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1503.368771] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 33e8376b-4b98-4aa5-8325-ac1f9953095a in Status: IN_PROGRESS for 2s [ 1504.796560] env[69980]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1504.796858] env[69980]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=2 [ 1505.380171] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 33e8376b-4b98-4aa5-8325-ac1f9953095a in Status: SUCCESS [ 1505.380440] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-33e8376b-4b98-4aa5-8325-ac1f9953095a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1505.380630] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-33e8376b-4b98-4aa5-8325-ac1f9953095a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1505.380865] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-33e8376b-4b98-4aa5-8325-ac1f9953095a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1505.381094] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1505.381249] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1505.381321] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1505.381479] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1505.381565] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1505.381682] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-33e8376b-4b98-4aa5-8325-ac1f9953095a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1505.381780] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('33e8376b-4b98-4aa5-8325-ac1f9953095a',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1505.884778] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-33e8376b-4b98-4aa5-8325-ac1f9953095a taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1505.885237] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-33e8376b-4b98-4aa5-8325-ac1f9953095a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1505.885237] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-33e8376b-4b98-4aa5-8325-ac1f9953095a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1505.885320] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-33e8376b-4b98-4aa5-8325-ac1f9953095a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1505.885450] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1505.885549] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1505.885608] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1505.885728] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1505.885807] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1505.885898] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-33e8376b-4b98-4aa5-8325-ac1f9953095a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1505.886063] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-33e8376b-4b98-4aa5-8325-ac1f9953095a taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1505.886157] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-33e8376b-4b98-4aa5-8325-ac1f9953095a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1505.886215] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-33e8376b-4b98-4aa5-8325-ac1f9953095a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1505.886350] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-33e8376b-4b98-4aa5-8325-ac1f9953095a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1505.886486] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1505.886569] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1505.886626] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1505.886758] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1505.886830] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1505.886909] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-33e8376b-4b98-4aa5-8325-ac1f9953095a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1505.886996] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('33e8376b-4b98-4aa5-8325-ac1f9953095a',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1506.389458] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 33e8376b-4b98-4aa5-8325-ac1f9953095a: rpc.has_security_group_logging(os_id): False [ 1506.411810] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1506.411964] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1506.412094] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1506.412308] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1506.412408] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1506.412636] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1506.412757] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1506.412828] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1506.413016] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1506.413108] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1506.413341] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1506.413465] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1506.413528] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1506.413702] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1506.413785] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1506.413998] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1506.414137] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1506.414202] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1506.414371] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1506.414452] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1506.414580] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 33e8376b-4b98-4aa5-8325-ac1f9953095a is going to be updated. [ 1506.483690] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1506.483973] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1506.483973] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1506.484196] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1506.484378] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1506.497534] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 33e8376b-4b98-4aa5-8325-ac1f9953095a in Status: IN_PROGRESS for 2s [ 1508.513485] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 33e8376b-4b98-4aa5-8325-ac1f9953095a in Status: SUCCESS [ 1508.513884] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-33e8376b-4b98-4aa5-8325-ac1f9953095a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1509.797152] env[69980]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1509.797453] env[69980]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1510.049485] env[69980]: INFO networking_nsxv3.common.synchronization [req-20ae706e-1892-4d96-b9aa-c686438de8fe req-28b20112-8e26-43f2-8a3a-db23ccdb08f3 tempest-ServersTestJSON-85857845 tempest-ServersTestJSON-85857845-project-member] Enqueued Resource ID: 33e8376b-4b98-4aa5-8325-ac1f9953095a with Priority: HIGHEST for action security_group_members [ 1510.050016] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 33e8376b-4b98-4aa5-8325-ac1f9953095a with Priority: HIGHEST for action security_group_members [ 1510.050325] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-33e8376b-4b98-4aa5-8325-ac1f9953095a taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1510.050494] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-33e8376b-4b98-4aa5-8325-ac1f9953095a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1510.050620] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-33e8376b-4b98-4aa5-8325-ac1f9953095a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1510.050737] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-33e8376b-4b98-4aa5-8325-ac1f9953095a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1510.050889] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1510.050991] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1510.051152] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1510.051318] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1510.051402] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1510.051512] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('33e8376b-4b98-4aa5-8325-ac1f9953095a',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1510.554839] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('33e8376b-4b98-4aa5-8325-ac1f9953095a',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1511.057160] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('33e8376b-4b98-4aa5-8325-ac1f9953095a',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1511.559975] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1511.560221] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1511.560221] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1511.560423] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1511.560560] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1511.560670] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 33e8376b-4b98-4aa5-8325-ac1f9953095a is going to be updated. [ 1511.599050] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1511.599216] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1511.599276] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1511.599483] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1511.599628] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1511.612805] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 33e8376b-4b98-4aa5-8325-ac1f9953095a in Status: IN_PROGRESS for 2s [ 1513.625329] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 33e8376b-4b98-4aa5-8325-ac1f9953095a in Status: SUCCESS [ 1513.625329] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-33e8376b-4b98-4aa5-8325-ac1f9953095a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1515.051068] env[69980]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1515.051415] env[69980]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1516.691788] env[69980]: INFO networking_nsxv3.common.synchronization [req-c03bfe41-c406-43a3-a5a0-21df678b81d2 req-ceec9094-875b-446f-9f37-06801e3b7abf tempest-ServersTestJSON-85857845 tempest-ServersTestJSON-85857845-project-member] Enqueued Resource ID: 33e8376b-4b98-4aa5-8325-ac1f9953095a with Priority: HIGHEST for action security_group_members [ 1516.692390] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 33e8376b-4b98-4aa5-8325-ac1f9953095a with Priority: HIGHEST for action security_group_members [ 1516.692848] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-33e8376b-4b98-4aa5-8325-ac1f9953095a taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1516.692926] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-33e8376b-4b98-4aa5-8325-ac1f9953095a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1516.692970] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-33e8376b-4b98-4aa5-8325-ac1f9953095a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1516.693168] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-33e8376b-4b98-4aa5-8325-ac1f9953095a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1516.693332] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1516.693433] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1516.693494] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1516.693676] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1516.693780] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1516.693875] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('33e8376b-4b98-4aa5-8325-ac1f9953095a',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1517.196053] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('33e8376b-4b98-4aa5-8325-ac1f9953095a',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1517.699180] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('33e8376b-4b98-4aa5-8325-ac1f9953095a',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1518.201489] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1518.201716] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1518.201765] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1518.202109] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1518.202240] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1518.202371] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 33e8376b-4b98-4aa5-8325-ac1f9953095a is going to be updated. [ 1518.236418] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1518.236578] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1518.236642] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1518.236818] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1518.236964] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1518.245670] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 33e8376b-4b98-4aa5-8325-ac1f9953095a in Status: IN_PROGRESS for 2s [ 1520.256590] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 33e8376b-4b98-4aa5-8325-ac1f9953095a in Status: SUCCESS [ 1520.256819] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-33e8376b-4b98-4aa5-8325-ac1f9953095a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1521.693353] env[69980]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1521.693747] env[69980]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1525.760195] env[69980]: INFO networking_nsxv3.common.synchronization [req-dfddf786-f828-48d0-8573-0641a74939d0 req-87c3bc46-ca18-4675-ada9-c21a2c37abcd tempest-ServersTestJSON-85857845 tempest-ServersTestJSON-85857845-project-member] Enqueued Resource ID: 33e8376b-4b98-4aa5-8325-ac1f9953095a with Priority: HIGHEST for action security_group_members [ 1525.760481] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 33e8376b-4b98-4aa5-8325-ac1f9953095a with Priority: HIGHEST for action security_group_members [ 1525.760763] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-33e8376b-4b98-4aa5-8325-ac1f9953095a taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1525.760886] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-33e8376b-4b98-4aa5-8325-ac1f9953095a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1525.760951] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-33e8376b-4b98-4aa5-8325-ac1f9953095a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1525.761384] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-33e8376b-4b98-4aa5-8325-ac1f9953095a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1525.761545] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1525.761671] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1525.761776] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1525.762008] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1525.762116] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1525.762211] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('33e8376b-4b98-4aa5-8325-ac1f9953095a',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1525.989415] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock network-14 taken with stack trace [, , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1525.989622] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "network-14" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1525.989751] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "network-14" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1525.990031] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "network-14" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1525.990294] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1525.990455] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1525.990575] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1525.990834] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1525.990983] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1525.991225] env[69980]: DEBUG dogpile.cache.region [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] No value present for key: 'zone-id' {{(pid=69980) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1525.991342] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] NeedRegenerationException {{(pid=69980) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1525.991451] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] no value, waiting for create lock {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1525.991563] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] value creation lock acquired {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1525.991674] env[69980]: DEBUG dogpile.cache.region [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] No value present for key: 'zone-id' {{(pid=69980) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1525.991782] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Calling creation function for not-yet-present value {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1525.992244] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1526.016050] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1526.016050] env[69980]: DEBUG dogpile.cache.region [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=69980) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1526.016050] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Released creation lock {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1526.016050] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "network-14" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1526.016050] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock port-ad70bd09-f301-4ef6-a232-ae03029eb71a taken with stack trace [, , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1526.016050] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "port-ad70bd09-f301-4ef6-a232-ae03029eb71a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1526.016449] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "port-ad70bd09-f301-4ef6-a232-ae03029eb71a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1526.016490] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "port-ad70bd09-f301-4ef6-a232-ae03029eb71a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1526.016625] env[69980]: DEBUG networking_nsxv3.api.rpc [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ad70bd09-f301-4ef6-a232-ae03029eb71a',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1526.265829] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('33e8376b-4b98-4aa5-8325-ac1f9953095a',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1526.519517] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1526.519812] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1526.519927] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1526.520567] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1526.520567] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1526.520567] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Segment Port ad70bd09-f301-4ef6-a232-ae03029eb71a not found, creating... [ 1526.520844] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1526.521010] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1526.521130] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1526.521352] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1526.521494] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1526.521889] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1526.522165] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1526.522369] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1526.522718] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1526.522939] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1526.523110] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Resource: SegmentPort with ID: ad70bd09-f301-4ef6-a232-ae03029eb71a is going to be created. [ 1526.546029] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1526.546029] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1526.546275] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1526.546407] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1526.546636] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1526.546858] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "port-ad70bd09-f301-4ef6-a232-ae03029eb71a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1526.768272] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('33e8376b-4b98-4aa5-8325-ac1f9953095a',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1527.203403] env[69980]: INFO networking_nsxv3.common.synchronization [req-dfddf786-f828-48d0-8573-0641a74939d0 req-6116ebde-cdcf-4f68-b548-271b379ee975 service nova] Enqueued Resource ID: 33e8376b-4b98-4aa5-8325-ac1f9953095a with Priority: HIGHEST for action security_group_rules [ 1527.203585] env[69980]: INFO networking_nsxv3.common.synchronization [req-dfddf786-f828-48d0-8573-0641a74939d0 req-6116ebde-cdcf-4f68-b548-271b379ee975 service nova] Enqueued Resource ID: 33e8376b-4b98-4aa5-8325-ac1f9953095a with Priority: HIGHEST for action security_group_members [ 1527.203729] env[69980]: INFO networking_nsxv3.common.synchronization [req-dfddf786-f828-48d0-8573-0641a74939d0 req-6116ebde-cdcf-4f68-b548-271b379ee975 service nova] Enqueued Resource ID: ad70bd09-f301-4ef6-a232-ae03029eb71a with Priority: HIGHEST for action port [ 1527.204279] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 33e8376b-4b98-4aa5-8325-ac1f9953095a with Priority: HIGHEST for action security_group_rules [ 1527.204379] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 33e8376b-4b98-4aa5-8325-ac1f9953095a with Priority: HIGHEST for action security_group_members [ 1527.204479] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ad70bd09-f301-4ef6-a232-ae03029eb71a with Priority: HIGHEST for action port [ 1527.204741] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock rules-33e8376b-4b98-4aa5-8325-ac1f9953095a taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1527.204863] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-33e8376b-4b98-4aa5-8325-ac1f9953095a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1527.204926] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-33e8376b-4b98-4aa5-8325-ac1f9953095a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1527.205144] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-33e8376b-4b98-4aa5-8325-ac1f9953095a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1527.205220] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('33e8376b-4b98-4aa5-8325-ac1f9953095a',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1527.206390] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-33e8376b-4b98-4aa5-8325-ac1f9953095a taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1527.206441] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-33e8376b-4b98-4aa5-8325-ac1f9953095a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1527.206606] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock port-ad70bd09-f301-4ef6-a232-ae03029eb71a taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1527.206707] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ad70bd09-f301-4ef6-a232-ae03029eb71a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1527.206774] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ad70bd09-f301-4ef6-a232-ae03029eb71a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1527.206923] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ad70bd09-f301-4ef6-a232-ae03029eb71a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1527.206998] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ad70bd09-f301-4ef6-a232-ae03029eb71a',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1527.270896] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1527.271047] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1527.271114] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1527.271285] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1527.271381] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1527.271509] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 33e8376b-4b98-4aa5-8325-ac1f9953095a is going to be updated. [ 1527.307168] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1527.307313] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1527.307386] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1527.307583] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1527.307734] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1527.316748] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 33e8376b-4b98-4aa5-8325-ac1f9953095a in Status: IN_PROGRESS for 2s [ 1527.709202] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-33e8376b-4b98-4aa5-8325-ac1f9953095a taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1527.709416] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-33e8376b-4b98-4aa5-8325-ac1f9953095a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1527.712034] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port ad70bd09-f301-4ef6-a232-ae03029eb71a with status ACTIVE [ 1527.712034] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1527.712234] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1527.712234] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1527.712412] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1527.712412] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1527.712598] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1527.712663] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1527.712731] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1527.712872] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1527.712978] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1527.713152] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1527.713238] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1527.713289] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1527.713430] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1527.713520] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1527.713574] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: ad70bd09-f301-4ef6-a232-ae03029eb71a is going to be updated. [ 1527.732765] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1527.732946] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1527.733018] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1527.733159] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1527.733292] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1527.733445] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ad70bd09-f301-4ef6-a232-ae03029eb71a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1529.325942] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 33e8376b-4b98-4aa5-8325-ac1f9953095a in Status: SUCCESS [ 1529.326340] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-33e8376b-4b98-4aa5-8325-ac1f9953095a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1529.326340] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-33e8376b-4b98-4aa5-8325-ac1f9953095a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1529.326486] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-33e8376b-4b98-4aa5-8325-ac1f9953095a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1529.326676] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1529.326791] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1529.326857] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1529.327028] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1529.327114] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1529.327211] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('33e8376b-4b98-4aa5-8325-ac1f9953095a',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1529.829223] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('33e8376b-4b98-4aa5-8325-ac1f9953095a',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1530.331463] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('33e8376b-4b98-4aa5-8325-ac1f9953095a',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1530.833970] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1530.833970] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1530.833970] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1530.834217] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1530.834349] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1530.834405] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 33e8376b-4b98-4aa5-8325-ac1f9953095a is going to be updated. [ 1530.858682] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1530.858824] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1530.858876] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1530.859071] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1530.859213] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1530.866866] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 33e8376b-4b98-4aa5-8325-ac1f9953095a in Status: IN_PROGRESS for 2s [ 1532.205677] env[69980]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1532.205990] env[69980]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=2 [ 1532.881275] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 33e8376b-4b98-4aa5-8325-ac1f9953095a in Status: SUCCESS [ 1532.881275] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-33e8376b-4b98-4aa5-8325-ac1f9953095a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1532.881275] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-33e8376b-4b98-4aa5-8325-ac1f9953095a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1532.881275] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-33e8376b-4b98-4aa5-8325-ac1f9953095a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1532.881275] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1532.881275] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1532.881275] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1532.881275] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1532.881275] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1532.881275] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-33e8376b-4b98-4aa5-8325-ac1f9953095a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1532.881275] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('33e8376b-4b98-4aa5-8325-ac1f9953095a',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1533.380504] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-33e8376b-4b98-4aa5-8325-ac1f9953095a taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1533.380841] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-33e8376b-4b98-4aa5-8325-ac1f9953095a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1533.380841] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-33e8376b-4b98-4aa5-8325-ac1f9953095a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1533.381022] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-33e8376b-4b98-4aa5-8325-ac1f9953095a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1533.381226] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1533.381355] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1533.381426] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1533.381638] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1533.381732] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1533.381853] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-33e8376b-4b98-4aa5-8325-ac1f9953095a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1533.382011] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-33e8376b-4b98-4aa5-8325-ac1f9953095a taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1533.382114] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-33e8376b-4b98-4aa5-8325-ac1f9953095a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1533.382190] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-33e8376b-4b98-4aa5-8325-ac1f9953095a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1533.382357] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-33e8376b-4b98-4aa5-8325-ac1f9953095a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1533.382511] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1533.382622] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1533.382678] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1533.382851] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1533.382935] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1533.383062] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-33e8376b-4b98-4aa5-8325-ac1f9953095a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1533.383163] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('33e8376b-4b98-4aa5-8325-ac1f9953095a',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1533.885962] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 33e8376b-4b98-4aa5-8325-ac1f9953095a: rpc.has_security_group_logging(os_id): False [ 1533.902887] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1533.903091] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1533.903150] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1533.903325] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1533.903415] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1533.903604] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1533.903703] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1533.903768] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1533.903920] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1533.903998] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1533.904212] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1533.904306] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1533.904368] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1533.904509] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1533.904583] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1533.904759] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1533.904851] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1533.904912] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1533.905072] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1533.905157] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1533.905242] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 33e8376b-4b98-4aa5-8325-ac1f9953095a is going to be updated. [ 1533.965655] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1533.965895] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1533.965895] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1533.966087] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1533.966234] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1533.981564] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 33e8376b-4b98-4aa5-8325-ac1f9953095a in Status: IN_PROGRESS for 2s [ 1535.999949] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 33e8376b-4b98-4aa5-8325-ac1f9953095a in Status: SUCCESS [ 1536.000391] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-33e8376b-4b98-4aa5-8325-ac1f9953095a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1537.034617] env[69980]: INFO networking_nsxv3.common.synchronization [req-9634fbc5-a5a8-412c-8783-e1697b441757 req-d665201c-f602-438c-9dd1-93186603880c tempest-ServersTestJSON-85857845 tempest-ServersTestJSON-85857845-project-member] Enqueued Resource ID: 33e8376b-4b98-4aa5-8325-ac1f9953095a with Priority: HIGHEST for action security_group_members [ 1537.034617] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 33e8376b-4b98-4aa5-8325-ac1f9953095a with Priority: HIGHEST for action security_group_members [ 1537.034970] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-33e8376b-4b98-4aa5-8325-ac1f9953095a taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1537.034970] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-33e8376b-4b98-4aa5-8325-ac1f9953095a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1537.034970] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-33e8376b-4b98-4aa5-8325-ac1f9953095a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1537.035253] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-33e8376b-4b98-4aa5-8325-ac1f9953095a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1537.035446] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1537.035556] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1537.035622] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1537.035801] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1537.035904] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1537.036016] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('33e8376b-4b98-4aa5-8325-ac1f9953095a',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1537.538439] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('33e8376b-4b98-4aa5-8325-ac1f9953095a',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1537.570834] env[69980]: INFO networking_nsxv3.common.synchronization [None req-48027691-22d7-4d96-a32d-d5b7d187cf8e tempest-AttachVolumeNegativeTest-1885261294 tempest-AttachVolumeNegativeTest-1885261294-project-member] Enqueued Resource ID: 27aee5b6-679c-4e5c-baeb-bebfb0cf1e97 with Priority: HIGHEST for action security_group_rules [ 1537.571256] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 27aee5b6-679c-4e5c-baeb-bebfb0cf1e97 with Priority: HIGHEST for action security_group_rules [ 1537.571567] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock rules-27aee5b6-679c-4e5c-baeb-bebfb0cf1e97 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1537.571684] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-27aee5b6-679c-4e5c-baeb-bebfb0cf1e97" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1537.571774] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-27aee5b6-679c-4e5c-baeb-bebfb0cf1e97" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1537.572115] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-27aee5b6-679c-4e5c-baeb-bebfb0cf1e97" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1537.572115] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('27aee5b6-679c-4e5c-baeb-bebfb0cf1e97',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1537.637773] env[69980]: INFO networking_nsxv3.common.synchronization [None req-992a229d-c13e-4b59-b68c-0e08ef196039 tempest-AttachVolumeNegativeTest-1885261294 tempest-AttachVolumeNegativeTest-1885261294-project-member] Enqueued Resource ID: 27aee5b6-679c-4e5c-baeb-bebfb0cf1e97 with Priority: HIGHEST for action security_group_rules [ 1537.638305] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 27aee5b6-679c-4e5c-baeb-bebfb0cf1e97 with Priority: HIGHEST for action security_group_rules [ 1537.638627] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock rules-27aee5b6-679c-4e5c-baeb-bebfb0cf1e97 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1537.639017] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-27aee5b6-679c-4e5c-baeb-bebfb0cf1e97" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1538.040960] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('33e8376b-4b98-4aa5-8325-ac1f9953095a',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1538.091980] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1538.092178] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1538.092259] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1538.092413] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1538.092503] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1538.092599] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 27aee5b6-679c-4e5c-baeb-bebfb0cf1e97 already deleted. [ 1538.092682] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-27aee5b6-679c-4e5c-baeb-bebfb0cf1e97" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1538.092821] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-27aee5b6-679c-4e5c-baeb-bebfb0cf1e97" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1538.092975] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-27aee5b6-679c-4e5c-baeb-bebfb0cf1e97" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1538.093068] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('27aee5b6-679c-4e5c-baeb-bebfb0cf1e97',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1538.544750] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1538.544964] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1538.544964] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1538.545216] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1538.545314] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1538.545417] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 33e8376b-4b98-4aa5-8325-ac1f9953095a is going to be updated. [ 1538.575262] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1538.575467] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1538.575467] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1538.575660] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1538.575825] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1538.584097] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 33e8376b-4b98-4aa5-8325-ac1f9953095a in Status: IN_PROGRESS for 2s [ 1538.619274] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1538.619413] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1538.619526] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1538.619763] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1538.619890] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1538.620031] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 27aee5b6-679c-4e5c-baeb-bebfb0cf1e97 already deleted. [ 1538.620156] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-27aee5b6-679c-4e5c-baeb-bebfb0cf1e97" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1540.593821] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 33e8376b-4b98-4aa5-8325-ac1f9953095a in Status: SUCCESS [ 1540.594170] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-33e8376b-4b98-4aa5-8325-ac1f9953095a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1542.638952] env[69980]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1542.639291] env[69980]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1543.340943] env[69980]: INFO networking_nsxv3.common.synchronization [req-e99ea57d-0559-4a0b-8cdc-7069c7e1edbf req-be56c36c-bee7-4b58-93ce-55da2ea48ede tempest-AttachVolumeNegativeTest-1885261294 tempest-AttachVolumeNegativeTest-1885261294-project-member] Enqueued Resource ID: 27aee5b6-679c-4e5c-baeb-bebfb0cf1e97 with Priority: HIGHEST for action security_group_members [ 1543.341090] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 27aee5b6-679c-4e5c-baeb-bebfb0cf1e97 with Priority: HIGHEST for action security_group_members [ 1543.341363] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-27aee5b6-679c-4e5c-baeb-bebfb0cf1e97 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1543.341487] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-27aee5b6-679c-4e5c-baeb-bebfb0cf1e97" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1543.341549] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-27aee5b6-679c-4e5c-baeb-bebfb0cf1e97" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1543.341808] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-27aee5b6-679c-4e5c-baeb-bebfb0cf1e97" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1543.341976] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1543.342103] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1543.342164] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1543.342344] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1543.342395] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1543.342510] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('27aee5b6-679c-4e5c-baeb-bebfb0cf1e97',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1543.605578] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock network-820 taken with stack trace [, , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1543.605794] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "network-820" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1543.605928] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "network-820" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1543.606227] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "network-820" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1543.606495] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1543.606665] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1543.607010] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1543.607101] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1543.607189] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1543.607408] env[69980]: DEBUG dogpile.cache.region [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] No value present for key: 'zone-id' {{(pid=69980) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1543.607505] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] NeedRegenerationException {{(pid=69980) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1543.607609] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] no value, waiting for create lock {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1543.607722] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] value creation lock acquired {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1543.607835] env[69980]: DEBUG dogpile.cache.region [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] No value present for key: 'zone-id' {{(pid=69980) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1543.607944] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Calling creation function for not-yet-present value {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1543.608109] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1543.628130] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1543.628298] env[69980]: DEBUG dogpile.cache.region [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=69980) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1543.628428] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Released creation lock {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1543.628599] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "network-820" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1543.628930] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock port-94d77acf-c4cb-44e5-a683-6bb9634315e4 taken with stack trace [, , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1543.629140] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "port-94d77acf-c4cb-44e5-a683-6bb9634315e4" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1543.629275] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "port-94d77acf-c4cb-44e5-a683-6bb9634315e4" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1543.629667] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "port-94d77acf-c4cb-44e5-a683-6bb9634315e4" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1543.629747] env[69980]: DEBUG networking_nsxv3.api.rpc [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('94d77acf-c4cb-44e5-a683-6bb9634315e4',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1543.844253] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1543.844709] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1543.844709] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1543.844709] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1543.844876] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1543.844956] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1543.845068] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1543.845126] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1543.845270] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1543.845344] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1543.845428] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 27aee5b6-679c-4e5c-baeb-bebfb0cf1e97 already deleted. [ 1543.845506] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-27aee5b6-679c-4e5c-baeb-bebfb0cf1e97" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1544.131923] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1544.132231] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1544.132354] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1544.132599] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1544.132753] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1544.132907] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Segment Port 94d77acf-c4cb-44e5-a683-6bb9634315e4 not found, creating... [ 1544.133196] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1544.133352] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1544.133471] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1544.133689] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1544.133829] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1544.134125] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1544.134308] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1544.134403] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1544.134606] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1544.134742] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1544.134882] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Resource: SegmentPort with ID: 94d77acf-c4cb-44e5-a683-6bb9634315e4 is going to be created. [ 1544.154299] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1544.154497] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1544.154543] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1544.154764] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1544.154983] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1544.155217] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "port-94d77acf-c4cb-44e5-a683-6bb9634315e4" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1544.858585] env[69980]: INFO networking_nsxv3.common.synchronization [req-e99ea57d-0559-4a0b-8cdc-7069c7e1edbf req-b0e588a3-5f15-47a9-89e6-af6b2cb22c9f service nova] Enqueued Resource ID: 27aee5b6-679c-4e5c-baeb-bebfb0cf1e97 with Priority: HIGHEST for action security_group_rules [ 1544.858830] env[69980]: INFO networking_nsxv3.common.synchronization [req-e99ea57d-0559-4a0b-8cdc-7069c7e1edbf req-b0e588a3-5f15-47a9-89e6-af6b2cb22c9f service nova] Enqueued Resource ID: 27aee5b6-679c-4e5c-baeb-bebfb0cf1e97 with Priority: HIGHEST for action security_group_members [ 1544.858943] env[69980]: INFO networking_nsxv3.common.synchronization [req-e99ea57d-0559-4a0b-8cdc-7069c7e1edbf req-b0e588a3-5f15-47a9-89e6-af6b2cb22c9f service nova] Enqueued Resource ID: 94d77acf-c4cb-44e5-a683-6bb9634315e4 with Priority: HIGHEST for action port [ 1544.859201] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 27aee5b6-679c-4e5c-baeb-bebfb0cf1e97 with Priority: HIGHEST for action security_group_rules [ 1544.859332] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 27aee5b6-679c-4e5c-baeb-bebfb0cf1e97 with Priority: HIGHEST for action security_group_members [ 1544.859427] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 94d77acf-c4cb-44e5-a683-6bb9634315e4 with Priority: HIGHEST for action port [ 1544.859974] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock rules-27aee5b6-679c-4e5c-baeb-bebfb0cf1e97 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1544.860281] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-27aee5b6-679c-4e5c-baeb-bebfb0cf1e97" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1544.860379] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-27aee5b6-679c-4e5c-baeb-bebfb0cf1e97" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1544.860558] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-27aee5b6-679c-4e5c-baeb-bebfb0cf1e97" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1544.860641] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('27aee5b6-679c-4e5c-baeb-bebfb0cf1e97',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1544.862029] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-27aee5b6-679c-4e5c-baeb-bebfb0cf1e97 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1544.862029] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-27aee5b6-679c-4e5c-baeb-bebfb0cf1e97" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1544.862253] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-27aee5b6-679c-4e5c-baeb-bebfb0cf1e97" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1544.862364] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-27aee5b6-679c-4e5c-baeb-bebfb0cf1e97" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1544.862524] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1544.862625] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1544.862672] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1544.862819] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1544.862904] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1544.862993] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('27aee5b6-679c-4e5c-baeb-bebfb0cf1e97',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1544.864911] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock port-94d77acf-c4cb-44e5-a683-6bb9634315e4 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1544.865025] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-94d77acf-c4cb-44e5-a683-6bb9634315e4" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1544.865603] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-94d77acf-c4cb-44e5-a683-6bb9634315e4" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1544.865603] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-94d77acf-c4cb-44e5-a683-6bb9634315e4" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1544.865603] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('94d77acf-c4cb-44e5-a683-6bb9634315e4',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1545.363066] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-27aee5b6-679c-4e5c-baeb-bebfb0cf1e97 taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1545.363357] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-27aee5b6-679c-4e5c-baeb-bebfb0cf1e97" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1545.365549] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('27aee5b6-679c-4e5c-baeb-bebfb0cf1e97',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1545.367278] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 94d77acf-c4cb-44e5-a683-6bb9634315e4 with status ACTIVE [ 1545.367401] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1545.367510] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1545.367559] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1545.367769] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1545.367875] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1545.368047] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1545.368147] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1545.368231] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1545.368364] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1545.368466] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1545.368663] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1545.368784] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1545.368860] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1545.368954] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1545.369056] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1545.369120] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 94d77acf-c4cb-44e5-a683-6bb9634315e4 is going to be updated. [ 1545.388646] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1545.388806] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1545.388892] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1545.389079] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1545.389205] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1545.389354] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-94d77acf-c4cb-44e5-a683-6bb9634315e4" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1545.868252] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('27aee5b6-679c-4e5c-baeb-bebfb0cf1e97',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1546.175950] env[69980]: INFO networking_nsxv3.common.synchronization [req-3db38a54-b66b-4b41-95fd-e7f67cef0391 req-2aa9bf2c-fd80-437b-a3fc-3e2ab812faae tempest-ServersTestJSON-85857845 tempest-ServersTestJSON-85857845-project-member] Enqueued Resource ID: 33e8376b-4b98-4aa5-8325-ac1f9953095a with Priority: HIGHEST for action security_group_members [ 1546.176470] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 33e8376b-4b98-4aa5-8325-ac1f9953095a with Priority: HIGHEST for action security_group_members [ 1546.176771] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-33e8376b-4b98-4aa5-8325-ac1f9953095a taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1546.176894] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-33e8376b-4b98-4aa5-8325-ac1f9953095a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1546.176963] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-33e8376b-4b98-4aa5-8325-ac1f9953095a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1546.177177] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-33e8376b-4b98-4aa5-8325-ac1f9953095a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1546.177330] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1546.177429] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1546.177492] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1546.177637] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1546.177722] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1546.177816] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('33e8376b-4b98-4aa5-8325-ac1f9953095a',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1546.371354] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1546.371354] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1546.371354] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1546.371354] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1546.371354] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1546.371354] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 27aee5b6-679c-4e5c-baeb-bebfb0cf1e97 is going to be created. [ 1546.393920] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1546.393920] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1546.394160] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1546.394203] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1546.394365] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1546.402520] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 27aee5b6-679c-4e5c-baeb-bebfb0cf1e97 in Status: UNINITIALIZED for 2s [ 1546.423991] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock network-14 taken with stack trace [, , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1546.424229] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "network-14" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1546.424358] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "network-14" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1546.424623] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "network-14" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1546.424890] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1546.425064] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1546.425188] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1546.425401] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1546.425550] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1546.425761] env[69980]: DEBUG dogpile.cache.region [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] No value present for key: 'zone-id' {{(pid=69980) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1546.425975] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] NeedRegenerationException {{(pid=69980) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1546.426154] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] no value, waiting for create lock {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1546.426237] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] value creation lock acquired {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1546.426351] env[69980]: DEBUG dogpile.cache.region [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] No value present for key: 'zone-id' {{(pid=69980) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1546.426459] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Calling creation function for not-yet-present value {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1546.426596] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1546.443425] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1546.443595] env[69980]: DEBUG dogpile.cache.region [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Cache value generated in 0.017 seconds for key(s): 'zone-id' {{(pid=69980) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1546.443737] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Released creation lock {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1546.443900] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "network-14" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1546.444219] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock port-b4f5309a-8150-4f68-a003-cb22bbe7c0b6 taken with stack trace [, , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1546.444389] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "port-b4f5309a-8150-4f68-a003-cb22bbe7c0b6" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1546.444510] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "port-b4f5309a-8150-4f68-a003-cb22bbe7c0b6" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1546.444809] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "port-b4f5309a-8150-4f68-a003-cb22bbe7c0b6" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1546.444951] env[69980]: DEBUG networking_nsxv3.api.rpc [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b4f5309a-8150-4f68-a003-cb22bbe7c0b6',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1546.683361] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('33e8376b-4b98-4aa5-8325-ac1f9953095a',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1546.948075] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1546.948075] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1546.948075] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1546.948468] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1546.948468] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1546.948544] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Segment Port b4f5309a-8150-4f68-a003-cb22bbe7c0b6 not found, creating... [ 1546.948840] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1546.949025] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1546.949155] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1546.949398] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1546.949525] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1546.949812] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1546.950015] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1546.950154] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1546.950368] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1546.950508] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1546.950652] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Resource: SegmentPort with ID: b4f5309a-8150-4f68-a003-cb22bbe7c0b6 is going to be created. [ 1546.970592] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1546.970776] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1546.970932] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1546.971205] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1546.971426] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1546.971650] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "port-b4f5309a-8150-4f68-a003-cb22bbe7c0b6" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1547.185079] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('33e8376b-4b98-4aa5-8325-ac1f9953095a',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1547.645429] env[69980]: INFO networking_nsxv3.common.synchronization [req-3db38a54-b66b-4b41-95fd-e7f67cef0391 req-84365ccb-26db-480c-8838-b1cb97aecd8a service nova] Enqueued Resource ID: 33e8376b-4b98-4aa5-8325-ac1f9953095a with Priority: HIGHEST for action security_group_rules [ 1547.645617] env[69980]: INFO networking_nsxv3.common.synchronization [req-3db38a54-b66b-4b41-95fd-e7f67cef0391 req-84365ccb-26db-480c-8838-b1cb97aecd8a service nova] Enqueued Resource ID: 33e8376b-4b98-4aa5-8325-ac1f9953095a with Priority: HIGHEST for action security_group_members [ 1547.645754] env[69980]: INFO networking_nsxv3.common.synchronization [req-3db38a54-b66b-4b41-95fd-e7f67cef0391 req-84365ccb-26db-480c-8838-b1cb97aecd8a service nova] Enqueued Resource ID: b4f5309a-8150-4f68-a003-cb22bbe7c0b6 with Priority: HIGHEST for action port [ 1547.645996] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 33e8376b-4b98-4aa5-8325-ac1f9953095a with Priority: HIGHEST for action security_group_rules [ 1547.646134] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 33e8376b-4b98-4aa5-8325-ac1f9953095a with Priority: HIGHEST for action security_group_members [ 1547.646232] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b4f5309a-8150-4f68-a003-cb22bbe7c0b6 with Priority: HIGHEST for action port [ 1547.648272] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock rules-33e8376b-4b98-4aa5-8325-ac1f9953095a taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1547.648401] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-33e8376b-4b98-4aa5-8325-ac1f9953095a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1547.648470] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-33e8376b-4b98-4aa5-8325-ac1f9953095a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1547.648666] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-33e8376b-4b98-4aa5-8325-ac1f9953095a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1547.648746] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('33e8376b-4b98-4aa5-8325-ac1f9953095a',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1547.649598] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-33e8376b-4b98-4aa5-8325-ac1f9953095a taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1547.649692] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-33e8376b-4b98-4aa5-8325-ac1f9953095a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1547.649878] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock port-b4f5309a-8150-4f68-a003-cb22bbe7c0b6 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1547.649978] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b4f5309a-8150-4f68-a003-cb22bbe7c0b6" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1547.650055] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b4f5309a-8150-4f68-a003-cb22bbe7c0b6" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1547.650293] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b4f5309a-8150-4f68-a003-cb22bbe7c0b6" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1547.650393] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b4f5309a-8150-4f68-a003-cb22bbe7c0b6',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1547.686792] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1547.686972] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1547.687023] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1547.687253] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1547.687349] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1547.687445] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 33e8376b-4b98-4aa5-8325-ac1f9953095a is going to be updated. [ 1547.719085] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1547.719221] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1547.719262] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1547.719435] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1547.719567] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1547.727293] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 33e8376b-4b98-4aa5-8325-ac1f9953095a in Status: IN_PROGRESS for 2s [ 1548.152415] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-33e8376b-4b98-4aa5-8325-ac1f9953095a taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1548.152685] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-33e8376b-4b98-4aa5-8325-ac1f9953095a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1548.152760] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b4f5309a-8150-4f68-a003-cb22bbe7c0b6 with status ACTIVE [ 1548.152937] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1548.153059] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1548.153130] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1548.153357] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1548.153444] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1548.153617] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1548.153713] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1548.153776] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1548.153925] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1548.154012] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1548.154194] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1548.154310] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1548.154345] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1548.154479] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1548.154551] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1548.154634] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b4f5309a-8150-4f68-a003-cb22bbe7c0b6 is going to be updated. [ 1548.178933] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1548.179062] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1548.179122] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1548.179286] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1548.179411] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1548.179563] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b4f5309a-8150-4f68-a003-cb22bbe7c0b6" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1548.411540] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 27aee5b6-679c-4e5c-baeb-bebfb0cf1e97 in Status: SUCCESS [ 1548.411706] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-27aee5b6-679c-4e5c-baeb-bebfb0cf1e97" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1548.411881] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-27aee5b6-679c-4e5c-baeb-bebfb0cf1e97" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1548.412125] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-27aee5b6-679c-4e5c-baeb-bebfb0cf1e97" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1548.412318] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1548.412434] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1548.412499] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1548.412653] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1548.412732] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1548.412818] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-27aee5b6-679c-4e5c-baeb-bebfb0cf1e97" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1548.412909] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('27aee5b6-679c-4e5c-baeb-bebfb0cf1e97',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1548.915446] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('27aee5b6-679c-4e5c-baeb-bebfb0cf1e97',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1549.417837] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 27aee5b6-679c-4e5c-baeb-bebfb0cf1e97: rpc.has_security_group_logging(os_id): False [ 1549.434929] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1549.435126] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1549.435216] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1549.435447] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1549.435549] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1549.435829] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1549.435947] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1549.436044] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1549.436217] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1549.436299] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1549.436404] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 27aee5b6-679c-4e5c-baeb-bebfb0cf1e97 is going to be created. [ 1549.500149] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1549.500354] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1549.500412] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1549.500615] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1549.500819] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1549.511140] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 27aee5b6-679c-4e5c-baeb-bebfb0cf1e97 in Status: IN_PROGRESS for 2s [ 1549.737065] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 33e8376b-4b98-4aa5-8325-ac1f9953095a in Status: SUCCESS [ 1549.737378] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-33e8376b-4b98-4aa5-8325-ac1f9953095a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1549.737569] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-33e8376b-4b98-4aa5-8325-ac1f9953095a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1549.737835] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-33e8376b-4b98-4aa5-8325-ac1f9953095a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1549.738082] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1549.738249] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1549.738330] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1549.738551] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1549.738682] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1549.738825] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('33e8376b-4b98-4aa5-8325-ac1f9953095a',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1550.241481] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('33e8376b-4b98-4aa5-8325-ac1f9953095a',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1550.745655] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('33e8376b-4b98-4aa5-8325-ac1f9953095a',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1551.248528] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1551.248814] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1551.248895] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1551.249180] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1551.249325] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1551.249486] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 33e8376b-4b98-4aa5-8325-ac1f9953095a is going to be updated. [ 1551.275025] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1551.275195] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1551.275195] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1551.275405] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1551.275617] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1551.283658] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 33e8376b-4b98-4aa5-8325-ac1f9953095a in Status: IN_PROGRESS for 2s [ 1551.522128] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 27aee5b6-679c-4e5c-baeb-bebfb0cf1e97 in Status: SUCCESS [ 1551.522366] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-27aee5b6-679c-4e5c-baeb-bebfb0cf1e97" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1552.648112] env[69980]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1552.648379] env[69980]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=2 [ 1553.293341] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 33e8376b-4b98-4aa5-8325-ac1f9953095a in Status: SUCCESS [ 1553.293567] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-33e8376b-4b98-4aa5-8325-ac1f9953095a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1553.293731] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-33e8376b-4b98-4aa5-8325-ac1f9953095a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1553.293955] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-33e8376b-4b98-4aa5-8325-ac1f9953095a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1553.294167] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1553.294288] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1553.294351] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1553.294512] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1553.294594] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1553.294685] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-33e8376b-4b98-4aa5-8325-ac1f9953095a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1553.294777] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('33e8376b-4b98-4aa5-8325-ac1f9953095a',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1553.797503] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-33e8376b-4b98-4aa5-8325-ac1f9953095a taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1553.797875] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-33e8376b-4b98-4aa5-8325-ac1f9953095a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1553.797875] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-33e8376b-4b98-4aa5-8325-ac1f9953095a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1553.797961] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-33e8376b-4b98-4aa5-8325-ac1f9953095a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1553.798124] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1553.798229] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1553.798294] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1553.798451] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1553.798540] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1553.798630] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-33e8376b-4b98-4aa5-8325-ac1f9953095a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1553.798780] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-33e8376b-4b98-4aa5-8325-ac1f9953095a taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1553.798959] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-33e8376b-4b98-4aa5-8325-ac1f9953095a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1553.798959] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-33e8376b-4b98-4aa5-8325-ac1f9953095a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1553.799125] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-33e8376b-4b98-4aa5-8325-ac1f9953095a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1553.799264] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1553.799354] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1553.799413] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1553.799563] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1553.799639] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1553.799722] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-33e8376b-4b98-4aa5-8325-ac1f9953095a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1553.799812] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('33e8376b-4b98-4aa5-8325-ac1f9953095a',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1554.301693] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 33e8376b-4b98-4aa5-8325-ac1f9953095a: rpc.has_security_group_logging(os_id): False [ 1554.317939] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1554.318120] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1554.318161] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1554.318359] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1554.318440] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1554.318633] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1554.318731] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1554.318801] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1554.318973] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1554.319071] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1554.319286] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1554.319386] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1554.319444] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1554.319574] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1554.319650] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1554.319829] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1554.319922] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1554.319987] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1554.320149] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1554.320222] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1554.320302] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 33e8376b-4b98-4aa5-8325-ac1f9953095a is going to be updated. [ 1554.376582] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1554.376754] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1554.376787] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1554.376980] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1554.377146] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1554.392700] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 33e8376b-4b98-4aa5-8325-ac1f9953095a in Status: IN_PROGRESS for 2s [ 1556.409961] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 33e8376b-4b98-4aa5-8325-ac1f9953095a in Status: SUCCESS [ 1556.410327] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-33e8376b-4b98-4aa5-8325-ac1f9953095a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1557.649475] env[69980]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1557.649764] env[69980]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1560.491969] env[69980]: INFO networking_nsxv3.common.synchronization [req-4acbf738-84a8-4ff2-9f71-d77be97469f7 req-69af85b3-3edb-40c5-85cf-6d5fb6682785 tempest-ServersTestJSON-85857845 tempest-ServersTestJSON-85857845-project-member] Enqueued Resource ID: 33e8376b-4b98-4aa5-8325-ac1f9953095a with Priority: HIGHEST for action security_group_members [ 1560.492567] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 33e8376b-4b98-4aa5-8325-ac1f9953095a with Priority: HIGHEST for action security_group_members [ 1560.493335] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-33e8376b-4b98-4aa5-8325-ac1f9953095a taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1560.493461] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-33e8376b-4b98-4aa5-8325-ac1f9953095a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1560.493530] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-33e8376b-4b98-4aa5-8325-ac1f9953095a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1560.493732] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-33e8376b-4b98-4aa5-8325-ac1f9953095a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1560.493886] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1560.493991] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1560.494061] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1560.494191] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1560.494276] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1560.494372] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('33e8376b-4b98-4aa5-8325-ac1f9953095a',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1560.999143] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('33e8376b-4b98-4aa5-8325-ac1f9953095a',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1561.501351] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('33e8376b-4b98-4aa5-8325-ac1f9953095a',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1562.003557] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1562.003713] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1562.003791] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1562.004017] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1562.004120] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1562.004228] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 33e8376b-4b98-4aa5-8325-ac1f9953095a is going to be updated. [ 1562.033810] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1562.034432] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1562.034432] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1562.034432] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1562.034432] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1562.042445] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 33e8376b-4b98-4aa5-8325-ac1f9953095a in Status: IN_PROGRESS for 2s [ 1564.053887] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 33e8376b-4b98-4aa5-8325-ac1f9953095a in Status: SUCCESS [ 1564.054232] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-33e8376b-4b98-4aa5-8325-ac1f9953095a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1565.493951] env[69980]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1565.494280] env[69980]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1566.714771] env[69980]: INFO networking_nsxv3.common.synchronization [req-739e48cd-66f5-4cce-b2bc-76e6a0885689 req-d0ec62cf-af50-415a-b3b6-5703734cc4ce tempest-ServersTestJSON-85857845 tempest-ServersTestJSON-85857845-project-member] Enqueued Resource ID: 33e8376b-4b98-4aa5-8325-ac1f9953095a with Priority: HIGHEST for action security_group_members [ 1566.715337] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 33e8376b-4b98-4aa5-8325-ac1f9953095a with Priority: HIGHEST for action security_group_members [ 1566.716214] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-33e8376b-4b98-4aa5-8325-ac1f9953095a taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1566.716214] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-33e8376b-4b98-4aa5-8325-ac1f9953095a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1566.716214] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-33e8376b-4b98-4aa5-8325-ac1f9953095a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1566.716214] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-33e8376b-4b98-4aa5-8325-ac1f9953095a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1566.716468] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1566.716468] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1566.716468] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1566.716619] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1566.716688] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1566.716778] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('33e8376b-4b98-4aa5-8325-ac1f9953095a',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1567.220027] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1567.220027] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1567.220027] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1567.220027] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1567.220266] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1567.220266] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1567.220434] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1567.220434] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1567.220776] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1567.220776] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1567.220776] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 33e8376b-4b98-4aa5-8325-ac1f9953095a is going to be updated. [ 1567.248523] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1567.248523] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1567.248523] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1567.248724] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1567.248838] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1567.256309] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 33e8376b-4b98-4aa5-8325-ac1f9953095a in Status: IN_PROGRESS for 2s [ 1569.267388] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 33e8376b-4b98-4aa5-8325-ac1f9953095a in Status: SUCCESS [ 1569.267388] env[69980]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 33e8376b-4b98-4aa5-8325-ac1f9953095a deletion is rescheduled due to dependency. [ 1569.267675] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-33e8376b-4b98-4aa5-8325-ac1f9953095a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1571.716350] env[69980]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1571.716758] env[69980]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1576.717980] env[69980]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1576.718318] env[69980]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1581.719197] env[69980]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1581.719513] env[69980]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1586.720786] env[69980]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1586.721124] env[69980]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1591.668324] env[69980]: INFO networking_nsxv3.common.synchronization [req-3bafb741-e046-4c76-b33a-72de7311f65b req-36fc3946-9e2a-47a1-964e-604643290f95 tempest-AttachVolumeNegativeTest-1885261294 tempest-AttachVolumeNegativeTest-1885261294-project-member] Enqueued Resource ID: 27aee5b6-679c-4e5c-baeb-bebfb0cf1e97 with Priority: HIGHEST for action security_group_members [ 1591.669213] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 27aee5b6-679c-4e5c-baeb-bebfb0cf1e97 with Priority: HIGHEST for action security_group_members [ 1591.669745] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-27aee5b6-679c-4e5c-baeb-bebfb0cf1e97 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1591.669986] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-27aee5b6-679c-4e5c-baeb-bebfb0cf1e97" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1591.670090] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-27aee5b6-679c-4e5c-baeb-bebfb0cf1e97" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1591.670344] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-27aee5b6-679c-4e5c-baeb-bebfb0cf1e97" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1591.670568] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1591.670729] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1591.670844] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1591.671063] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1591.671156] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1591.671245] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('27aee5b6-679c-4e5c-baeb-bebfb0cf1e97',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1592.173984] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1592.174156] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1592.174271] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1592.174512] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1592.174632] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1592.174864] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1592.174980] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1592.175074] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1592.175247] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1592.175356] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1592.175457] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 27aee5b6-679c-4e5c-baeb-bebfb0cf1e97 is going to be updated. [ 1592.201503] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1592.201653] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1592.201693] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1592.201838] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1592.201984] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1592.209640] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 27aee5b6-679c-4e5c-baeb-bebfb0cf1e97 in Status: IN_PROGRESS for 2s [ 1594.220444] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 27aee5b6-679c-4e5c-baeb-bebfb0cf1e97 in Status: SUCCESS [ 1594.220787] env[69980]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 27aee5b6-679c-4e5c-baeb-bebfb0cf1e97 deletion is rescheduled due to dependency. [ 1594.220787] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-27aee5b6-679c-4e5c-baeb-bebfb0cf1e97" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1596.670832] env[69980]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1596.671228] env[69980]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1601.671874] env[69980]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1601.672154] env[69980]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1602.902350] env[69980]: INFO networking_nsxv3.common.synchronization [req-feb57216-4045-4ad0-93c3-daa5aaddaa84 req-3c7a240a-c34b-4312-bf3c-b1ba86760b81 tempest-AttachVolumeNegativeTest-1885261294 tempest-AttachVolumeNegativeTest-1885261294-project-member] Enqueued Resource ID: 1629967c-76d1-4b7e-a365-0305af6dc147 with Priority: HIGHEST for action security_group_members [ 1602.902871] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1629967c-76d1-4b7e-a365-0305af6dc147 with Priority: HIGHEST for action security_group_members [ 1602.903312] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-1629967c-76d1-4b7e-a365-0305af6dc147 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1602.903455] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1629967c-76d1-4b7e-a365-0305af6dc147" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1602.903954] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1629967c-76d1-4b7e-a365-0305af6dc147" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1602.903954] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1629967c-76d1-4b7e-a365-0305af6dc147" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1602.903954] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1602.904225] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1602.904225] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1602.904285] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1602.904380] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1602.904440] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1629967c-76d1-4b7e-a365-0305af6dc147',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1603.406524] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1603.406688] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1603.406763] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1603.406980] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1603.407095] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1603.407295] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1603.407396] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1603.407462] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1603.407613] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1603.407693] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1603.407780] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1629967c-76d1-4b7e-a365-0305af6dc147 is going to be updated. [ 1603.438774] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1603.438935] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1603.438935] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1603.439172] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1603.439321] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1603.448216] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1629967c-76d1-4b7e-a365-0305af6dc147 in Status: IN_PROGRESS for 2s [ 1605.459267] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1629967c-76d1-4b7e-a365-0305af6dc147 in Status: SUCCESS [ 1605.459594] env[69980]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1629967c-76d1-4b7e-a365-0305af6dc147 deletion is rescheduled due to dependency. [ 1605.459594] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1629967c-76d1-4b7e-a365-0305af6dc147" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1607.696727] env[69980]: INFO networking_nsxv3.common.synchronization [None req-e6066165-2ffb-4223-9c39-6d91983ed723 tempest-AttachVolumeNegativeTest-1885261294 tempest-AttachVolumeNegativeTest-1885261294-project-member] Enqueued Resource ID: ab85228d-7c6a-46c1-be82-5f17e49ba685 with Priority: HIGHEST for action security_group_rules [ 1607.697271] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ab85228d-7c6a-46c1-be82-5f17e49ba685 with Priority: HIGHEST for action security_group_rules [ 1607.697577] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ab85228d-7c6a-46c1-be82-5f17e49ba685 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1607.697700] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ab85228d-7c6a-46c1-be82-5f17e49ba685" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1607.697771] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ab85228d-7c6a-46c1-be82-5f17e49ba685" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1607.698039] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ab85228d-7c6a-46c1-be82-5f17e49ba685" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1607.698127] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ab85228d-7c6a-46c1-be82-5f17e49ba685',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1607.760588] env[69980]: INFO networking_nsxv3.common.synchronization [None req-44bb7c77-00d6-4ba2-bcb1-96811a187805 tempest-AttachVolumeNegativeTest-1885261294 tempest-AttachVolumeNegativeTest-1885261294-project-member] Enqueued Resource ID: ab85228d-7c6a-46c1-be82-5f17e49ba685 with Priority: HIGHEST for action security_group_rules [ 1607.760588] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ab85228d-7c6a-46c1-be82-5f17e49ba685 with Priority: HIGHEST for action security_group_rules [ 1607.761700] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ab85228d-7c6a-46c1-be82-5f17e49ba685 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1607.761700] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ab85228d-7c6a-46c1-be82-5f17e49ba685" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1608.217470] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1608.217657] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1608.217741] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1608.217939] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1608.218064] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1608.218152] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ab85228d-7c6a-46c1-be82-5f17e49ba685 already deleted. [ 1608.218241] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ab85228d-7c6a-46c1-be82-5f17e49ba685" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1608.218384] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ab85228d-7c6a-46c1-be82-5f17e49ba685" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1608.218542] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ab85228d-7c6a-46c1-be82-5f17e49ba685" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1608.218627] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ab85228d-7c6a-46c1-be82-5f17e49ba685',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1608.737129] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1608.737487] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1608.737487] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1608.737487] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1608.737578] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1608.737672] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ab85228d-7c6a-46c1-be82-5f17e49ba685 already deleted. [ 1608.737773] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ab85228d-7c6a-46c1-be82-5f17e49ba685" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1612.761368] env[69980]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1612.761789] env[69980]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1612.917515] env[69980]: INFO networking_nsxv3.common.synchronization [req-22861068-9ffe-4932-bec7-52ca508d1f93 req-c12e4421-7101-4957-ac4b-0878dad439fd tempest-AttachVolumeNegativeTest-1885261294 tempest-AttachVolumeNegativeTest-1885261294-project-member] Enqueued Resource ID: ab85228d-7c6a-46c1-be82-5f17e49ba685 with Priority: HIGHEST for action security_group_members [ 1612.917946] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ab85228d-7c6a-46c1-be82-5f17e49ba685 with Priority: HIGHEST for action security_group_members [ 1612.918274] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-ab85228d-7c6a-46c1-be82-5f17e49ba685 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1612.918395] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ab85228d-7c6a-46c1-be82-5f17e49ba685" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1612.918460] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ab85228d-7c6a-46c1-be82-5f17e49ba685" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1612.918712] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ab85228d-7c6a-46c1-be82-5f17e49ba685" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1612.918866] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1612.918964] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1612.919046] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1612.919205] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1612.919291] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1612.919401] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ab85228d-7c6a-46c1-be82-5f17e49ba685',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1613.157795] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock network-820 taken with stack trace [, , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1613.158038] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "network-820" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1613.158196] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "network-820" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1613.158495] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "network-820" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1613.158759] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1613.158921] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1613.159059] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1613.159280] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1613.159428] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1613.159661] env[69980]: DEBUG dogpile.cache.region [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] No value present for key: 'zone-id' {{(pid=69980) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1613.159779] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] NeedRegenerationException {{(pid=69980) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1613.159892] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] no value, waiting for create lock {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1613.160015] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] value creation lock acquired {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1613.160141] env[69980]: DEBUG dogpile.cache.region [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] No value present for key: 'zone-id' {{(pid=69980) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1613.160251] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Calling creation function for not-yet-present value {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1613.160386] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1613.180898] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1613.181061] env[69980]: DEBUG dogpile.cache.region [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=69980) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1613.181224] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Released creation lock {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1613.181393] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "network-820" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1613.181722] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock port-7f4137c9-2ad1-4664-8c97-409cd1c8ec3a taken with stack trace [, , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1613.182263] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "port-7f4137c9-2ad1-4664-8c97-409cd1c8ec3a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1613.182263] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "port-7f4137c9-2ad1-4664-8c97-409cd1c8ec3a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1613.182422] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "port-7f4137c9-2ad1-4664-8c97-409cd1c8ec3a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1613.182422] env[69980]: DEBUG networking_nsxv3.api.rpc [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7f4137c9-2ad1-4664-8c97-409cd1c8ec3a',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1613.420946] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1613.421121] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1613.421181] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1613.421384] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1613.421492] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1613.421705] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1613.421792] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1613.421856] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1613.421998] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1613.422089] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1613.422179] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ab85228d-7c6a-46c1-be82-5f17e49ba685 already deleted. [ 1613.422246] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ab85228d-7c6a-46c1-be82-5f17e49ba685" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1613.684731] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1613.684979] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1613.685124] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1613.685405] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1613.685574] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1613.685742] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Segment Port 7f4137c9-2ad1-4664-8c97-409cd1c8ec3a not found, creating... [ 1613.686014] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1613.686183] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1613.686305] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1613.686525] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1613.686669] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1613.686985] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1613.687164] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1613.687286] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1613.687489] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1613.687629] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1613.687770] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Resource: SegmentPort with ID: 7f4137c9-2ad1-4664-8c97-409cd1c8ec3a is going to be created. [ 1613.707810] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1613.707810] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1613.707981] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1613.708178] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1613.708403] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1613.708616] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "port-7f4137c9-2ad1-4664-8c97-409cd1c8ec3a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1614.364138] env[69980]: INFO networking_nsxv3.common.synchronization [req-22861068-9ffe-4932-bec7-52ca508d1f93 req-a29dded0-a30b-45eb-8532-9881b38f4d6b service nova] Enqueued Resource ID: ab85228d-7c6a-46c1-be82-5f17e49ba685 with Priority: HIGHEST for action security_group_rules [ 1614.364380] env[69980]: INFO networking_nsxv3.common.synchronization [req-22861068-9ffe-4932-bec7-52ca508d1f93 req-a29dded0-a30b-45eb-8532-9881b38f4d6b service nova] Enqueued Resource ID: ab85228d-7c6a-46c1-be82-5f17e49ba685 with Priority: HIGHEST for action security_group_members [ 1614.364471] env[69980]: INFO networking_nsxv3.common.synchronization [req-22861068-9ffe-4932-bec7-52ca508d1f93 req-a29dded0-a30b-45eb-8532-9881b38f4d6b service nova] Enqueued Resource ID: 7f4137c9-2ad1-4664-8c97-409cd1c8ec3a with Priority: HIGHEST for action port [ 1614.364688] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ab85228d-7c6a-46c1-be82-5f17e49ba685 with Priority: HIGHEST for action security_group_rules [ 1614.364814] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ab85228d-7c6a-46c1-be82-5f17e49ba685 with Priority: HIGHEST for action security_group_members [ 1614.364909] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7f4137c9-2ad1-4664-8c97-409cd1c8ec3a with Priority: HIGHEST for action port [ 1614.365449] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ab85228d-7c6a-46c1-be82-5f17e49ba685 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1614.365577] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ab85228d-7c6a-46c1-be82-5f17e49ba685" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1614.365648] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ab85228d-7c6a-46c1-be82-5f17e49ba685" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1614.365952] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ab85228d-7c6a-46c1-be82-5f17e49ba685" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1614.366053] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ab85228d-7c6a-46c1-be82-5f17e49ba685',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1614.366870] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-ab85228d-7c6a-46c1-be82-5f17e49ba685 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1614.366981] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ab85228d-7c6a-46c1-be82-5f17e49ba685" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1614.367060] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ab85228d-7c6a-46c1-be82-5f17e49ba685" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1614.367232] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ab85228d-7c6a-46c1-be82-5f17e49ba685" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1614.367404] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1614.367495] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1614.367558] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1614.367703] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1614.367789] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1614.367872] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ab85228d-7c6a-46c1-be82-5f17e49ba685',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1614.368843] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock port-7f4137c9-2ad1-4664-8c97-409cd1c8ec3a taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1614.368960] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7f4137c9-2ad1-4664-8c97-409cd1c8ec3a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1614.369040] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7f4137c9-2ad1-4664-8c97-409cd1c8ec3a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1614.369194] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7f4137c9-2ad1-4664-8c97-409cd1c8ec3a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1614.369268] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7f4137c9-2ad1-4664-8c97-409cd1c8ec3a',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1614.870965] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-ab85228d-7c6a-46c1-be82-5f17e49ba685 taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1614.871126] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ab85228d-7c6a-46c1-be82-5f17e49ba685" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1614.871335] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ab85228d-7c6a-46c1-be82-5f17e49ba685',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1614.872619] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 7f4137c9-2ad1-4664-8c97-409cd1c8ec3a with status ACTIVE [ 1614.872781] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1614.872923] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1614.873024] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1614.873226] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1614.873365] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1614.873568] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1614.873669] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1614.873728] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1614.873878] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1614.873957] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1614.874167] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1614.874263] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1614.874326] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1614.874465] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1614.874542] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1614.874638] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 7f4137c9-2ad1-4664-8c97-409cd1c8ec3a is going to be updated. [ 1614.895050] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1614.895158] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1614.895229] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1614.895379] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1614.895498] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1614.895646] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7f4137c9-2ad1-4664-8c97-409cd1c8ec3a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1615.376462] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ab85228d-7c6a-46c1-be82-5f17e49ba685',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1615.879868] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1615.880119] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1615.880119] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1615.880343] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1615.880435] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1615.880536] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ab85228d-7c6a-46c1-be82-5f17e49ba685 is going to be created. [ 1615.902362] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1615.902496] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1615.902563] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1615.902727] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1615.902881] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1615.910721] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ab85228d-7c6a-46c1-be82-5f17e49ba685 in Status: UNINITIALIZED for 2s [ 1617.921619] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ab85228d-7c6a-46c1-be82-5f17e49ba685 in Status: SUCCESS [ 1617.921945] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ab85228d-7c6a-46c1-be82-5f17e49ba685" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1617.922023] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ab85228d-7c6a-46c1-be82-5f17e49ba685" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1617.922191] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ab85228d-7c6a-46c1-be82-5f17e49ba685" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1617.922386] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1617.922509] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1617.922574] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1617.922722] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1617.922806] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1617.922893] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ab85228d-7c6a-46c1-be82-5f17e49ba685" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1617.922983] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ab85228d-7c6a-46c1-be82-5f17e49ba685',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1618.425143] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ab85228d-7c6a-46c1-be82-5f17e49ba685',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1618.927364] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ab85228d-7c6a-46c1-be82-5f17e49ba685: rpc.has_security_group_logging(os_id): False [ 1618.943948] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1618.944175] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1618.944175] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1618.944356] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1618.944445] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1618.944706] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1618.944822] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1618.944882] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1618.945058] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1618.945138] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1618.945228] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ab85228d-7c6a-46c1-be82-5f17e49ba685 is going to be created. [ 1618.995863] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1618.995979] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1618.996062] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1618.996233] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1618.996400] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1619.007470] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ab85228d-7c6a-46c1-be82-5f17e49ba685 in Status: IN_PROGRESS for 2s [ 1619.366252] env[69980]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1619.366429] env[69980]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1621.020681] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ab85228d-7c6a-46c1-be82-5f17e49ba685 in Status: SUCCESS [ 1621.021063] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ab85228d-7c6a-46c1-be82-5f17e49ba685" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1624.367458] env[69980]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1624.367862] env[69980]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1629.368410] env[69980]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1629.368750] env[69980]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1629.467019] env[69980]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-977287c2-69f8-47e1-8dff-764e9cba9a38 None None] NSXv3 Agent Agent loop - iteration:3 completed [ 1629.467157] env[69980]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-977287c2-69f8-47e1-8dff-764e9cba9a38 None None] NSXv3 Agent Agent loop - iteration:4 started [ 1634.369926] env[69980]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1634.370388] env[69980]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1639.370867] env[69980]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1639.371273] env[69980]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1644.372264] env[69980]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1644.372601] env[69980]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1648.426096] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1648.426539] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1648.426539] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1648.426539] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1648.426631] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1648.928935] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1649.372866] env[69980]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1649.373099] env[69980]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1649.431582] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1649.933834] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 1649.933986] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 1650.606342] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1650.606777] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1650.606777] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1650.606777] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1650.619205] env[69980]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 1650.620627] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1650.621908] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 1650.657171] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1650.657339] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1650.657381] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1650.657543] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1650.669220] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1650.669897] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 1650.669977] env[69980]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=69980) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1650.670079] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 1650.697609] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1650.697750] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1650.697790] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1650.697963] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1650.698669] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1650.698799] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 1650.775533] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1650.775732] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1650.775842] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1650.776139] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1650.776567] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1650.776824] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 1650.841166] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1650.841327] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1650.841366] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1650.841564] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1650.841850] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1650.842152] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:26. [ 1650.842245] env[69980]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:{'23fa8e46-c46e-429c-b533-b6ee73936de0', '27aee5b6-679c-4e5c-baeb-bebfb0cf1e97', '00f20236-2b69-46dc-a00f-0c4d6b93c17a', '07d8236a-b9f2-429a-9942-e7cb46920213', 'f0f521c8-595e-4f1b-a139-3ce8948484da', 'f2b778ac-011d-472f-9220-d8d50a881380', '162065c3-9db0-41c8-9437-c51716e30968', 'b472d7ce-a3a7-4859-8fa3-f222ee058e66', '1629967c-76d1-4b7e-a365-0305af6dc147', '2961e549-f7d2-46b0-a1f4-9365d96bb58a', 'ab85228d-7c6a-46c1-be82-5f17e49ba685', 'bb697495-b311-499b-98c5-fa0133350846', '48dd2a84-68ac-43c8-a7e2-4cb28bb82546', '825b0052-8bd1-4107-8258-075804cbc484', '33e8376b-4b98-4aa5-8325-ac1f9953095a', '9057c45b-1d82-49a9-8ffb-aaf0cddf5801', '6719a83d-3363-4339-a277-6e1ec27ec7bc', '832bb529-72a6-428e-bdd7-50f804872365', '4eb0fe0d-cd04-4189-9b26-953ab87885bd', '400b642e-7f7e-4993-9916-a3e96af018da', '462431af-62e3-426c-a50e-a61604f20358', '700dc02a-f3c2-4363-9a0e-d7cdcb13a5b8', '194841ae-0965-407f-a2bf-6d1f7693c801', '241bcad9-5919-4c26-b0b9-beb6a98733bd', 'd696a1d3-1fa9-4790-b673-19d262f97699', 'e63cb46c-ccab-4856-bf25-2380514e2780'} {{(pid=69980) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1650.842322] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 1650.859425] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1650.859541] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1650.859575] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1650.860945] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1650.860945] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1650.860945] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 1650.860945] env[69980]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=69980) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1650.860945] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 1650.925890] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1650.926056] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1650.926111] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1650.926391] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1650.927483] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1650.927733] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 1650.927814] env[69980]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=69980) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1650.927888] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 1650.927958] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 1650.928049] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 20/26 resources of Type:Security Group Rules [ 1650.928123] env[69980]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 23fa8e46-c46e-429c-b533-b6ee73936de0 with Priority: HIGH for action security_group_rules [ 1650.928200] env[69980]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 27aee5b6-679c-4e5c-baeb-bebfb0cf1e97 with Priority: HIGH for action security_group_rules [ 1650.928267] env[69980]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 00f20236-2b69-46dc-a00f-0c4d6b93c17a with Priority: HIGH for action security_group_rules [ 1650.928330] env[69980]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 07d8236a-b9f2-429a-9942-e7cb46920213 with Priority: HIGH for action security_group_rules [ 1650.928392] env[69980]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: f0f521c8-595e-4f1b-a139-3ce8948484da with Priority: HIGH for action security_group_rules [ 1650.928453] env[69980]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: f2b778ac-011d-472f-9220-d8d50a881380 with Priority: HIGH for action security_group_rules [ 1650.928512] env[69980]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 162065c3-9db0-41c8-9437-c51716e30968 with Priority: HIGH for action security_group_rules [ 1650.928573] env[69980]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: b472d7ce-a3a7-4859-8fa3-f222ee058e66 with Priority: HIGH for action security_group_rules [ 1650.928634] env[69980]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 1629967c-76d1-4b7e-a365-0305af6dc147 with Priority: HIGH for action security_group_rules [ 1650.928694] env[69980]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 2961e549-f7d2-46b0-a1f4-9365d96bb58a with Priority: HIGH for action security_group_rules [ 1650.928753] env[69980]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: ab85228d-7c6a-46c1-be82-5f17e49ba685 with Priority: HIGH for action security_group_rules [ 1650.928814] env[69980]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: bb697495-b311-499b-98c5-fa0133350846 with Priority: HIGH for action security_group_rules [ 1650.928872] env[69980]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 48dd2a84-68ac-43c8-a7e2-4cb28bb82546 with Priority: HIGH for action security_group_rules [ 1650.928940] env[69980]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 825b0052-8bd1-4107-8258-075804cbc484 with Priority: HIGH for action security_group_rules [ 1650.929034] env[69980]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 33e8376b-4b98-4aa5-8325-ac1f9953095a with Priority: HIGH for action security_group_rules [ 1650.929104] env[69980]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 9057c45b-1d82-49a9-8ffb-aaf0cddf5801 with Priority: HIGH for action security_group_rules [ 1650.929166] env[69980]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 6719a83d-3363-4339-a277-6e1ec27ec7bc with Priority: HIGH for action security_group_rules [ 1650.929230] env[69980]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 832bb529-72a6-428e-bdd7-50f804872365 with Priority: HIGH for action security_group_rules [ 1650.929294] env[69980]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 4eb0fe0d-cd04-4189-9b26-953ab87885bd with Priority: HIGH for action security_group_rules [ 1650.929351] env[69980]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 400b642e-7f7e-4993-9916-a3e96af018da with Priority: HIGH for action security_group_rules [ 1650.929445] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1654.373915] env[69980]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1654.374374] env[69980]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=20], Jobs=0 [ 1654.374374] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 23fa8e46-c46e-429c-b533-b6ee73936de0 with Priority: HIGH for action security_group_rules [ 1654.374374] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 00f20236-2b69-46dc-a00f-0c4d6b93c17a with Priority: HIGH for action security_group_rules [ 1654.374374] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 162065c3-9db0-41c8-9437-c51716e30968 with Priority: HIGH for action security_group_rules [ 1654.374567] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 33e8376b-4b98-4aa5-8325-ac1f9953095a with Priority: HIGH for action security_group_rules [ 1654.374567] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 400b642e-7f7e-4993-9916-a3e96af018da with Priority: HIGH for action security_group_rules [ 1654.374679] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4eb0fe0d-cd04-4189-9b26-953ab87885bd with Priority: HIGH for action security_group_rules [ 1654.374727] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 832bb529-72a6-428e-bdd7-50f804872365 with Priority: HIGH for action security_group_rules [ 1654.374817] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6719a83d-3363-4339-a277-6e1ec27ec7bc with Priority: HIGH for action security_group_rules [ 1654.374908] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 825b0052-8bd1-4107-8258-075804cbc484 with Priority: HIGH for action security_group_rules [ 1654.374996] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9057c45b-1d82-49a9-8ffb-aaf0cddf5801 with Priority: HIGH for action security_group_rules [ 1654.375098] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 48dd2a84-68ac-43c8-a7e2-4cb28bb82546 with Priority: HIGH for action security_group_rules [ 1654.375186] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bb697495-b311-499b-98c5-fa0133350846 with Priority: HIGH for action security_group_rules [ 1654.375270] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ab85228d-7c6a-46c1-be82-5f17e49ba685 with Priority: HIGH for action security_group_rules [ 1654.375354] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2961e549-f7d2-46b0-a1f4-9365d96bb58a with Priority: HIGH for action security_group_rules [ 1654.375440] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1629967c-76d1-4b7e-a365-0305af6dc147 with Priority: HIGH for action security_group_rules [ 1654.375525] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f2b778ac-011d-472f-9220-d8d50a881380 with Priority: HIGH for action security_group_rules [ 1654.375609] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b472d7ce-a3a7-4859-8fa3-f222ee058e66 with Priority: HIGH for action security_group_rules [ 1654.375696] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f0f521c8-595e-4f1b-a139-3ce8948484da with Priority: HIGH for action security_group_rules [ 1654.375778] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 27aee5b6-679c-4e5c-baeb-bebfb0cf1e97 with Priority: HIGH for action security_group_rules [ 1654.375861] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 07d8236a-b9f2-429a-9942-e7cb46920213 with Priority: HIGH for action security_group_rules [ 1654.376223] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock rules-23fa8e46-c46e-429c-b533-b6ee73936de0 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1654.376357] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-23fa8e46-c46e-429c-b533-b6ee73936de0" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1654.376423] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-23fa8e46-c46e-429c-b533-b6ee73936de0" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1654.376638] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-23fa8e46-c46e-429c-b533-b6ee73936de0" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1654.376722] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('23fa8e46-c46e-429c-b533-b6ee73936de0',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1654.377744] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock rules-00f20236-2b69-46dc-a00f-0c4d6b93c17a taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1654.377873] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-00f20236-2b69-46dc-a00f-0c4d6b93c17a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1654.377942] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-00f20236-2b69-46dc-a00f-0c4d6b93c17a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1654.378162] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-00f20236-2b69-46dc-a00f-0c4d6b93c17a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1654.378278] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('00f20236-2b69-46dc-a00f-0c4d6b93c17a',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1654.496902] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock rules-162065c3-9db0-41c8-9437-c51716e30968 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1654.497108] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-162065c3-9db0-41c8-9437-c51716e30968" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1654.497108] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-162065c3-9db0-41c8-9437-c51716e30968" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1654.497294] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-162065c3-9db0-41c8-9437-c51716e30968" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1654.497370] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('162065c3-9db0-41c8-9437-c51716e30968',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1654.498180] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock rules-33e8376b-4b98-4aa5-8325-ac1f9953095a taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1654.498304] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-33e8376b-4b98-4aa5-8325-ac1f9953095a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1654.498356] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-33e8376b-4b98-4aa5-8325-ac1f9953095a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1654.498511] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-33e8376b-4b98-4aa5-8325-ac1f9953095a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1654.498590] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('33e8376b-4b98-4aa5-8325-ac1f9953095a',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1654.499472] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock rules-400b642e-7f7e-4993-9916-a3e96af018da taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1654.499472] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-400b642e-7f7e-4993-9916-a3e96af018da" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1654.499472] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-400b642e-7f7e-4993-9916-a3e96af018da" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1654.499583] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-400b642e-7f7e-4993-9916-a3e96af018da" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1654.499612] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('400b642e-7f7e-4993-9916-a3e96af018da',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1654.500316] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4eb0fe0d-cd04-4189-9b26-953ab87885bd taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1654.500421] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4eb0fe0d-cd04-4189-9b26-953ab87885bd" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1654.500486] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4eb0fe0d-cd04-4189-9b26-953ab87885bd" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1654.500631] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4eb0fe0d-cd04-4189-9b26-953ab87885bd" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1654.500701] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4eb0fe0d-cd04-4189-9b26-953ab87885bd',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1654.501417] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock rules-832bb529-72a6-428e-bdd7-50f804872365 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1654.501538] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-832bb529-72a6-428e-bdd7-50f804872365" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1654.501605] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-832bb529-72a6-428e-bdd7-50f804872365" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1654.501755] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-832bb529-72a6-428e-bdd7-50f804872365" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1654.501827] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('832bb529-72a6-428e-bdd7-50f804872365',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1654.502507] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6719a83d-3363-4339-a277-6e1ec27ec7bc taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1654.502655] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6719a83d-3363-4339-a277-6e1ec27ec7bc" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1654.502714] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6719a83d-3363-4339-a277-6e1ec27ec7bc" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1654.502817] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6719a83d-3363-4339-a277-6e1ec27ec7bc" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1654.502893] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6719a83d-3363-4339-a277-6e1ec27ec7bc',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1654.503607] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock rules-825b0052-8bd1-4107-8258-075804cbc484 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1654.503715] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-825b0052-8bd1-4107-8258-075804cbc484" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1654.503781] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-825b0052-8bd1-4107-8258-075804cbc484" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1654.503943] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-825b0052-8bd1-4107-8258-075804cbc484" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1654.504028] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('825b0052-8bd1-4107-8258-075804cbc484',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1654.504674] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9057c45b-1d82-49a9-8ffb-aaf0cddf5801 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1654.504777] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9057c45b-1d82-49a9-8ffb-aaf0cddf5801" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1654.504843] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9057c45b-1d82-49a9-8ffb-aaf0cddf5801" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1654.504990] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9057c45b-1d82-49a9-8ffb-aaf0cddf5801" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1654.505076] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9057c45b-1d82-49a9-8ffb-aaf0cddf5801',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1654.505703] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock rules-48dd2a84-68ac-43c8-a7e2-4cb28bb82546 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1654.505832] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-48dd2a84-68ac-43c8-a7e2-4cb28bb82546" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1654.505903] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-48dd2a84-68ac-43c8-a7e2-4cb28bb82546" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1654.506516] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-48dd2a84-68ac-43c8-a7e2-4cb28bb82546" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1654.506624] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('48dd2a84-68ac-43c8-a7e2-4cb28bb82546',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1654.507397] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock rules-bb697495-b311-499b-98c5-fa0133350846 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1654.507510] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-bb697495-b311-499b-98c5-fa0133350846" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1654.507577] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-bb697495-b311-499b-98c5-fa0133350846" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1654.507725] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-bb697495-b311-499b-98c5-fa0133350846" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1654.507795] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('bb697495-b311-499b-98c5-fa0133350846',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1654.508547] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ab85228d-7c6a-46c1-be82-5f17e49ba685 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1654.508686] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ab85228d-7c6a-46c1-be82-5f17e49ba685" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1654.508755] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ab85228d-7c6a-46c1-be82-5f17e49ba685" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1654.508902] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ab85228d-7c6a-46c1-be82-5f17e49ba685" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1654.508974] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ab85228d-7c6a-46c1-be82-5f17e49ba685',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1654.509751] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2961e549-f7d2-46b0-a1f4-9365d96bb58a taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1654.509892] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2961e549-f7d2-46b0-a1f4-9365d96bb58a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1654.510042] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2961e549-f7d2-46b0-a1f4-9365d96bb58a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1654.510206] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2961e549-f7d2-46b0-a1f4-9365d96bb58a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1654.510280] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2961e549-f7d2-46b0-a1f4-9365d96bb58a',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1654.511203] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1629967c-76d1-4b7e-a365-0305af6dc147 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1654.511482] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1629967c-76d1-4b7e-a365-0305af6dc147" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1654.511590] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1629967c-76d1-4b7e-a365-0305af6dc147" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1654.511798] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1629967c-76d1-4b7e-a365-0305af6dc147" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1654.511918] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1629967c-76d1-4b7e-a365-0305af6dc147',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1654.513044] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f2b778ac-011d-472f-9220-d8d50a881380 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1654.513189] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f2b778ac-011d-472f-9220-d8d50a881380" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1654.513306] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f2b778ac-011d-472f-9220-d8d50a881380" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1654.513406] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f2b778ac-011d-472f-9220-d8d50a881380" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1654.513478] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f2b778ac-011d-472f-9220-d8d50a881380',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1654.514219] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b472d7ce-a3a7-4859-8fa3-f222ee058e66 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1654.514327] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b472d7ce-a3a7-4859-8fa3-f222ee058e66" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1654.514397] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b472d7ce-a3a7-4859-8fa3-f222ee058e66" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1654.514546] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b472d7ce-a3a7-4859-8fa3-f222ee058e66" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1654.514616] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b472d7ce-a3a7-4859-8fa3-f222ee058e66',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1654.515315] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f0f521c8-595e-4f1b-a139-3ce8948484da taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1654.515423] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f0f521c8-595e-4f1b-a139-3ce8948484da" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1654.515490] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f0f521c8-595e-4f1b-a139-3ce8948484da" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1654.515637] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f0f521c8-595e-4f1b-a139-3ce8948484da" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1654.515707] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f0f521c8-595e-4f1b-a139-3ce8948484da',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1654.516430] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock rules-27aee5b6-679c-4e5c-baeb-bebfb0cf1e97 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1654.516541] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-27aee5b6-679c-4e5c-baeb-bebfb0cf1e97" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1654.516591] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-27aee5b6-679c-4e5c-baeb-bebfb0cf1e97" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1654.516738] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-27aee5b6-679c-4e5c-baeb-bebfb0cf1e97" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1654.516873] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('27aee5b6-679c-4e5c-baeb-bebfb0cf1e97',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1654.517600] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock rules-07d8236a-b9f2-429a-9942-e7cb46920213 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1654.517706] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-07d8236a-b9f2-429a-9942-e7cb46920213" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1654.517773] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-07d8236a-b9f2-429a-9942-e7cb46920213" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1654.517920] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-07d8236a-b9f2-429a-9942-e7cb46920213" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1654.517993] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('07d8236a-b9f2-429a-9942-e7cb46920213',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1654.545152] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1654.545272] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1654.545339] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1654.545520] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1654.547229] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1654.547318] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1654.547977] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1654.548088] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1654.562988] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1654.563090] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 00f20236-2b69-46dc-a00f-0c4d6b93c17a is going to be deleted. [ 1654.563825] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1654.563996] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1654.581098] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1654.581195] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 23fa8e46-c46e-429c-b533-b6ee73936de0 is going to be deleted. [ 1654.581879] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1654.582083] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1654.604559] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1654.604663] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4eb0fe0d-cd04-4189-9b26-953ab87885bd is going to be deleted. [ 1654.619112] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1654.619277] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1654.619277] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1654.619423] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1654.619505] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1654.619607] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-00f20236-2b69-46dc-a00f-0c4d6b93c17a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1654.628836] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1654.628946] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1654.628989] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1654.629140] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1654.629222] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1654.629324] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-23fa8e46-c46e-429c-b533-b6ee73936de0" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1654.673411] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1654.673583] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1654.673583] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1654.673760] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1654.673844] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1654.673954] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4eb0fe0d-cd04-4189-9b26-953ab87885bd" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1655.022591] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-ab85228d-7c6a-46c1-be82-5f17e49ba685 taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1655.022817] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ab85228d-7c6a-46c1-be82-5f17e49ba685" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1655.022817] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ab85228d-7c6a-46c1-be82-5f17e49ba685" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1655.023019] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ab85228d-7c6a-46c1-be82-5f17e49ba685" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1655.023188] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1655.023285] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1655.023349] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1655.023500] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1655.023588] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1655.023672] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ab85228d-7c6a-46c1-be82-5f17e49ba685" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1655.023757] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ab85228d-7c6a-46c1-be82-5f17e49ba685',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1655.076398] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1655.076636] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1655.076636] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1655.076794] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1655.078317] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1655.078431] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1655.079230] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1655.079328] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1655.080049] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1655.080165] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1655.080886] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1655.081023] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1655.081371] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1655.081460] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1655.082420] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1655.082510] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1655.083193] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1655.083276] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1655.083937] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1655.084045] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1655.084674] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1655.084772] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1655.085418] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1655.085513] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1655.086087] env[69980]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1655.086433] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1655.086524] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1655.087067] env[69980]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1655.087439] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1655.087534] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1655.088141] env[69980]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1655.088493] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1655.088584] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1655.089150] env[69980]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1655.089499] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1655.089592] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1655.090164] env[69980]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1655.090510] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1655.090600] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1655.093898] env[69980]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1655.094285] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1655.094394] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6719a83d-3363-4339-a277-6e1ec27ec7bc is going to be deleted. [ 1655.095146] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1655.095329] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1655.112266] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1655.112370] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 400b642e-7f7e-4993-9916-a3e96af018da is going to be deleted. [ 1655.113080] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1655.113247] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1655.130933] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1655.131058] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2961e549-f7d2-46b0-a1f4-9365d96bb58a is going to be deleted. [ 1655.131742] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1655.131924] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1655.146403] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1655.146498] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f2b778ac-011d-472f-9220-d8d50a881380 is going to be deleted. [ 1655.147178] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1655.147349] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1655.153100] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1655.153205] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1655.162599] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1655.162697] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f0f521c8-595e-4f1b-a139-3ce8948484da is going to be deleted. [ 1655.163409] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1655.163579] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1655.176394] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1655.176503] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1655.188381] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1655.188471] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1655.190015] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1655.190126] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 162065c3-9db0-41c8-9437-c51716e30968 is going to be deleted. [ 1655.191070] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1655.191240] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1655.250878] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1655.250981] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 27aee5b6-679c-4e5c-baeb-bebfb0cf1e97 is going to be deleted. [ 1655.251695] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1655.251919] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1655.260400] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1655.260507] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1655.275097] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1655.275239] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1655.289466] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1655.289580] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 825b0052-8bd1-4107-8258-075804cbc484 is going to be deleted. [ 1655.290315] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1655.290499] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1655.326867] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1655.326980] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1629967c-76d1-4b7e-a365-0305af6dc147 is going to be deleted. [ 1655.327714] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1655.327897] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1655.372137] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1655.372267] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1655.389728] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1655.390017] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b472d7ce-a3a7-4859-8fa3-f222ee058e66 is going to be deleted. [ 1655.390622] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1655.390813] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1655.404259] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1655.404380] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1655.410122] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1655.410221] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1655.445574] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1655.445678] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1655.448792] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1655.448905] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 48dd2a84-68ac-43c8-a7e2-4cb28bb82546 is going to be deleted. [ 1655.449712] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1655.449927] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1655.518281] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1655.518395] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 07d8236a-b9f2-429a-9942-e7cb46920213 is going to be deleted. [ 1655.519194] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1655.519391] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1655.524107] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1655.524232] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1655.527539] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ab85228d-7c6a-46c1-be82-5f17e49ba685',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1655.577985] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1655.578107] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 33e8376b-4b98-4aa5-8325-ac1f9953095a is going to be deleted. [ 1655.578910] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1655.579127] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1655.610775] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1655.610876] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 832bb529-72a6-428e-bdd7-50f804872365 is going to be deleted. [ 1655.611578] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1655.611757] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1655.650116] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1655.650251] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1655.652269] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1655.652379] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1655.661728] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1655.661838] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bb697495-b311-499b-98c5-fa0133350846 is going to be deleted. [ 1655.662626] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1655.662838] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1655.692066] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1655.692198] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1655.708246] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1655.708340] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9057c45b-1d82-49a9-8ffb-aaf0cddf5801 is going to be deleted. [ 1655.709135] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1655.709326] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1655.709414] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1655.709533] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6719a83d-3363-4339-a277-6e1ec27ec7bc" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1655.709679] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1655.709828] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1655.709907] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1655.710037] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-400b642e-7f7e-4993-9916-a3e96af018da" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1655.710451] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1655.710605] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1655.710699] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1655.710814] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2961e549-f7d2-46b0-a1f4-9365d96bb58a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1655.710943] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1655.711096] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1655.711172] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1655.711284] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f2b778ac-011d-472f-9220-d8d50a881380" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1655.711410] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1655.711547] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1655.711620] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1655.711727] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f0f521c8-595e-4f1b-a139-3ce8948484da" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1655.711852] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1655.712057] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1655.712140] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1655.712251] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-162065c3-9db0-41c8-9437-c51716e30968" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1655.712379] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1655.712519] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1655.712593] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1655.712703] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-27aee5b6-679c-4e5c-baeb-bebfb0cf1e97" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1655.712827] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1655.712972] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1655.713055] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1655.713165] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-825b0052-8bd1-4107-8258-075804cbc484" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1655.713289] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1655.713423] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1655.713495] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1655.713601] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1629967c-76d1-4b7e-a365-0305af6dc147" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1655.713719] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1655.713852] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1655.713925] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1655.714044] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b472d7ce-a3a7-4859-8fa3-f222ee058e66" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1655.714165] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1655.714300] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1655.714371] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1655.714471] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-07d8236a-b9f2-429a-9942-e7cb46920213" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1655.714589] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1655.714720] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1655.714790] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1655.714904] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-48dd2a84-68ac-43c8-a7e2-4cb28bb82546" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1655.715047] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1655.715185] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1655.715257] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1655.715357] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-33e8376b-4b98-4aa5-8325-ac1f9953095a" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1655.725706] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1655.725816] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1655.725885] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1655.726099] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1655.726196] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1655.726305] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-832bb529-72a6-428e-bdd7-50f804872365" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1655.752251] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1655.752374] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1655.752439] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1655.752574] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1655.752655] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1655.752762] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-bb697495-b311-499b-98c5-fa0133350846" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1655.807164] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1655.807289] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1655.807289] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1655.807458] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1655.807537] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1655.807649] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9057c45b-1d82-49a9-8ffb-aaf0cddf5801" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1656.029554] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ab85228d-7c6a-46c1-be82-5f17e49ba685: rpc.has_security_group_logging(os_id): False [ 1656.046904] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1656.047129] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1656.047129] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1656.047337] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1656.066122] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1656.066414] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1656.066545] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1656.066602] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1656.066799] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1656.066885] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1656.066976] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ab85228d-7c6a-46c1-be82-5f17e49ba685 is going to be updated. [ 1656.120503] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1656.120729] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1656.120729] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1656.120953] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1656.121123] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1656.132702] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ab85228d-7c6a-46c1-be82-5f17e49ba685 in Status: IN_PROGRESS for 2s [ 1658.146822] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ab85228d-7c6a-46c1-be82-5f17e49ba685 in Status: SUCCESS [ 1658.147165] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ab85228d-7c6a-46c1-be82-5f17e49ba685" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1659.376395] env[69980]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1659.376798] env[69980]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1664.377134] env[69980]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1664.377499] env[69980]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1669.378084] env[69980]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1669.378472] env[69980]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1674.379412] env[69980]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1674.379758] env[69980]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1674.664762] env[69980]: INFO networking_nsxv3.common.synchronization [req-bc3d1a11-2a4b-40eb-b10b-754d7c41ea03 req-0c4634ec-ec2b-4c62-9f15-aec62f1db2b5 tempest-AttachVolumeNegativeTest-1885261294 tempest-AttachVolumeNegativeTest-1885261294-project-member] Enqueued Resource ID: ab85228d-7c6a-46c1-be82-5f17e49ba685 with Priority: HIGHEST for action security_group_members [ 1674.665329] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ab85228d-7c6a-46c1-be82-5f17e49ba685 with Priority: HIGHEST for action security_group_members [ 1674.665962] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-ab85228d-7c6a-46c1-be82-5f17e49ba685 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1674.666110] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ab85228d-7c6a-46c1-be82-5f17e49ba685" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1674.666575] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ab85228d-7c6a-46c1-be82-5f17e49ba685" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1674.666575] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ab85228d-7c6a-46c1-be82-5f17e49ba685" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1674.666575] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1674.666824] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1674.666824] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1674.666824] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1674.666933] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1674.667015] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ab85228d-7c6a-46c1-be82-5f17e49ba685',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1675.168820] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1675.169051] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1675.169105] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1675.169293] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1675.169391] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1675.169591] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1675.169693] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1675.169757] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1675.169906] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1675.169983] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1675.170101] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ab85228d-7c6a-46c1-be82-5f17e49ba685 is going to be updated. [ 1675.199190] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1675.199333] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1675.199333] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1675.199492] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1675.199619] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1675.207451] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ab85228d-7c6a-46c1-be82-5f17e49ba685 in Status: IN_PROGRESS for 2s [ 1677.217596] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ab85228d-7c6a-46c1-be82-5f17e49ba685 in Status: SUCCESS [ 1677.217937] env[69980]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ab85228d-7c6a-46c1-be82-5f17e49ba685 deletion is rescheduled due to dependency. [ 1677.217937] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ab85228d-7c6a-46c1-be82-5f17e49ba685" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1679.486880] env[69980]: INFO networking_nsxv3.common.synchronization [None req-bb9442e7-5177-48d7-8b9f-e01e03c1b6fe tempest-AttachVolumeNegativeTest-1885261294 tempest-AttachVolumeNegativeTest-1885261294-project-member] Enqueued Resource ID: 620b6983-145f-4a4a-bdf4-cae066afc152 with Priority: HIGHEST for action security_group_rules [ 1679.487420] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 620b6983-145f-4a4a-bdf4-cae066afc152 with Priority: HIGHEST for action security_group_rules [ 1679.488044] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock rules-620b6983-145f-4a4a-bdf4-cae066afc152 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1679.488181] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-620b6983-145f-4a4a-bdf4-cae066afc152" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1679.488252] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-620b6983-145f-4a4a-bdf4-cae066afc152" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1679.488503] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-620b6983-145f-4a4a-bdf4-cae066afc152" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1679.488584] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('620b6983-145f-4a4a-bdf4-cae066afc152',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1679.548451] env[69980]: INFO networking_nsxv3.common.synchronization [None req-f3292909-6b04-452c-8f1f-9e05091aeedd tempest-AttachVolumeNegativeTest-1885261294 tempest-AttachVolumeNegativeTest-1885261294-project-member] Enqueued Resource ID: 620b6983-145f-4a4a-bdf4-cae066afc152 with Priority: HIGHEST for action security_group_rules [ 1679.548451] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 620b6983-145f-4a4a-bdf4-cae066afc152 with Priority: HIGHEST for action security_group_rules [ 1679.548451] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock rules-620b6983-145f-4a4a-bdf4-cae066afc152 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1679.548451] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-620b6983-145f-4a4a-bdf4-cae066afc152" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1680.010656] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1680.010831] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1680.010896] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1680.011153] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1680.011281] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1680.011347] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 620b6983-145f-4a4a-bdf4-cae066afc152 already deleted. [ 1680.011429] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-620b6983-145f-4a4a-bdf4-cae066afc152" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1680.011579] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-620b6983-145f-4a4a-bdf4-cae066afc152" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1680.011884] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-620b6983-145f-4a4a-bdf4-cae066afc152" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1680.011884] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('620b6983-145f-4a4a-bdf4-cae066afc152',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1680.531424] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1680.531798] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1680.531798] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1680.531860] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1680.531954] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1680.532057] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 620b6983-145f-4a4a-bdf4-cae066afc152 already deleted. [ 1680.532188] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-620b6983-145f-4a4a-bdf4-cae066afc152" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1684.548389] env[69980]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1684.548678] env[69980]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1684.710748] env[69980]: INFO networking_nsxv3.common.synchronization [req-16a97630-3059-45dc-bb9b-847af017b9fe req-5e41d821-4f8c-49c6-b2da-4db53db049f9 tempest-AttachVolumeNegativeTest-1885261294 tempest-AttachVolumeNegativeTest-1885261294-project-member] Enqueued Resource ID: 620b6983-145f-4a4a-bdf4-cae066afc152 with Priority: HIGHEST for action security_group_members [ 1684.711317] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 620b6983-145f-4a4a-bdf4-cae066afc152 with Priority: HIGHEST for action security_group_members [ 1684.711620] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-620b6983-145f-4a4a-bdf4-cae066afc152 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1684.711760] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-620b6983-145f-4a4a-bdf4-cae066afc152" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1684.711808] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-620b6983-145f-4a4a-bdf4-cae066afc152" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1684.712298] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-620b6983-145f-4a4a-bdf4-cae066afc152" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1684.712336] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1684.712448] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1684.712503] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1684.712687] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1684.712772] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1684.712885] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('620b6983-145f-4a4a-bdf4-cae066afc152',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1684.959610] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock network-820 taken with stack trace [, , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1684.959822] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "network-820" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1684.959951] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "network-820" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1684.960258] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "network-820" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1684.960522] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1684.960686] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1684.960805] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1684.961144] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1684.961335] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1684.961550] env[69980]: DEBUG dogpile.cache.region [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] No value present for key: 'zone-id' {{(pid=69980) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1684.961669] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] NeedRegenerationException {{(pid=69980) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1684.961779] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] no value, waiting for create lock {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1684.961889] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] value creation lock acquired {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1684.961999] env[69980]: DEBUG dogpile.cache.region [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] No value present for key: 'zone-id' {{(pid=69980) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1684.962121] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Calling creation function for not-yet-present value {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1684.962295] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1684.982836] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1684.982979] env[69980]: DEBUG dogpile.cache.region [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=69980) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1684.983137] env[69980]: DEBUG dogpile.lock [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Released creation lock {{(pid=69980) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1684.983323] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "network-820" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1684.983596] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock port-36ef16dd-0a21-4794-bd81-0af4d44c2fab taken with stack trace [, , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1684.983760] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "port-36ef16dd-0a21-4794-bd81-0af4d44c2fab" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1684.983882] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "port-36ef16dd-0a21-4794-bd81-0af4d44c2fab" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1684.984174] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "port-36ef16dd-0a21-4794-bd81-0af4d44c2fab" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1684.984341] env[69980]: DEBUG networking_nsxv3.api.rpc [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('36ef16dd-0a21-4794-bd81-0af4d44c2fab',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1685.214895] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1685.215078] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1685.215198] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1685.215341] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1685.215432] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1685.215629] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1685.215725] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1685.215786] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1685.215928] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1685.216011] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1685.216100] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 620b6983-145f-4a4a-bdf4-cae066afc152 already deleted. [ 1685.216179] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-620b6983-145f-4a4a-bdf4-cae066afc152" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1685.486933] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1685.487209] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1685.487325] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1685.487597] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1685.487753] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1685.487912] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Segment Port 36ef16dd-0a21-4794-bd81-0af4d44c2fab not found, creating... [ 1685.488188] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1685.488351] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1685.488472] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1685.488687] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1685.488826] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1685.489129] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1685.489325] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1685.489491] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1685.489709] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1685.489848] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1685.489991] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Resource: SegmentPort with ID: 36ef16dd-0a21-4794-bd81-0af4d44c2fab is going to be created. [ 1685.509140] env[69980]: DEBUG networking_nsxv3.common.locking [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1685.509396] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1685.509471] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1685.509690] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1685.509936] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1685.510196] env[69980]: DEBUG oslo_concurrency.lockutils [None req-515098f4-9704-4064-93ad-f3a113e072e4 None None] Releasing lock "port-36ef16dd-0a21-4794-bd81-0af4d44c2fab" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1686.162463] env[69980]: INFO networking_nsxv3.common.synchronization [req-16a97630-3059-45dc-bb9b-847af017b9fe req-455a572b-f609-4f4b-8446-756510cf8736 service nova] Enqueued Resource ID: 620b6983-145f-4a4a-bdf4-cae066afc152 with Priority: HIGHEST for action security_group_rules [ 1686.162710] env[69980]: INFO networking_nsxv3.common.synchronization [req-16a97630-3059-45dc-bb9b-847af017b9fe req-455a572b-f609-4f4b-8446-756510cf8736 service nova] Enqueued Resource ID: 620b6983-145f-4a4a-bdf4-cae066afc152 with Priority: HIGHEST for action security_group_members [ 1686.162773] env[69980]: INFO networking_nsxv3.common.synchronization [req-16a97630-3059-45dc-bb9b-847af017b9fe req-455a572b-f609-4f4b-8446-756510cf8736 service nova] Enqueued Resource ID: 36ef16dd-0a21-4794-bd81-0af4d44c2fab with Priority: HIGHEST for action port [ 1686.163010] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 620b6983-145f-4a4a-bdf4-cae066afc152 with Priority: HIGHEST for action security_group_rules [ 1686.163143] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 620b6983-145f-4a4a-bdf4-cae066afc152 with Priority: HIGHEST for action security_group_members [ 1686.163239] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 36ef16dd-0a21-4794-bd81-0af4d44c2fab with Priority: HIGHEST for action port [ 1686.163850] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock rules-620b6983-145f-4a4a-bdf4-cae066afc152 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1686.163933] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-620b6983-145f-4a4a-bdf4-cae066afc152" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1686.164010] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-620b6983-145f-4a4a-bdf4-cae066afc152" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1686.164285] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-620b6983-145f-4a4a-bdf4-cae066afc152" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1686.164372] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('620b6983-145f-4a4a-bdf4-cae066afc152',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1686.165552] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-620b6983-145f-4a4a-bdf4-cae066afc152 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1686.165664] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-620b6983-145f-4a4a-bdf4-cae066afc152" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1686.165732] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-620b6983-145f-4a4a-bdf4-cae066afc152" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1686.165887] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-620b6983-145f-4a4a-bdf4-cae066afc152" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1686.166042] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1686.166131] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1686.166203] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1686.166367] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1686.166452] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1686.166539] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('620b6983-145f-4a4a-bdf4-cae066afc152',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1686.167244] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock port-36ef16dd-0a21-4794-bd81-0af4d44c2fab taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1686.167488] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-36ef16dd-0a21-4794-bd81-0af4d44c2fab" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1686.167488] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-36ef16dd-0a21-4794-bd81-0af4d44c2fab" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1686.167569] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-36ef16dd-0a21-4794-bd81-0af4d44c2fab" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1686.167619] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('36ef16dd-0a21-4794-bd81-0af4d44c2fab',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1686.669396] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('620b6983-145f-4a4a-bdf4-cae066afc152',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1686.670450] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-620b6983-145f-4a4a-bdf4-cae066afc152 taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1686.670629] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-620b6983-145f-4a4a-bdf4-cae066afc152" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1686.671838] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 36ef16dd-0a21-4794-bd81-0af4d44c2fab with status ACTIVE [ 1686.672010] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1686.672129] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1686.672222] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1686.672427] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1686.672518] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1686.672689] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1686.672786] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1686.672847] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1686.673009] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1686.673119] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1686.673289] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1686.673386] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1686.673447] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1686.673588] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1686.673662] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1686.673744] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 36ef16dd-0a21-4794-bd81-0af4d44c2fab is going to be updated. [ 1686.692805] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1686.692959] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1686.692995] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1686.693186] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1686.693350] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1686.693473] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-36ef16dd-0a21-4794-bd81-0af4d44c2fab" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1687.175871] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('620b6983-145f-4a4a-bdf4-cae066afc152',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1687.677905] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1687.678098] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1687.678169] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1687.678372] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1687.678464] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1687.678566] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 620b6983-145f-4a4a-bdf4-cae066afc152 is going to be created. [ 1687.705910] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1687.706070] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1687.706070] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1687.706276] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1687.706431] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1687.715444] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 620b6983-145f-4a4a-bdf4-cae066afc152 in Status: UNINITIALIZED for 2s [ 1689.726041] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 620b6983-145f-4a4a-bdf4-cae066afc152 in Status: SUCCESS [ 1689.726367] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-620b6983-145f-4a4a-bdf4-cae066afc152" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1689.726367] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-620b6983-145f-4a4a-bdf4-cae066afc152" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1689.726571] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-620b6983-145f-4a4a-bdf4-cae066afc152" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1689.726761] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1689.726928] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1689.726928] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1689.727105] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1689.727184] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1689.727273] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-620b6983-145f-4a4a-bdf4-cae066afc152" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1689.727364] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('620b6983-145f-4a4a-bdf4-cae066afc152',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1690.229620] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('620b6983-145f-4a4a-bdf4-cae066afc152',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1690.732637] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 620b6983-145f-4a4a-bdf4-cae066afc152: rpc.has_security_group_logging(os_id): False [ 1690.749325] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1690.749497] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1690.749547] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1690.749739] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1690.749823] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1690.750082] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1690.750188] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1690.750242] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1690.750396] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1690.750471] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1690.750558] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 620b6983-145f-4a4a-bdf4-cae066afc152 is going to be created. [ 1690.804607] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1690.804751] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1690.804844] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1690.805015] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1690.805199] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1690.815248] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 620b6983-145f-4a4a-bdf4-cae066afc152 in Status: IN_PROGRESS for 2s [ 1691.164435] env[69980]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1691.164435] env[69980]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1692.828098] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 620b6983-145f-4a4a-bdf4-cae066afc152 in Status: SUCCESS [ 1692.828572] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-620b6983-145f-4a4a-bdf4-cae066afc152" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1696.166022] env[69980]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1696.166381] env[69980]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1701.167827] env[69980]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1701.168206] env[69980]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1706.168610] env[69980]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1706.168931] env[69980]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1711.170119] env[69980]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1711.170355] env[69980]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1716.171107] env[69980]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1716.171107] env[69980]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1721.171667] env[69980]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1721.172046] env[69980]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1726.172880] env[69980]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1726.173259] env[69980]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1731.174456] env[69980]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1731.174783] env[69980]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1736.176083] env[69980]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1736.176475] env[69980]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1741.177368] env[69980]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1741.177368] env[69980]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1746.177882] env[69980]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1746.178215] env[69980]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1748.713558] env[69980]: INFO networking_nsxv3.common.synchronization [req-057f8fec-279b-486d-add0-493535d90555 req-df4b9b01-4425-4199-92b0-d47cee47e913 tempest-AttachVolumeNegativeTest-1885261294 tempest-AttachVolumeNegativeTest-1885261294-project-member] Enqueued Resource ID: 620b6983-145f-4a4a-bdf4-cae066afc152 with Priority: HIGHEST for action security_group_members [ 1748.714110] env[69980]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 620b6983-145f-4a4a-bdf4-cae066afc152 with Priority: HIGHEST for action security_group_members [ 1748.714417] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock member-620b6983-145f-4a4a-bdf4-cae066afc152 taken with stack trace [, , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1748.714537] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-620b6983-145f-4a4a-bdf4-cae066afc152" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1748.714781] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-620b6983-145f-4a4a-bdf4-cae066afc152" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1748.714830] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-620b6983-145f-4a4a-bdf4-cae066afc152" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1748.714964] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1748.715120] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1748.715180] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1748.715277] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1748.715763] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1748.715763] env[69980]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('620b6983-145f-4a4a-bdf4-cae066afc152',) {} {{(pid=69980) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1749.218389] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1749.218595] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1749.218595] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1749.218828] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1749.218921] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1749.219143] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1749.219240] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1749.219303] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1749.219449] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1749.219527] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1749.219613] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 620b6983-145f-4a4a-bdf4-cae066afc152 is going to be updated. [ 1749.258290] env[69980]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69980) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1749.258479] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1749.258479] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1749.258677] env[69980]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1749.258813] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1749.266794] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 620b6983-145f-4a4a-bdf4-cae066afc152 in Status: IN_PROGRESS for 2s [ 1751.278221] env[69980]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 620b6983-145f-4a4a-bdf4-cae066afc152 in Status: SUCCESS [ 1751.278609] env[69980]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 620b6983-145f-4a4a-bdf4-cae066afc152 deletion is rescheduled due to dependency. [ 1751.278609] env[69980]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-620b6983-145f-4a4a-bdf4-cae066afc152" {{(pid=69980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1753.715252] env[69980]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1753.715586] env[69980]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1758.716212] env[69980]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1758.716610] env[69980]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1763.717065] env[69980]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1763.717333] env[69980]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1768.718681] env[69980]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1768.719129] env[69980]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1773.720153] env[69980]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1773.720486] env[69980]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1778.721789] env[69980]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1778.722193] env[69980]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1783.722907] env[69980]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1783.723348] env[69980]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0